2024-06-02T22:08:28.409 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-02T22:08:28.409 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600 --verbose --name teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/orig.config.yaml 2024-06-02T22:08:28.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T22:08:28.583 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7738600' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2064 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 125/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLU0pyu0EORyfuRvYsAt/9kn3txIrNh10QvjO6JTw9B7ASiwXVjyWpQeUvEZai7DSL57DztS9ImFk4DPUEh7UVg= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGDaarWNDpwv28qVGsS6dvlz9VtO9Fi/BnIzKtY2pq5OWvFvHG56KPIc5bucv7iFdwkq+o3J9ag0KIbMMUQeJig= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBwJyrPFOn8IByUFR5HV/EEfmuo9HzH35wnwf5VMVYJpfWhCgPtxwBelM/vcHfBsmTZMemZheoDl6U2hndiVtw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-02_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T22:08:28.583 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa; will attempt to use it 2024-06-02T22:08:28.584 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks 2024-06-02T22:08:28.584 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T22:08:28.586 INFO:teuthology.task.internal:Checking packages... 2024-06-02T22:08:28.607 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-02T22:08:28.607 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T22:08:28.607 INFO:teuthology.packaging:ref: None 2024-06-02T22:08:28.608 INFO:teuthology.packaging:tag: None 2024-06-02T22:08:28.608 INFO:teuthology.packaging:branch: squid 2024-06-02T22:08:28.608 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:08:28.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-02T22:08:28.808 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2952.gdfcc4b3c 2024-06-02T22:08:28.809 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T22:08:28.816 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T22:08:28.816 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T22:08:28.824 INFO:teuthology.task.internal:Saving configuration 2024-06-02T22:08:28.847 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T22:08:28.856 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T22:08:28.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:02:59.711816', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLU0pyu0EORyfuRvYsAt/9kn3txIrNh10QvjO6JTw9B7ASiwXVjyWpQeUvEZai7DSL57DztS9ImFk4DPUEh7UVg='} 2024-06-02T22:08:28.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:02:59.713882', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGDaarWNDpwv28qVGsS6dvlz9VtO9Fi/BnIzKtY2pq5OWvFvHG56KPIc5bucv7iFdwkq+o3J9ag0KIbMMUQeJig='} 2024-06-02T22:08:28.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 22:02:59.715442', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBwJyrPFOn8IByUFR5HV/EEfmuo9HzH35wnwf5VMVYJpfWhCgPtxwBelM/vcHfBsmTZMemZheoDl6U2hndiVtw='} 2024-06-02T22:08:28.932 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T22:08:28.940 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-02T22:08:28.941 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-02T22:08:28.941 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-02T22:08:28.941 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T22:08:29.031 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f234908fbe0>, signals=[15]) 2024-06-02T22:08:29.031 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T22:08:29.039 INFO:teuthology.task.internal:Opening connections... 2024-06-02T22:08:29.039 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:08:29.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:08:29.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-06-02T22:08:29.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:08:29.222 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-06-02T22:08:29.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:08:29.301 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T22:08:29.310 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-06-02T22:08:29.329 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-06-02T22:08:29.329 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-06-02T22:08:29.387 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:08:29.388 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:08:29.389 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-06-02T22:08:29.405 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-06-02T22:08:29.423 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-06-02T22:08:29.423 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-06-02T22:08:29.479 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:08:29.480 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:08:29.480 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-06-02T22:08:29.496 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-06-02T22:08:29.513 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-06-02T22:08:29.514 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-06-02T22:08:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-06-02T22:08:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-06-02T22:08:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-06-02T22:08:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-06-02T22:08:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T22:08:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T22:08:29.573 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-06-02T22:08:29.588 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T22:08:29.611 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T22:08:29.624 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T22:08:29.625 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:08:29.627 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:08:29.631 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-06-02T22:08:29.648 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T22:08:29.663 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T22:08:29.663 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:08:29.685 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:08:29.688 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-06-02T22:08:29.717 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T22:08:29.796 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T22:08:29.818 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-02T22:08:29.819 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-06-02T22:08:29.819 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-06-02T22:08:29.819 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:08:29.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:08:29.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-02T22:08:30.087 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T22:08:30.087 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-06-02T22:08:30.087 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-06-02T22:08:30.105 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-437.el9.x86_64 2024-06-02T22:08:30.106 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T22:08:30.106 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-02T22:08:30.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum upgrade -y linux-firmware 2024-06-02T22:08:32.347 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-02T22:08:34.097 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 32 MB/s | 19 MB 00:00 2024-06-02T22:08:38.206 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.2 MB 00:00 2024-06-02T22:08:39.740 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 17 kB 00:00 2024-06-02T22:08:41.267 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-06-02T22:08:46.633 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-06-02T22:08:48.839 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-06-02T22:08:48.840 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-06-02T22:08:48.840 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-06-02T22:08:48.933 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-02T22:08:48.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-02T22:08:49.089 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-06-02T22:08:49.089 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-02T22:08:49.092 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-06-02T22:09:02.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02 22:09:02 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-02T22:09:02.087 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2024-06-02 22:09:02-- 2024-06-02T22:09:02.088 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 13s 2024-06-02T22:09:02.088 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 340M in 13s (27.0 MB/s) 2024-06-02T22:09:02.090 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-02T22:09:02.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-02T22:09:04.270 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying... ######################################## 2024-06-02T22:09:04.391 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing... ######################################## 2024-06-02T22:09:04.500 INFO:teuthology.orchestra.run.smithi031.stdout:Updating / installing... 2024-06-02T22:09:12.820 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-06-02T22:09:52.514 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-02T22:09:52.515 DEBUG:teuthology.orchestra.run.smithi031:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-02T22:09:52.598 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/config-6.9.0-gb9459a26b088 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-06-02T22:09:52.599 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-02T22:09:52.600 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-06-02T22:09:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-06-02T22:09:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-06-02T22:09:52.603 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-06-02T22:09:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-06-02T22:09:52.605 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-06-02T22:09:52.606 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-06-02T22:09:52.607 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-06-02T22:09:52.608 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-06-02T22:09:52.609 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-06-02T22:09:52.610 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-06-02T22:09:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-06-02T22:09:52.612 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-06-02T22:09:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-06-02T22:09:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-06-02T22:09:52.615 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-06-02T22:09:52.616 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-02T22:09:52.617 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-06-02T22:09:52.618 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-06-02T22:09:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-02T22:09:52.620 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-06-02T22:09:52.621 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-02T22:09:52.622 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-02T22:09:52.623 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-02T22:09:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-02T22:09:52.625 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-06-02T22:09:52.626 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-02T22:09:52.627 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-06-02T22:09:52.628 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-06-02T22:09:52.629 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-06-02T22:09:52.630 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-06-02T22:09:52.631 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-06-02T22:09:52.632 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-06-02T22:09:52.633 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-06-02T22:09:52.634 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-06-02T22:09:52.635 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-06-02T22:09:52.636 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-06-02T22:09:52.637 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-02T22:09:52.638 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-06-02T22:09:52.639 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-02T22:09:52.640 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-06-02T22:09:52.641 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-06-02T22:09:52.642 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-06-02T22:09:52.643 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-06-02T22:09:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-06-02T22:09:52.645 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-02T22:09:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-06-02T22:09:52.647 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-06-02T22:09:52.648 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-06-02T22:09:52.649 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-02T22:09:52.650 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-02T22:09:52.651 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-06-02T22:09:52.652 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-06-02T22:09:52.653 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-02T22:09:52.654 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-02T22:09:52.655 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-06-02T22:09:52.656 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-02T22:09:52.657 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-02T22:09:52.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-02T22:09:52.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-06-02T22:09:52.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-02T22:09:52.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-06-02T22:09:52.658 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-06-02T22:09:52.659 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-06-02T22:09:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-06-02T22:09:52.661 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-06-02T22:09:52.662 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-06-02T22:09:52.663 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-06-02T22:09:52.664 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-06-02T22:09:52.665 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-02T22:09:52.666 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-06-02T22:09:52.667 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-02T22:09:52.668 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-06-02T22:09:52.669 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-06-02T22:09:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-02T22:09:52.671 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-02T22:09:52.672 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-06-02T22:09:52.673 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-02T22:09:52.674 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-02T22:09:52.675 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-02T22:09:52.676 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-02T22:09:52.677 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-02T22:09:52.678 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-02T22:09:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-06-02T22:09:52.680 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-02T22:09:52.681 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-02T22:09:52.682 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-02T22:09:52.683 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-02T22:09:52.684 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-02T22:09:52.685 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-02T22:09:52.686 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-02T22:09:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-06-02T22:09:52.688 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-06-02T22:09:52.689 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-02T22:09:52.690 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-06-02T22:09:52.691 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-06-02T22:09:52.692 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-06-02T22:09:52.693 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-02T22:09:52.694 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-06-02T22:09:52.695 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-06-02T22:09:52.696 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-06-02T22:09:52.697 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-06-02T22:09:52.698 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-02T22:09:52.699 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-06-02T22:09:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-02T22:09:52.701 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-02T22:09:52.702 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-02T22:09:52.703 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-02T22:09:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-02T22:09:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-06-02T22:09:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-02T22:09:52.707 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-06-02T22:09:52.708 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-02T22:09:52.709 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-06-02T22:09:52.710 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-06-02T22:09:52.711 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-02T22:09:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-06-02T22:09:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-02T22:09:52.714 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-02T22:09:52.715 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-06-02T22:09:52.716 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-06-02T22:09:52.717 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-02T22:09:52.718 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-02T22:09:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-06-02T22:09:52.720 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-06-02T22:09:52.721 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-06-02T22:09:52.722 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-06-02T22:09:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-02T22:09:52.724 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-06-02T22:09:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-02T22:09:52.726 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-02T22:09:52.727 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-06-02T22:09:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-02T22:09:52.729 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-06-02T22:09:52.730 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-02T22:09:52.731 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-02T22:09:52.732 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-06-02T22:09:52.733 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-02T22:09:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-02T22:09:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-02T22:09:52.736 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-06-02T22:09:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-06-02T22:09:52.738 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-06-02T22:09:52.739 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-06-02T22:09:52.740 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-06-02T22:09:52.741 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-06-02T22:09:52.742 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-06-02T22:09:52.743 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-06-02T22:09:52.744 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-06-02T22:09:52.745 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-02T22:09:52.746 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-06-02T22:09:52.747 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-06-02T22:09:52.748 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-06-02T22:09:52.749 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-06-02T22:09:52.749 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-06-02T22:09:52.749 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-06-02T22:09:52.749 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-06-02T22:09:52.749 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-06-02T22:09:52.750 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-06-02T22:09:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-06-02T22:09:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-06-02T22:09:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-06-02T22:09:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-06-02T22:09:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-06-02T22:09:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-06-02T22:09:52.753 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-06-02T22:09:52.754 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-06-02T22:09:52.755 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-06-02T22:09:52.756 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-06-02T22:09:52.757 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-06-02T22:09:52.758 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-06-02T22:09:52.759 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-06-02T22:09:52.760 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-02T22:09:52.761 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-06-02T22:09:52.762 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-06-02T22:09:52.763 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-06-02T22:09:52.764 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-02T22:09:52.765 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-06-02T22:09:52.766 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-06-02T22:09:52.767 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-06-02T22:09:52.768 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-02T22:09:52.769 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-02T22:09:52.770 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-06-02T22:09:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-06-02T22:09:52.772 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-06-02T22:09:52.773 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-02T22:09:52.774 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-02T22:09:52.775 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-02T22:09:52.776 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-06-02T22:09:52.777 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-06-02T22:09:52.778 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-06-02T22:09:52.779 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-02T22:09:52.780 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-02T22:09:52.781 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-02T22:09:52.782 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-02T22:09:52.783 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-02T22:09:52.784 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-02T22:09:52.785 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-06-02T22:09:52.786 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-06-02T22:09:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-06-02T22:09:52.788 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-06-02T22:09:52.789 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-06-02T22:09:52.790 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-06-02T22:09:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-06-02T22:09:52.792 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-06-02T22:09:52.793 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-06-02T22:09:52.794 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-06-02T22:09:52.795 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-06-02T22:09:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-06-02T22:09:52.797 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-06-02T22:09:52.798 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-06-02T22:09:52.799 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-06-02T22:09:52.800 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-06-02T22:09:52.801 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-06-02T22:09:52.802 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-06-02T22:09:52.803 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-06-02T22:09:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T22:09:52.809 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-06-02T22:09:52.809 DEBUG:teuthology.orchestra.run.smithi031:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-02T22:09:52.833 INFO:teuthology.orchestra.run.smithi031.stdout:postinstall scriptlet (using /bin/sh): 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout:for file in vmlinuz System.map config; do 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout: fi 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout:done 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-06-02T22:09:52.834 INFO:teuthology.orchestra.run.smithi031.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-06-02T22:09:52.835 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-06-02T22:09:52.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-06-02T22:09:52.910 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-06-02T22:09:52.910 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-06-02T22:09:52.911 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2024-06-02T22:09:52.911 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 68.el9 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8264254 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2024-06-02T22:09:52.912 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T22:09:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T22:09:52.914 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T22:09:52.914 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-06-02T22:09:52.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:09:52.914 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T22:09:52.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T22:09:52.915 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 6.9.0-gb9459a26b088 2024-06-02T22:09:52.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T22:09:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-06-02T22:09:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T22:09:55.058 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-06-02T22:09:55.060 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-06-02T22:09:55.093 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.niCAH1348Y 2024-06-02T22:09:55.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.niCAH1348Y 2024-06-02T22:09:55.159 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.niCAH1348Y 2024-06-02T22:09:55.318 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.niCAH1348Y is 6KB 2024-06-02T22:09:55.366 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.niCAH1348Y 2024-06-02T22:09:55.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T22:09:55.453 INFO:teuthology.orchestra.run.smithi031.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T22:09:55.454 INFO:teuthology.orchestra.run.smithi031.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T22:09:55.454 INFO:teuthology.orchestra.run.smithi031.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T22:09:55.454 INFO:teuthology.orchestra.run.smithi031.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-06-02T22:09:55.455 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-06-02T22:09:55.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-06-02T22:10:25.616 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-02T22:10:25.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-06-02T22:10:25.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:11:25.621 DEBUG:teuthology.orchestra.remote:timed out 2024-06-02T22:11:34.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-06-02T22:11:34.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:11:34.984 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-06-02T22:11:35.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-06-02T22:11:35.644 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-06-02T22:11:35.644 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-06-02T22:11:35.684 INFO:teuthology.orchestra.run.smithi031.stdout:6.9.0-gb9459a26b088 2024-06-02T22:11:35.684 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-06-02T22:11:35.684 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T22:11:35.684 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T22:11:36.688 DEBUG:teuthology.parallel:result is None 2024-06-02T22:11:36.688 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T22:11:36.696 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T22:11:36.697 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:11:36.702 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:11:36.705 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T22:11:36.748 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T22:11:36.755 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T22:11:36.763 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T22:11:36.764 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:11:36.798 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:11:36.801 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T22:11:36.848 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T22:11:36.854 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T22:11:36.855 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:11:36.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:11:36.882 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T22:11:36.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:11:36.899 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:11:36.903 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:11:36.925 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T22:11:36.958 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:36.974 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:37.001 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:37.018 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:37.033 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:37.078 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T22:11:37.082 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T22:11:37.089 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T22:11:37.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:11:37.094 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:11:37.096 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T22:11:37.157 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T22:11:37.166 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T22:11:37.166 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:11:37.171 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:11:37.173 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T22:11:37.206 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:37.332 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:37.426 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:37.510 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:37.595 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:11:37.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:11:37.688 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:37.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:37.782 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:37.865 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:37.908 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:11:37.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:11:37.974 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:38.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T22:11:38.077 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:38.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T22:11:38.202 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:11:38.202 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T22:11:38.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-06-02T22:11:38.275 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-06-02T22:11:38.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-06-02T22:11:38.311 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:11:38.346 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:11:38.383 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T22:11:38.955 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T22:11:38.966 INFO:teuthology.task.internal:Starting timer... 2024-06-02T22:11:38.966 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T22:11:39.049 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T22:11:39.073 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-02T22:11:39.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-06-02T22:11:39.189 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-06-02T22:11:39.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-06-02T22:11:39.257 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-06-02T22:11:39.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-06-02T22:11:39.333 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-06-02T22:11:39.335 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T22:11:39.335 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-06-02T22:11:39.402 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-06-02T22:11:39.403 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-06-02T22:11:39.435 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-06-02T22:11:39.436 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-06-02T22:11:39.455 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-06-02T22:11:39.455 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-06-02T22:11:39.455 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:11:39.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:11:39.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:11:39.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:11:39.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T22:11:39.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:11:39.576 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T22:11:39.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:11:39.646 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:11:39.671 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-06-02T22:11:39.696 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T22:11:39.707 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T22:11:39.710 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T22:11:39.851 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T22:11:39.864 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T22:11:39.865 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T22:18:26.755 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-06-02T22:18:26.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-06-02T22:18:26.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:18:26.865 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-06-02T22:18:27.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-06-02T22:18:27.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-06-02T22:18:27.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:18:27.094 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-06-02T22:18:27.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-06-02T22:18:27.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-06-02T22:18:27.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T22:18:27.251 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-06-02T22:18:27.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-06-02T22:18:27.334 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T22:18:27.344 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T22:18:27.345 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T22:18:27.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:18:27.353 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T22:18:27.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:18:27.355 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T22:18:27.355 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T22:18:27.385 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T22:18:27.400 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T22:18:27.407 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T22:18:27.421 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T22:18:27.424 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-06-02T22:18:27.435 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-06-02T22:18:27.445 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-06-02T22:18:27.447 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T22:18:27.449 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T22:18:27.456 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-06-02T22:18:27.462 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T22:18:27.470 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T22:18:27.483 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T22:18:27.492 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T22:18:27.525 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.539 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.542 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-06-02T22:18:27.606 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-06-02T22:18:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T22:18:27.693 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T22:18:27.830 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-06-02T22:18:27.839 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T22:18:27.840 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-06-02T22:18:27.840 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.840 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.840 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.840 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T22:18:27.841 INFO:teuthology.run_tasks:Running task install... 2024-06-02T22:18:27.850 DEBUG:teuthology.task.install:project ceph 2024-06-02T22:18:27.850 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-02T22:18:27.850 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T22:18:27.850 INFO:teuthology.task.install:Using flavor: default 2024-06-02T22:18:27.856 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T22:18:27.856 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T22:18:27.856 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T22:18:27.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:18:27.859 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T22:18:27.859 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:18:27.860 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T22:18:27.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:18:28.002 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T22:18:28.002 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T22:18:28.007 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T22:18:28.007 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T22:18:28.078 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T22:18:28.079 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T22:18:28.223 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T22:18:28.223 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:18:28.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T22:18:28.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T22:18:28.251 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T22:18:28.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T22:18:28.278 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:18:28.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T22:18:28.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T22:18:28.351 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T22:18:28.351 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:18:28.352 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T22:18:28.371 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T22:18:28.371 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T22:18:28.380 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T22:18:28.380 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T22:18:28.391 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T22:18:28.446 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T22:18:28.455 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-06-02T22:18:28.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-06-02T22:18:28.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T22:18:28.522 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T22:18:28.586 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-06-02T22:18:28.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-06-02T22:18:28.631 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T22:18:28.679 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-06-02T22:18:28.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T22:18:28.711 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-06-02T22:18:28.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-06-02T22:18:28.812 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-06-02T22:18:28.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T22:18:29.056 INFO:teuthology.orchestra.run.smithi031.stdout:45 files removed 2024-06-02T22:18:29.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T22:18:29.469 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 164 kB/s | 83 kB 00:00 2024-06-02T22:18:29.649 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 152 kB/s | 83 kB 00:00 2024-06-02T22:18:29.995 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-06-02T22:18:30.167 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 24 kB/s | 11 kB 00:00 2024-06-02T22:18:30.236 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 121 kB/s | 83 kB 00:00 2024-06-02T22:18:30.671 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-06-02T22:18:30.951 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-06-02T22:18:31.154 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.1 MB 00:00 2024-06-02T22:18:31.250 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 13 kB/s | 11 kB 00:00 2024-06-02T22:18:32.087 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-06-02T22:18:33.039 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-06-02T22:18:33.442 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.1 MB 00:02 2024-06-02T22:18:34.585 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.1 MB 00:02 2024-06-02T22:18:35.243 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-06-02T22:18:36.673 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-02T22:18:36.982 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-06-02T22:18:38.466 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 17 kB 00:00 2024-06-02T22:18:39.277 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-06-02T22:18:39.871 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-06-02T22:18:40.845 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 17 kB 00:00 2024-06-02T22:18:41.386 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-06-02T22:18:42.571 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-06-02T22:18:43.271 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 17 kB 00:00 2024-06-02T22:18:44.632 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-02T22:18:45.169 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-06-02T22:18:47.469 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:47.470 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:47.481 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T22:18:47.482 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T22:18:47.482 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T22:18:47.483 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T22:18:47.485 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T22:18:47.487 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T22:18:47.488 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T22:18:47.550 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-06-02T22:18:47.570 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-06-02T22:18:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-06-02T22:18:47.570 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-06-02T22:18:47.570 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-06-02T22:18:47.570 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T22:18:47.571 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T22:18:47.572 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T22:18:47.573 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T22:18:47.574 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T22:18:47.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T22:18:47.576 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T22:18:47.577 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T22:18:47.578 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T22:18:47.579 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T22:18:47.580 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T22:18:47.581 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T22:18:47.582 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T22:18:47.583 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout:Install 148 Packages 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 11 Packages 2024-06-02T22:18:47.584 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:18:47.585 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 225 M 2024-06-02T22:18:47.585 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-06-02T22:18:47.721 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-06-02T22:18:48.244 INFO:teuthology.orchestra.run.smithi098.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-06-02T22:18:48.469 INFO:teuthology.orchestra.run.smithi098.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 3.9 MB/s | 890 kB 00:00 2024-06-02T22:18:48.520 INFO:teuthology.orchestra.run.smithi098.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.8 MB/s | 145 kB 00:00 2024-06-02T22:18:48.820 INFO:teuthology.orchestra.run.smithi098.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-06-02T22:18:49.037 INFO:teuthology.orchestra.run.smithi098.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 1.5 MB 00:00 2024-06-02T22:18:49.404 INFO:teuthology.orchestra.run.smithi098.stdout:(6/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-06-02T22:18:49.646 INFO:teuthology.orchestra.run.smithi098.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 7.7 MB/s | 4.7 MB 00:00 2024-06-02T22:18:49.971 INFO:teuthology.orchestra.run.smithi098.stdout:(8/159): ceph-common-19.0.0-2946.g3d89accf.el9. 11 MB/s | 21 MB 00:01 2024-06-02T22:18:50.038 INFO:teuthology.orchestra.run.smithi098.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 377 kB/s | 25 kB 00:00 2024-06-02T22:18:50.039 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:50.039 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:50.050 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T22:18:50.050 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T22:18:50.051 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T22:18:50.052 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T22:18:50.054 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T22:18:50.056 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T22:18:50.057 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T22:18:50.120 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-06-02T22:18:50.145 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T22:18:50.146 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T22:18:50.147 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T22:18:50.148 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T22:18:50.149 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T22:18:50.150 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T22:18:50.151 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T22:18:50.152 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T22:18:50.153 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T22:18:50.154 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T22:18:50.155 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T22:18:50.156 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T22:18:50.157 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T22:18:50.158 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout:Install 148 Packages 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 11 Packages 2024-06-02T22:18:50.159 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:18:50.160 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 225 M 2024-06-02T22:18:50.160 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-06-02T22:18:50.655 INFO:teuthology.orchestra.run.smithi098.stdout:(10/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 10 MB/s | 10 MB 00:01 2024-06-02T22:18:50.722 INFO:teuthology.orchestra.run.smithi098.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 3.3 MB/s | 221 kB 00:00 2024-06-02T22:18:50.781 INFO:teuthology.orchestra.run.smithi098.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 464 kB/s | 27 kB 00:00 2024-06-02T22:18:50.850 INFO:teuthology.orchestra.run.smithi098.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 476 kB/s | 32 kB 00:00 2024-06-02T22:18:50.981 INFO:teuthology.orchestra.run.smithi098.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 5.5 MB/s | 747 kB 00:00 2024-06-02T22:18:51.013 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-06-02T22:18:51.022 INFO:teuthology.orchestra.run.smithi178.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-06-02T22:18:51.056 INFO:teuthology.orchestra.run.smithi098.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.1 MB/s | 163 kB 00:00 2024-06-02T22:18:51.132 INFO:teuthology.orchestra.run.smithi098.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.6 MB/s | 127 kB 00:00 2024-06-02T22:18:51.224 INFO:teuthology.orchestra.run.smithi098.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 5.3 MB/s | 501 kB 00:00 2024-06-02T22:18:51.458 INFO:teuthology.orchestra.run.smithi098.stdout:(18/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 8.2 MB/s | 17 MB 00:02 2024-06-02T22:18:51.550 INFO:teuthology.orchestra.run.smithi098.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 493 kB/s | 45 kB 00:00 2024-06-02T22:18:51.630 INFO:teuthology.orchestra.run.smithi178.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 890 kB 00:00 2024-06-02T22:18:51.650 INFO:teuthology.orchestra.run.smithi098.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.3 MB/s | 135 kB 00:00 2024-06-02T22:18:51.764 INFO:teuthology.orchestra.run.smithi178.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.1 MB/s | 145 kB 00:00 2024-06-02T22:18:51.775 INFO:teuthology.orchestra.run.smithi098.stdout:(21/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 9.7 MB/s | 5.3 MB 00:00 2024-06-02T22:18:51.801 INFO:teuthology.orchestra.run.smithi098.stdout:(22/159): python3-cephfs-19.0.0-2946.g3d89accf. 1.0 MB/s | 162 kB 00:00 2024-06-02T22:18:51.851 INFO:teuthology.orchestra.run.smithi098.stdout:(23/159): python3-rados-19.0.0-2946.g3d89accf.e 4.2 MB/s | 321 kB 00:00 2024-06-02T22:18:51.901 INFO:teuthology.orchestra.run.smithi098.stdout:(24/159): python3-rbd-19.0.0-2946.g3d89accf.el9 2.9 MB/s | 300 kB 00:00 2024-06-02T22:18:51.927 INFO:teuthology.orchestra.run.smithi098.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-02T22:18:51.985 INFO:teuthology.orchestra.run.smithi098.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.0 MB/s | 85 kB 00:00 2024-06-02T22:18:52.102 INFO:teuthology.orchestra.run.smithi098.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.4 MB/s | 171 kB 00:00 2024-06-02T22:18:52.219 INFO:teuthology.orchestra.run.smithi098.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 271 kB/s | 32 kB 00:00 2024-06-02T22:18:52.303 INFO:teuthology.orchestra.run.smithi098.stdout:(29/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 8.2 MB/s | 3.1 MB 00:00 2024-06-02T22:18:52.328 INFO:teuthology.orchestra.run.smithi098.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.3 MB/s | 142 kB 00:00 2024-06-02T22:18:52.664 INFO:teuthology.orchestra.run.smithi178.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-06-02T22:18:52.728 INFO:teuthology.orchestra.run.smithi098.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 8.3 MB/s | 3.5 MB 00:00 2024-06-02T22:18:52.812 INFO:teuthology.orchestra.run.smithi098.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.9 MB/s | 249 kB 00:00 2024-06-02T22:18:52.873 INFO:teuthology.orchestra.run.smithi178.stdout:(5/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-06-02T22:18:52.896 INFO:teuthology.orchestra.run.smithi098.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 740 kB/s | 49 kB 00:00 2024-06-02T22:18:52.948 INFO:teuthology.orchestra.run.smithi178.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 5.3 MB/s | 1.5 MB 00:00 2024-06-02T22:18:52.962 INFO:teuthology.orchestra.run.smithi098.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 197 kB/s | 16 kB 00:00 2024-06-02T22:18:53.046 INFO:teuthology.orchestra.run.smithi098.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-02T22:18:53.163 INFO:teuthology.orchestra.run.smithi098.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-02T22:18:53.239 INFO:teuthology.orchestra.run.smithi098.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 243 kB/s | 18 kB 00:00 2024-06-02T22:18:53.381 INFO:teuthology.orchestra.run.smithi098.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-06-02T22:18:53.531 INFO:teuthology.orchestra.run.smithi098.stdout:(39/159): libgfortran-11.4.1-3.el9.x86_64.rpm 5.2 MB/s | 803 kB 00:00 2024-06-02T22:18:53.581 INFO:teuthology.orchestra.run.smithi098.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-06-02T22:18:53.640 INFO:teuthology.orchestra.run.smithi098.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-06-02T22:18:53.758 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:53.760 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T22:18:53.782 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T22:18:53.783 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T22:18:53.784 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T22:18:53.786 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T22:18:53.788 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T22:18:53.790 INFO:teuthology.orchestra.run.smithi098.stdout:(42/159): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-06-02T22:18:53.792 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T22:18:53.793 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T22:18:53.849 INFO:teuthology.orchestra.run.smithi098.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-02T22:18:53.871 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T22:18:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T22:18:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T22:18:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T22:18:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T22:18:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T22:18:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T22:18:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T22:18:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T22:18:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T22:18:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T22:18:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T22:18:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T22:18:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:18:53.912 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-06-02T22:18:53.912 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================= 2024-06-02T22:18:53.912 INFO:teuthology.orchestra.run.smithi031.stdout:Install 148 Packages 2024-06-02T22:18:53.912 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 11 Packages 2024-06-02T22:18:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:18:53.913 INFO:teuthology.orchestra.run.smithi098.stdout:(44/159): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-06-02T22:18:53.913 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 225 M 2024-06-02T22:18:53.913 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-06-02T22:18:53.966 INFO:teuthology.orchestra.run.smithi098.stdout:(45/159): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-06-02T22:18:54.025 INFO:teuthology.orchestra.run.smithi098.stdout:(46/159): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-06-02T22:18:54.167 INFO:teuthology.orchestra.run.smithi098.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 4.8 MB/s | 689 kB 00:00 2024-06-02T22:18:54.225 INFO:teuthology.orchestra.run.smithi098.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-06-02T22:18:54.309 INFO:teuthology.orchestra.run.smithi098.stdout:(49/159): ceph-mgr-diskprediction-local-19.0.0- 3.7 MB/s | 7.4 MB 00:01 2024-06-02T22:18:54.335 INFO:teuthology.orchestra.run.smithi098.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 983 kB/s | 107 kB 00:00 2024-06-02T22:18:54.376 INFO:teuthology.orchestra.run.smithi098.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-06-02T22:18:54.393 INFO:teuthology.orchestra.run.smithi098.stdout:(52/159): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-06-02T22:18:54.410 INFO:teuthology.orchestra.run.smithi098.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 969 kB/s | 33 kB 00:00 2024-06-02T22:18:54.436 INFO:teuthology.orchestra.run.smithi098.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 732 kB/s | 18 kB 00:00 2024-06-02T22:18:54.461 INFO:teuthology.orchestra.run.smithi098.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 447 kB/s | 11 kB 00:00 2024-06-02T22:18:54.503 INFO:teuthology.orchestra.run.smithi098.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-06-02T22:18:54.553 INFO:teuthology.orchestra.run.smithi098.stdout:(57/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-06-02T22:18:54.578 INFO:teuthology.orchestra.run.smithi098.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-06-02T22:18:54.581 INFO:teuthology.orchestra.run.smithi178.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 2.7 MB/s | 4.7 MB 00:01 2024-06-02T22:18:54.621 INFO:teuthology.orchestra.run.smithi098.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-02T22:18:54.654 INFO:teuthology.orchestra.run.smithi098.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-06-02T22:18:54.680 INFO:teuthology.orchestra.run.smithi098.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 433 kB/s | 25 kB 00:00 2024-06-02T22:18:54.705 INFO:teuthology.orchestra.run.smithi098.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-06-02T22:18:54.730 INFO:teuthology.orchestra.run.smithi098.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-02T22:18:54.740 INFO:teuthology.orchestra.run.smithi178.stdout:(8/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 9.4 MB/s | 17 MB 00:01 2024-06-02T22:18:54.756 INFO:teuthology.orchestra.run.smithi098.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-06-02T22:18:54.781 INFO:teuthology.orchestra.run.smithi098.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 700 kB/s | 35 kB 00:00 2024-06-02T22:18:54.790 INFO:teuthology.orchestra.run.smithi178.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 505 kB/s | 25 kB 00:00 2024-06-02T22:18:54.890 INFO:teuthology.orchestra.run.smithi098.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-06-02T22:18:54.957 INFO:teuthology.orchestra.run.smithi098.stdout:(67/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-06-02T22:18:55.015 INFO:teuthology.orchestra.run.smithi098.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-02T22:18:55.057 INFO:teuthology.orchestra.run.smithi098.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-06-02T22:18:55.082 INFO:teuthology.orchestra.run.smithi098.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-06-02T22:18:55.090 INFO:teuthology.orchestra.run.smithi031.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-06-02T22:18:55.133 INFO:teuthology.orchestra.run.smithi098.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-06-02T22:18:55.208 INFO:teuthology.orchestra.run.smithi098.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-06-02T22:18:55.233 INFO:teuthology.orchestra.run.smithi098.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 872 kB/s | 87 kB 00:00 2024-06-02T22:18:55.284 INFO:teuthology.orchestra.run.smithi098.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-06-02T22:18:55.368 INFO:teuthology.orchestra.run.smithi098.stdout:(75/159): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-06-02T22:18:55.393 INFO:teuthology.orchestra.run.smithi098.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-06-02T22:18:55.418 INFO:teuthology.orchestra.run.smithi098.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-06-02T22:18:55.435 INFO:teuthology.orchestra.run.smithi098.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-06-02T22:18:55.452 INFO:teuthology.orchestra.run.smithi098.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-06-02T22:18:55.477 INFO:teuthology.orchestra.run.smithi098.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-02T22:18:55.494 INFO:teuthology.orchestra.run.smithi098.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-06-02T22:18:55.536 INFO:teuthology.orchestra.run.smithi098.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-02T22:18:55.611 INFO:teuthology.orchestra.run.smithi098.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-06-02T22:18:55.637 INFO:teuthology.orchestra.run.smithi098.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-06-02T22:18:55.662 INFO:teuthology.orchestra.run.smithi098.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T22:18:55.679 INFO:teuthology.orchestra.run.smithi098.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-06-02T22:18:55.704 INFO:teuthology.orchestra.run.smithi098.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-06-02T22:18:55.730 INFO:teuthology.orchestra.run.smithi098.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T22:18:56.048 INFO:teuthology.orchestra.run.smithi031.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 929 kB/s | 890 kB 00:00 2024-06-02T22:18:56.155 INFO:teuthology.orchestra.run.smithi098.stdout:(89/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 7.9 MB/s | 48 MB 00:06 2024-06-02T22:18:56.173 INFO:teuthology.orchestra.run.smithi031.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 1.1 MB/s | 145 kB 00:00 2024-06-02T22:18:56.180 INFO:teuthology.orchestra.run.smithi098.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 113 kB/s | 51 kB 00:00 2024-06-02T22:18:56.205 INFO:teuthology.orchestra.run.smithi098.stdout:(91/159): python3-pyasn1-modules-0.4.8-6.el9.no 557 kB/s | 279 kB 00:00 2024-06-02T22:18:56.248 INFO:teuthology.orchestra.run.smithi098.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-06-02T22:18:56.273 INFO:teuthology.orchestra.run.smithi098.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-06-02T22:18:56.282 INFO:teuthology.orchestra.run.smithi178.stdout:(10/159): ceph-common-19.0.0-2946.g3d89accf.el9 3.8 MB/s | 21 MB 00:05 2024-06-02T22:18:56.298 INFO:teuthology.orchestra.run.smithi098.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-06-02T22:18:56.324 INFO:teuthology.orchestra.run.smithi098.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-02T22:18:56.349 INFO:teuthology.orchestra.run.smithi098.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-06-02T22:18:56.374 INFO:teuthology.orchestra.run.smithi098.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-06-02T22:18:56.382 INFO:teuthology.orchestra.run.smithi178.stdout:(11/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 2.2 MB/s | 221 kB 00:00 2024-06-02T22:18:56.416 INFO:teuthology.orchestra.run.smithi098.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-06-02T22:18:56.441 INFO:teuthology.orchestra.run.smithi098.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-06-02T22:18:56.457 INFO:teuthology.orchestra.run.smithi178.stdout:(12/159): cephfs-shell-19.0.0-2946.g3d89accf.el 361 kB/s | 27 kB 00:00 2024-06-02T22:18:56.467 INFO:teuthology.orchestra.run.smithi098.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-02T22:18:56.492 INFO:teuthology.orchestra.run.smithi098.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-02T22:18:56.517 INFO:teuthology.orchestra.run.smithi098.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-06-02T22:18:56.524 INFO:teuthology.orchestra.run.smithi178.stdout:(13/159): libcephfs-devel-19.0.0-2946.g3d89accf 476 kB/s | 32 kB 00:00 2024-06-02T22:18:56.709 INFO:teuthology.orchestra.run.smithi098.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-06-02T22:18:56.735 INFO:teuthology.orchestra.run.smithi098.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-06-02T22:18:56.791 INFO:teuthology.orchestra.run.smithi178.stdout:(14/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 2.7 MB/s | 747 kB 00:00 2024-06-02T22:18:56.868 INFO:teuthology.orchestra.run.smithi098.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-06-02T22:18:56.875 INFO:teuthology.orchestra.run.smithi178.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 1.9 MB/s | 163 kB 00:00 2024-06-02T22:18:56.994 INFO:teuthology.orchestra.run.smithi098.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 155 kB/s | 19 kB 00:00 2024-06-02T22:18:57.000 INFO:teuthology.orchestra.run.smithi178.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.0 MB/s | 127 kB 00:00 2024-06-02T22:18:57.019 INFO:teuthology.orchestra.run.smithi098.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-06-02T22:18:57.044 INFO:teuthology.orchestra.run.smithi098.stdout:(108/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-06-02T22:18:57.094 INFO:teuthology.orchestra.run.smithi098.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-06-02T22:18:57.099 INFO:teuthology.orchestra.run.smithi031.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-06-02T22:18:57.120 INFO:teuthology.orchestra.run.smithi098.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-06-02T22:18:57.178 INFO:teuthology.orchestra.run.smithi098.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-02T22:18:57.184 INFO:teuthology.orchestra.run.smithi178.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 2.7 MB/s | 501 kB 00:00 2024-06-02T22:18:57.195 INFO:teuthology.orchestra.run.smithi098.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 670 kB/s | 67 kB 00:00 2024-06-02T22:18:57.296 INFO:teuthology.orchestra.run.smithi098.stdout:(113/159): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-06-02T22:18:57.329 INFO:teuthology.orchestra.run.smithi098.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-06-02T22:18:57.382 INFO:teuthology.orchestra.run.smithi098.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 618 kB/s | 32 kB 00:00 2024-06-02T22:18:57.407 INFO:teuthology.orchestra.run.smithi098.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 391 kB/s | 43 kB 00:00 2024-06-02T22:18:57.432 INFO:teuthology.orchestra.run.smithi098.stdout:(117/159): python3-asyncssh-2.13.2-5.el9.noarch 2.3 MB/s | 548 kB 00:00 2024-06-02T22:18:57.458 INFO:teuthology.orchestra.run.smithi098.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-06-02T22:18:57.483 INFO:teuthology.orchestra.run.smithi098.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-06-02T22:18:57.508 INFO:teuthology.orchestra.run.smithi098.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-06-02T22:18:57.542 INFO:teuthology.orchestra.run.smithi098.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-06-02T22:18:57.567 INFO:teuthology.orchestra.run.smithi098.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-06-02T22:18:57.599 INFO:teuthology.orchestra.run.smithi031.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-06-02T22:18:57.601 INFO:teuthology.orchestra.run.smithi098.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-06-02T22:18:57.618 INFO:teuthology.orchestra.run.smithi098.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-06-02T22:18:57.668 INFO:teuthology.orchestra.run.smithi098.stdout:(125/159): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-06-02T22:18:57.685 INFO:teuthology.orchestra.run.smithi098.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 210 kB/s | 18 kB 00:00 2024-06-02T22:18:57.702 INFO:teuthology.orchestra.run.smithi098.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 276 kB/s | 23 kB 00:00 2024-06-02T22:18:57.719 INFO:teuthology.orchestra.run.smithi098.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-06-02T22:18:57.744 INFO:teuthology.orchestra.run.smithi098.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-06-02T22:18:57.761 INFO:teuthology.orchestra.run.smithi098.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-06-02T22:18:57.795 INFO:teuthology.orchestra.run.smithi098.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-06-02T22:18:57.812 INFO:teuthology.orchestra.run.smithi098.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-06-02T22:18:57.845 INFO:teuthology.orchestra.run.smithi098.stdout:(133/159): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-06-02T22:18:57.871 INFO:teuthology.orchestra.run.smithi098.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-06-02T22:18:57.896 INFO:teuthology.orchestra.run.smithi098.stdout:(135/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-06-02T22:18:57.921 INFO:teuthology.orchestra.run.smithi098.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-02T22:18:57.947 INFO:teuthology.orchestra.run.smithi098.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-06-02T22:18:57.972 INFO:teuthology.orchestra.run.smithi098.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-06-02T22:18:57.984 INFO:teuthology.orchestra.run.smithi178.stdout:(18/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 15 MB/s | 48 MB 00:03 2024-06-02T22:18:57.997 INFO:teuthology.orchestra.run.smithi098.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-02T22:18:58.022 INFO:teuthology.orchestra.run.smithi098.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 782 kB/s | 59 kB 00:00 2024-06-02T22:18:58.043 INFO:teuthology.orchestra.run.smithi178.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 779 kB/s | 45 kB 00:00 2024-06-02T22:18:58.048 INFO:teuthology.orchestra.run.smithi098.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-06-02T22:18:58.073 INFO:teuthology.orchestra.run.smithi098.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-06-02T22:18:58.093 INFO:teuthology.orchestra.run.smithi178.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 2.6 MB/s | 135 kB 00:00 2024-06-02T22:18:58.098 INFO:teuthology.orchestra.run.smithi098.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-02T22:18:58.099 INFO:teuthology.orchestra.run.smithi031.stdout:(6/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-06-02T22:18:58.124 INFO:teuthology.orchestra.run.smithi098.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-02T22:18:58.152 INFO:teuthology.orchestra.run.smithi178.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.7 MB/s | 162 kB 00:00 2024-06-02T22:18:58.157 INFO:teuthology.orchestra.run.smithi098.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-06-02T22:18:58.183 INFO:teuthology.orchestra.run.smithi098.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-06-02T22:18:58.208 INFO:teuthology.orchestra.run.smithi098.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-06-02T22:18:58.210 INFO:teuthology.orchestra.run.smithi178.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 5.4 MB/s | 321 kB 00:00 2024-06-02T22:18:58.216 INFO:teuthology.orchestra.run.smithi031.stdout:(7/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 7.6 MB/s | 4.7 MB 00:00 2024-06-02T22:18:58.250 INFO:teuthology.orchestra.run.smithi098.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-06-02T22:18:58.269 INFO:teuthology.orchestra.run.smithi178.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 5.0 MB/s | 300 kB 00:00 2024-06-02T22:18:58.328 INFO:teuthology.orchestra.run.smithi178.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 99 kB 00:00 2024-06-02T22:18:58.395 INFO:teuthology.orchestra.run.smithi178.stdout:(25/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.4 MB/s | 5.3 MB 00:01 2024-06-02T22:18:58.420 INFO:teuthology.orchestra.run.smithi178.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 928 kB/s | 85 kB 00:00 2024-06-02T22:18:58.506 INFO:teuthology.orchestra.run.smithi178.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.0 MB/s | 171 kB 00:00 2024-06-02T22:18:58.604 INFO:teuthology.orchestra.run.smithi178.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 317 kB/s | 32 kB 00:00 2024-06-02T22:18:58.617 INFO:teuthology.orchestra.run.smithi098.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 6.3 MB/s | 2.3 MB 00:00 2024-06-02T22:18:58.712 INFO:teuthology.orchestra.run.smithi178.stdout:(29/159): ceph-radosgw-19.0.0-2946.g3d89accf.el 2.5 MB/s | 10 MB 00:04 2024-06-02T22:18:58.737 INFO:teuthology.orchestra.run.smithi178.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.0 MB/s | 142 kB 00:00 2024-06-02T22:18:58.809 INFO:teuthology.orchestra.run.smithi098.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-06-02T22:18:58.859 INFO:teuthology.orchestra.run.smithi098.stdout:(151/159): librados2-19.0.0-2946.g3d89accf.el9. 5.0 MB/s | 3.4 MB 00:00 2024-06-02T22:18:58.885 INFO:teuthology.orchestra.run.smithi098.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 549 kB/s | 41 kB 00:00 2024-06-02T22:18:58.935 INFO:teuthology.orchestra.run.smithi098.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 734 kB/s | 37 kB 00:00 2024-06-02T22:18:58.993 INFO:teuthology.orchestra.run.smithi098.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-02T22:18:59.052 INFO:teuthology.orchestra.run.smithi098.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 4.3 MB/s | 260 kB 00:00 2024-06-02T22:18:59.094 INFO:teuthology.orchestra.run.smithi098.stdout:(156/159): NetworkManager-tui-1.47.91-1.el9.x86 1.0 MB/s | 248 kB 00:00 2024-06-02T22:18:59.213 INFO:teuthology.orchestra.run.smithi098.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 8.4 MB/s | 1.3 MB 00:00 2024-06-02T22:18:59.386 INFO:teuthology.orchestra.run.smithi098.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-06-02T22:18:59.438 INFO:teuthology.orchestra.run.smithi178.stdout:(31/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 3.0 MB/s | 3.1 MB 00:01 2024-06-02T22:18:59.530 INFO:teuthology.orchestra.run.smithi098.stdout:(159/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-06-02T22:18:59.531 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:18:59.531 INFO:teuthology.orchestra.run.smithi098.stdout:Total 19 MB/s | 225 MB 00:11 2024-06-02T22:18:59.538 INFO:teuthology.orchestra.run.smithi178.stdout:(32/159): ceph-mgr-diskprediction-local-19.0.0- 9.2 MB/s | 7.4 MB 00:00 2024-06-02T22:18:59.563 INFO:teuthology.orchestra.run.smithi178.stdout:(33/159): ceph-mgr-modules-core-19.0.0-2946.g3d 1.9 MB/s | 249 kB 00:00 2024-06-02T22:18:59.583 INFO:teuthology.orchestra.run.smithi031.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 7.5 MB/s | 10 MB 00:01 2024-06-02T22:18:59.588 INFO:teuthology.orchestra.run.smithi178.stdout:(34/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 991 kB/s | 49 kB 00:00 2024-06-02T22:18:59.614 INFO:teuthology.orchestra.run.smithi178.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2946.g3 328 kB/s | 16 kB 00:00 2024-06-02T22:18:59.639 INFO:teuthology.orchestra.run.smithi178.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 5.1 MB/s | 264 kB 00:00 2024-06-02T22:18:59.641 INFO:teuthology.orchestra.run.smithi031.stdout:(9/159): ceph-selinux-19.0.0-2946.g3d89accf.el9 441 kB/s | 25 kB 00:00 2024-06-02T22:18:59.698 INFO:teuthology.orchestra.run.smithi178.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 313 kB/s | 18 kB 00:00 2024-06-02T22:18:59.765 INFO:teuthology.orchestra.run.smithi178.stdout:(38/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 5.0 MB/s | 763 kB 00:00 2024-06-02T22:18:59.798 INFO:teuthology.orchestra.run.smithi178.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 802 kB/s | 80 kB 00:00 2024-06-02T22:18:59.865 INFO:teuthology.orchestra.run.smithi178.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-06-02T22:18:59.907 INFO:teuthology.orchestra.run.smithi178.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-02T22:18:59.966 INFO:teuthology.orchestra.run.smithi178.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-06-02T22:19:00.000 INFO:teuthology.orchestra.run.smithi178.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-06-02T22:19:00.033 INFO:teuthology.orchestra.run.smithi178.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-06-02T22:19:00.083 INFO:teuthology.orchestra.run.smithi178.stdout:(45/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 2.6 MB/s | 3.5 MB 00:01 2024-06-02T22:19:00.109 INFO:teuthology.orchestra.run.smithi178.stdout:(46/159): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-06-02T22:19:00.134 INFO:teuthology.orchestra.run.smithi178.stdout:(47/159): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-06-02T22:19:00.201 INFO:teuthology.orchestra.run.smithi178.stdout:(48/159): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-06-02T22:19:00.318 INFO:teuthology.orchestra.run.smithi178.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-06-02T22:19:00.343 INFO:teuthology.orchestra.run.smithi178.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 753 kB/s | 107 kB 00:00 2024-06-02T22:19:00.369 INFO:teuthology.orchestra.run.smithi178.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-06-02T22:19:00.410 INFO:teuthology.orchestra.run.smithi178.stdout:(52/159): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-06-02T22:19:00.436 INFO:teuthology.orchestra.run.smithi178.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-06-02T22:19:00.461 INFO:teuthology.orchestra.run.smithi178.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-06-02T22:19:00.486 INFO:teuthology.orchestra.run.smithi178.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-06-02T22:19:00.511 INFO:teuthology.orchestra.run.smithi178.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-06-02T22:19:00.545 INFO:teuthology.orchestra.run.smithi178.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-02T22:19:00.570 INFO:teuthology.orchestra.run.smithi178.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-06-02T22:19:00.604 INFO:teuthology.orchestra.run.smithi178.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-02T22:19:00.638 INFO:teuthology.orchestra.run.smithi178.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-06-02T22:19:00.672 INFO:teuthology.orchestra.run.smithi178.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 380 kB/s | 25 kB 00:00 2024-06-02T22:19:00.697 INFO:teuthology.orchestra.run.smithi178.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-06-02T22:19:00.722 INFO:teuthology.orchestra.run.smithi178.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-02T22:19:00.745 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-06-02T22:19:00.772 INFO:teuthology.orchestra.run.smithi178.stdout:(64/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-06-02T22:19:00.798 INFO:teuthology.orchestra.run.smithi178.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-06-02T22:19:00.823 INFO:teuthology.orchestra.run.smithi178.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-06-02T22:19:00.900 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-06-02T22:19:00.901 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-06-02T22:19:00.934 INFO:teuthology.orchestra.run.smithi178.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-06-02T22:19:00.998 INFO:teuthology.orchestra.run.smithi178.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-06-02T22:19:01.032 INFO:teuthology.orchestra.run.smithi178.stdout:(69/159): postgresql-13.14-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-06-02T22:19:01.057 INFO:teuthology.orchestra.run.smithi178.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-02T22:19:01.099 INFO:teuthology.orchestra.run.smithi178.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-06-02T22:19:01.216 INFO:teuthology.orchestra.run.smithi178.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-06-02T22:19:01.358 INFO:teuthology.orchestra.run.smithi178.stdout:(73/159): python3-babel-2.9.1-2.el9.noarch.rpm 42 MB/s | 6.0 MB 00:00 2024-06-02T22:19:01.400 INFO:teuthology.orchestra.run.smithi178.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-06-02T22:19:01.450 INFO:teuthology.orchestra.run.smithi178.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-02T22:19:01.492 INFO:teuthology.orchestra.run.smithi178.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-06-02T22:19:01.526 INFO:teuthology.orchestra.run.smithi178.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 768 kB/s | 26 kB 00:00 2024-06-02T22:19:01.560 INFO:teuthology.orchestra.run.smithi178.stdout:(78/159): python3-jsonpointer-2.0-4.el9.noarch. 576 kB/s | 19 kB 00:00 2024-06-02T22:19:01.585 INFO:teuthology.orchestra.run.smithi178.stdout:(79/159): python3-attrs-20.3.0-7.el9.noarch.rpm 180 kB/s | 87 kB 00:00 2024-06-02T22:19:01.610 INFO:teuthology.orchestra.run.smithi178.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-06-02T22:19:01.835 INFO:teuthology.orchestra.run.smithi178.stdout:(81/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-06-02T22:19:01.886 INFO:teuthology.orchestra.run.smithi178.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-06-02T22:19:01.928 INFO:teuthology.orchestra.run.smithi178.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-06-02T22:19:01.961 INFO:teuthology.orchestra.run.smithi178.stdout:(84/159): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-06-02T22:19:01.987 INFO:teuthology.orchestra.run.smithi178.stdout:(85/159): python3-markupsafe-1.1.1-12.el9.x86_6 86 kB/s | 35 kB 00:00 2024-06-02T22:19:02.012 INFO:teuthology.orchestra.run.smithi178.stdout:(86/159): python3-packaging-20.9-5.el9.noarch.r 921 kB/s | 77 kB 00:00 2024-06-02T22:19:02.037 INFO:teuthology.orchestra.run.smithi178.stdout:(87/159): python3-prettytable-0.7.2-27.el9.noar 559 kB/s | 42 kB 00:00 2024-06-02T22:19:02.062 INFO:teuthology.orchestra.run.smithi178.stdout:(88/159): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-06-02T22:19:02.088 INFO:teuthology.orchestra.run.smithi178.stdout:(89/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T22:19:02.100 INFO:teuthology.orchestra.run.smithi031.stdout:(10/159): ceph-common-19.0.0-2946.g3d89accf.el9 2.8 MB/s | 21 MB 00:07 2024-06-02T22:19:02.113 INFO:teuthology.orchestra.run.smithi178.stdout:(90/159): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-06-02T22:19:02.138 INFO:teuthology.orchestra.run.smithi178.stdout:(91/159): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-06-02T22:19:02.197 INFO:teuthology.orchestra.run.smithi178.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 714 kB/s | 42 kB 00:00 2024-06-02T22:19:02.222 INFO:teuthology.orchestra.run.smithi178.stdout:(93/159): python3-requests-oauthlib-1.3.0-12.el 399 kB/s | 54 kB 00:00 2024-06-02T22:19:02.248 INFO:teuthology.orchestra.run.smithi178.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-06-02T22:19:02.273 INFO:teuthology.orchestra.run.smithi178.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-02T22:19:02.298 INFO:teuthology.orchestra.run.smithi178.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-06-02T22:19:02.323 INFO:teuthology.orchestra.run.smithi178.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-06-02T22:19:02.333 INFO:teuthology.orchestra.run.smithi031.stdout:(11/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 4.0 MB/s | 17 MB 00:04 2024-06-02T22:19:02.367 INFO:teuthology.orchestra.run.smithi031.stdout:(12/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 834 kB/s | 221 kB 00:00 2024-06-02T22:19:02.373 INFO:teuthology.orchestra.run.smithi178.stdout:(98/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-02T22:19:02.392 INFO:teuthology.orchestra.run.smithi031.stdout:(13/159): cephfs-shell-19.0.0-2946.g3d89accf.el 473 kB/s | 27 kB 00:00 2024-06-02T22:19:02.399 INFO:teuthology.orchestra.run.smithi178.stdout:(99/159): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-06-02T22:19:02.417 INFO:teuthology.orchestra.run.smithi031.stdout:(14/159): libcephfs-devel-19.0.0-2946.g3d89accf 646 kB/s | 32 kB 00:00 2024-06-02T22:19:02.424 INFO:teuthology.orchestra.run.smithi178.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-02T22:19:02.458 INFO:teuthology.orchestra.run.smithi178.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-02T22:19:02.483 INFO:teuthology.orchestra.run.smithi178.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-06-02T22:19:02.492 INFO:teuthology.orchestra.run.smithi031.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.2 MB/s | 163 kB 00:00 2024-06-02T22:19:02.551 INFO:teuthology.orchestra.run.smithi031.stdout:(16/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 4.6 MB/s | 747 kB 00:00 2024-06-02T22:19:02.585 INFO:teuthology.orchestra.run.smithi031.stdout:(17/159): librados-devel-19.0.0-2946.g3d89accf. 1.4 MB/s | 127 kB 00:00 2024-06-02T22:19:02.667 INFO:teuthology.orchestra.run.smithi178.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-06-02T22:19:02.668 INFO:teuthology.orchestra.run.smithi031.stdout:(18/159): libradosstriper1-19.0.0-2946.g3d89acc 4.2 MB/s | 501 kB 00:00 2024-06-02T22:19:02.736 INFO:teuthology.orchestra.run.smithi031.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 686 kB/s | 45 kB 00:00 2024-06-02T22:19:02.786 INFO:teuthology.orchestra.run.smithi031.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 2.7 MB/s | 135 kB 00:00 2024-06-02T22:19:02.844 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-06-02T22:19:02.845 INFO:teuthology.orchestra.run.smithi031.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.8 MB/s | 162 kB 00:00 2024-06-02T22:19:02.845 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-06-02T22:19:02.936 INFO:teuthology.orchestra.run.smithi031.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 3.5 MB/s | 321 kB 00:00 2024-06-02T22:19:03.017 INFO:teuthology.orchestra.run.smithi178.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-06-02T22:19:03.292 INFO:teuthology.orchestra.run.smithi178.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 877 kB/s | 548 kB 00:00 2024-06-02T22:19:03.392 INFO:teuthology.orchestra.run.smithi178.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 195 kB/s | 19 kB 00:00 2024-06-02T22:19:03.453 INFO:teuthology.orchestra.run.smithi031.stdout:(23/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 13 MB/s | 48 MB 00:03 2024-06-02T22:19:03.495 INFO:teuthology.orchestra.run.smithi031.stdout:(24/159): python3-rbd-19.0.0-2946.g3d89accf.el9 537 kB/s | 300 kB 00:00 2024-06-02T22:19:03.529 INFO:teuthology.orchestra.run.smithi031.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-02T22:19:03.559 INFO:teuthology.orchestra.run.smithi178.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 570 kB/s | 309 kB 00:00 2024-06-02T22:19:03.562 INFO:teuthology.orchestra.run.smithi031.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.3 MB/s | 85 kB 00:00 2024-06-02T22:19:03.602 INFO:teuthology.orchestra.run.smithi178.stdout:(108/159): protobuf-compiler-3.14.0-13.el9.x86_ 772 kB/s | 863 kB 00:01 2024-06-02T22:19:03.630 INFO:teuthology.orchestra.run.smithi031.stdout:(27/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.5 MB/s | 171 kB 00:00 2024-06-02T22:19:03.660 INFO:teuthology.orchestra.run.smithi178.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-06-02T22:19:03.705 INFO:teuthology.orchestra.run.smithi031.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 428 kB/s | 32 kB 00:00 2024-06-02T22:19:03.793 INFO:teuthology.orchestra.run.smithi178.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-06-02T22:19:03.810 INFO:teuthology.orchestra.run.smithi178.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 448 kB/s | 67 kB 00:00 2024-06-02T22:19:03.813 INFO:teuthology.orchestra.run.smithi031.stdout:(29/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 4.3 MB/s | 5.3 MB 00:01 2024-06-02T22:19:03.847 INFO:teuthology.orchestra.run.smithi031.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.0 MB/s | 142 kB 00:00 2024-06-02T22:19:03.894 INFO:teuthology.orchestra.run.smithi178.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-06-02T22:19:03.928 INFO:teuthology.orchestra.run.smithi178.stdout:(113/159): liboath-2.6.7-2.el9.x86_64.rpm 149 kB/s | 49 kB 00:00 2024-06-02T22:19:03.956 INFO:teuthology.orchestra.run.smithi031.stdout:(31/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 7.3 MB/s | 3.1 MB 00:00 2024-06-02T22:19:04.003 INFO:teuthology.orchestra.run.smithi178.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-06-02T22:19:04.070 INFO:teuthology.orchestra.run.smithi031.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.2 MB/s | 249 kB 00:00 2024-06-02T22:19:04.078 INFO:teuthology.orchestra.run.smithi178.stdout:(115/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-06-02T22:19:04.103 INFO:teuthology.orchestra.run.smithi178.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-06-02T22:19:04.131 INFO:teuthology.orchestra.run.smithi031.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 815 kB/s | 49 kB 00:00 2024-06-02T22:19:04.170 INFO:teuthology.orchestra.run.smithi178.stdout:(117/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 179 kB/s | 43 kB 00:00 2024-06-02T22:19:04.190 INFO:teuthology.orchestra.run.smithi031.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 286 kB/s | 16 kB 00:00 2024-06-02T22:19:04.196 INFO:teuthology.orchestra.run.smithi178.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-06-02T22:19:04.221 INFO:teuthology.orchestra.run.smithi178.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-06-02T22:19:04.274 INFO:teuthology.orchestra.run.smithi031.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-02T22:19:04.296 INFO:teuthology.orchestra.run.smithi178.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-06-02T22:19:04.322 INFO:teuthology.orchestra.run.smithi178.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-06-02T22:19:04.416 INFO:teuthology.orchestra.run.smithi031.stdout:(36/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 5.9 MB/s | 3.5 MB 00:00 2024-06-02T22:19:04.422 INFO:teuthology.orchestra.run.smithi178.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-06-02T22:19:04.464 INFO:teuthology.orchestra.run.smithi178.stdout:(123/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-06-02T22:19:04.474 INFO:teuthology.orchestra.run.smithi031.stdout:(37/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 3.7 MB/s | 763 kB 00:00 2024-06-02T22:19:04.491 INFO:teuthology.orchestra.run.smithi031.stdout:(38/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 246 kB/s | 18 kB 00:00 2024-06-02T22:19:04.523 INFO:teuthology.orchestra.run.smithi178.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-06-02T22:19:04.573 INFO:teuthology.orchestra.run.smithi178.stdout:(125/159): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-06-02T22:19:04.598 INFO:teuthology.orchestra.run.smithi178.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2024-06-02T22:19:04.623 INFO:teuthology.orchestra.run.smithi178.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-06-02T22:19:04.666 INFO:teuthology.orchestra.run.smithi031.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 421 kB/s | 80 kB 00:00 2024-06-02T22:19:04.674 INFO:teuthology.orchestra.run.smithi178.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-06-02T22:19:04.699 INFO:teuthology.orchestra.run.smithi178.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-06-02T22:19:04.741 INFO:teuthology.orchestra.run.smithi178.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-06-02T22:19:04.758 INFO:teuthology.orchestra.run.smithi031.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-06-02T22:19:04.774 INFO:teuthology.orchestra.run.smithi178.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-06-02T22:19:04.800 INFO:teuthology.orchestra.run.smithi031.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-06-02T22:19:04.808 INFO:teuthology.orchestra.run.smithi178.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 724 kB/s | 79 kB 00:00 2024-06-02T22:19:04.842 INFO:teuthology.orchestra.run.smithi178.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-06-02T22:19:04.851 INFO:teuthology.orchestra.run.smithi031.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-02T22:19:04.875 INFO:teuthology.orchestra.run.smithi178.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-06-02T22:19:04.909 INFO:teuthology.orchestra.run.smithi178.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-06-02T22:19:04.909 INFO:teuthology.orchestra.run.smithi031.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-02T22:19:04.942 INFO:teuthology.orchestra.run.smithi178.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-06-02T22:19:04.976 INFO:teuthology.orchestra.run.smithi178.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-06-02T22:19:05.010 INFO:teuthology.orchestra.run.smithi178.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-06-02T22:19:05.043 INFO:teuthology.orchestra.run.smithi178.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-06-02T22:19:05.059 INFO:teuthology.orchestra.run.smithi031.stdout:(44/159): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-06-02T22:19:05.077 INFO:teuthology.orchestra.run.smithi178.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-06-02T22:19:05.093 INFO:teuthology.orchestra.run.smithi031.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 740 kB/s | 135 kB 00:00 2024-06-02T22:19:05.110 INFO:teuthology.orchestra.run.smithi178.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-06-02T22:19:05.143 INFO:teuthology.orchestra.run.smithi031.stdout:(46/159): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-06-02T22:19:05.144 INFO:teuthology.orchestra.run.smithi178.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-06-02T22:19:05.177 INFO:teuthology.orchestra.run.smithi031.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-06-02T22:19:05.178 INFO:teuthology.orchestra.run.smithi178.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-02T22:19:05.219 INFO:teuthology.orchestra.run.smithi178.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-06-02T22:19:05.244 INFO:teuthology.orchestra.run.smithi031.stdout:(48/159): python3-requests-2.25.1-8.el9.noarch. 682 kB/s | 125 kB 00:00 2024-06-02T22:19:05.245 INFO:teuthology.orchestra.run.smithi178.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-06-02T22:19:05.270 INFO:teuthology.orchestra.run.smithi178.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-06-02T22:19:05.345 INFO:teuthology.orchestra.run.smithi178.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-06-02T22:19:05.369 INFO:teuthology.orchestra.run.smithi031.stdout:(49/159): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-06-02T22:19:05.387 INFO:teuthology.orchestra.run.smithi178.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-06-02T22:19:05.395 INFO:teuthology.orchestra.run.smithi031.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 715 kB/s | 107 kB 00:00 2024-06-02T22:19:05.420 INFO:teuthology.orchestra.run.smithi031.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 440 kB/s | 22 kB 00:00 2024-06-02T22:19:05.462 INFO:teuthology.orchestra.run.smithi031.stdout:(52/159): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-06-02T22:19:05.487 INFO:teuthology.orchestra.run.smithi031.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 496 kB/s | 33 kB 00:00 2024-06-02T22:19:05.521 INFO:teuthology.orchestra.run.smithi031.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-06-02T22:19:05.538 INFO:teuthology.orchestra.run.smithi178.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-02T22:19:05.546 INFO:teuthology.orchestra.run.smithi031.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-06-02T22:19:05.571 INFO:teuthology.orchestra.run.smithi031.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 226 kB/s | 11 kB 00:00 2024-06-02T22:19:05.613 INFO:teuthology.orchestra.run.smithi178.stdout:(150/159): librados2-19.0.0-2946.g3d89accf.el9. 9.9 MB/s | 3.4 MB 00:00 2024-06-02T22:19:05.621 INFO:teuthology.orchestra.run.smithi031.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-06-02T22:19:05.647 INFO:teuthology.orchestra.run.smithi031.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 609 kB/s | 45 kB 00:00 2024-06-02T22:19:05.655 INFO:teuthology.orchestra.run.smithi178.stdout:(151/159): NetworkManager-libnm-1.47.91-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-06-02T22:19:05.680 INFO:teuthology.orchestra.run.smithi178.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 620 kB/s | 41 kB 00:00 2024-06-02T22:19:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-06-02T22:19:05.705 INFO:teuthology.orchestra.run.smithi178.stdout:(153/159): NetworkManager-tui-1.47.91-1.el9.x86 4.8 MB/s | 248 kB 00:00 2024-06-02T22:19:05.731 INFO:teuthology.orchestra.run.smithi178.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 731 kB/s | 37 kB 00:00 2024-06-02T22:19:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-06-02T22:19:05.756 INFO:teuthology.orchestra.run.smithi178.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.0 MB/s | 207 kB 00:00 2024-06-02T22:19:05.764 INFO:teuthology.orchestra.run.smithi031.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 386 kB/s | 25 kB 00:00 2024-06-02T22:19:05.789 INFO:teuthology.orchestra.run.smithi031.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 963 kB/s | 47 kB 00:00 2024-06-02T22:19:05.798 INFO:teuthology.orchestra.run.smithi178.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 3.8 MB/s | 260 kB 00:00 2024-06-02T22:19:05.823 INFO:teuthology.orchestra.run.smithi031.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.0 MB/s | 292 kB 00:00 2024-06-02T22:19:05.840 INFO:teuthology.orchestra.run.smithi178.stdout:(157/159): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-06-02T22:19:05.906 INFO:teuthology.orchestra.run.smithi031.stdout:(64/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-06-02T22:19:05.915 INFO:teuthology.orchestra.run.smithi178.stdout:(158/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-06-02T22:19:05.932 INFO:teuthology.orchestra.run.smithi031.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 326 kB/s | 35 kB 00:00 2024-06-02T22:19:05.998 INFO:teuthology.orchestra.run.smithi031.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 907 kB/s | 188 kB 00:00 2024-06-02T22:19:06.107 INFO:teuthology.orchestra.run.smithi031.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-06-02T22:19:06.216 INFO:teuthology.orchestra.run.smithi031.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-06-02T22:19:06.249 INFO:teuthology.orchestra.run.smithi178.stdout:(159/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-06-02T22:19:06.252 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:19:06.252 INFO:teuthology.orchestra.run.smithi178.stdout:Total 14 MB/s | 225 MB 00:16 2024-06-02T22:19:06.308 INFO:teuthology.orchestra.run.smithi031.stdout:(69/159): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-06-02T22:19:06.341 INFO:teuthology.orchestra.run.smithi031.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-06-02T22:19:06.400 INFO:teuthology.orchestra.run.smithi031.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 3.1 MB/s | 911 kB 00:00 2024-06-02T22:19:06.459 INFO:teuthology.orchestra.run.smithi031.stdout:(72/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-06-02T22:19:06.526 INFO:teuthology.orchestra.run.smithi031.stdout:(73/159): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-06-02T22:19:06.676 INFO:teuthology.orchestra.run.smithi031.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-06-02T22:19:06.701 INFO:teuthology.orchestra.run.smithi031.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 351 kB/s | 61 kB 00:00 2024-06-02T22:19:06.735 INFO:teuthology.orchestra.run.smithi031.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-06-02T22:19:06.785 INFO:teuthology.orchestra.run.smithi031.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-06-02T22:19:06.802 INFO:teuthology.orchestra.run.smithi031.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 388 kB/s | 26 kB 00:00 2024-06-02T22:19:06.819 INFO:teuthology.orchestra.run.smithi031.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 582 kB/s | 19 kB 00:00 2024-06-02T22:19:06.853 INFO:teuthology.orchestra.run.smithi031.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-02T22:19:06.870 INFO:teuthology.orchestra.run.smithi031.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 701 kB/s | 35 kB 00:00 2024-06-02T22:19:06.995 INFO:teuthology.orchestra.run.smithi031.stdout:(82/159): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-06-02T22:19:07.029 INFO:teuthology.orchestra.run.smithi031.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-06-02T22:19:07.062 INFO:teuthology.orchestra.run.smithi031.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-06-02T22:19:07.087 INFO:teuthology.orchestra.run.smithi031.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-02T22:19:07.113 INFO:teuthology.orchestra.run.smithi031.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 856 kB/s | 42 kB 00:00 2024-06-02T22:19:07.163 INFO:teuthology.orchestra.run.smithi031.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-06-02T22:19:07.197 INFO:teuthology.orchestra.run.smithi031.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-06-02T22:19:07.230 INFO:teuthology.orchestra.run.smithi031.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-06-02T22:19:07.255 INFO:teuthology.orchestra.run.smithi031.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 885 kB/s | 51 kB 00:00 2024-06-02T22:19:07.281 INFO:teuthology.orchestra.run.smithi031.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-06-02T22:19:07.331 INFO:teuthology.orchestra.run.smithi031.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 841 kB/s | 42 kB 00:00 2024-06-02T22:19:07.381 INFO:teuthology.orchestra.run.smithi031.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 910 kB/s | 44 kB 00:00 2024-06-02T22:19:07.440 INFO:teuthology.orchestra.run.smithi031.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.8 MB/s | 221 kB 00:00 2024-06-02T22:19:07.509 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-06-02T22:19:07.565 INFO:teuthology.orchestra.run.smithi031.stdout:(95/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.2 MB/s | 5.1 MB 00:00 2024-06-02T22:19:07.590 INFO:teuthology.orchestra.run.smithi031.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 240 kB/s | 36 kB 00:00 2024-06-02T22:19:07.616 INFO:teuthology.orchestra.run.smithi031.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 956 kB/s | 47 kB 00:00 2024-06-02T22:19:07.649 INFO:teuthology.orchestra.run.smithi031.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-06-02T22:19:07.668 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-06-02T22:19:07.668 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-06-02T22:19:07.674 INFO:teuthology.orchestra.run.smithi031.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-06-02T22:19:07.700 INFO:teuthology.orchestra.run.smithi031.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-06-02T22:19:07.725 INFO:teuthology.orchestra.run.smithi031.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-06-02T22:19:07.750 INFO:teuthology.orchestra.run.smithi031.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 911 kB/s | 45 kB 00:00 2024-06-02T22:19:07.809 INFO:teuthology.orchestra.run.smithi031.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 270 kB/s | 22 kB 00:00 2024-06-02T22:19:08.134 INFO:teuthology.orchestra.run.smithi031.stdout:(104/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-06-02T22:19:08.176 INFO:teuthology.orchestra.run.smithi031.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-06-02T22:19:08.477 INFO:teuthology.orchestra.run.smithi031.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-06-02T22:19:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 756 kB/s | 548 kB 00:00 2024-06-02T22:19:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 679 kB/s | 309 kB 00:00 2024-06-02T22:19:08.619 INFO:teuthology.orchestra.run.smithi031.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 314 kB/s | 26 kB 00:00 2024-06-02T22:19:08.669 INFO:teuthology.orchestra.run.smithi031.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 654 kB/s | 49 kB 00:00 2024-06-02T22:19:08.719 INFO:teuthology.orchestra.run.smithi031.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 678 kB/s | 67 kB 00:00 2024-06-02T22:19:08.761 INFO:teuthology.orchestra.run.smithi031.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-06-02T22:19:08.862 INFO:teuthology.orchestra.run.smithi031.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-06-02T22:19:08.912 INFO:teuthology.orchestra.run.smithi031.stdout:(114/159): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-06-02T22:19:08.937 INFO:teuthology.orchestra.run.smithi031.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 584 kB/s | 43 kB 00:00 2024-06-02T22:19:08.987 INFO:teuthology.orchestra.run.smithi031.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 434 kB/s | 32 kB 00:00 2024-06-02T22:19:09.013 INFO:teuthology.orchestra.run.smithi031.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-06-02T22:19:09.063 INFO:teuthology.orchestra.run.smithi031.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-06-02T22:19:09.146 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-06-02T22:19:09.163 INFO:teuthology.orchestra.run.smithi031.stdout:(119/159): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-06-02T22:19:09.197 INFO:teuthology.orchestra.run.smithi031.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-06-02T22:19:09.216 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T22:19:09.230 INFO:teuthology.orchestra.run.smithi031.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-06-02T22:19:09.262 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T22:19:09.264 INFO:teuthology.orchestra.run.smithi031.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-06-02T22:19:09.306 INFO:teuthology.orchestra.run.smithi031.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-06-02T22:19:09.316 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T22:19:09.331 INFO:teuthology.orchestra.run.smithi031.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-06-02T22:19:09.359 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T22:19:09.384 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T22:19:09.407 INFO:teuthology.orchestra.run.smithi031.stdout:(125/159): python3-grpcio-1.46.7-10.el9.x86_64. 9.8 MB/s | 2.0 MB 00:00 2024-06-02T22:19:09.427 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T22:19:09.432 INFO:teuthology.orchestra.run.smithi031.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-06-02T22:19:09.457 INFO:teuthology.orchestra.run.smithi031.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 186 kB/s | 23 kB 00:00 2024-06-02T22:19:09.466 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-06-02T22:19:09.466 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-06-02T22:19:09.591 INFO:teuthology.orchestra.run.smithi031.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 107 kB/s | 19 kB 00:00 2024-06-02T22:19:09.616 INFO:teuthology.orchestra.run.smithi031.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 125 kB/s | 20 kB 00:00 2024-06-02T22:19:09.674 INFO:teuthology.orchestra.run.smithi031.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-06-02T22:19:09.700 INFO:teuthology.orchestra.run.smithi031.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-06-02T22:19:09.725 INFO:teuthology.orchestra.run.smithi031.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 730 kB/s | 79 kB 00:00 2024-06-02T22:19:09.750 INFO:teuthology.orchestra.run.smithi031.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-06-02T22:19:09.757 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T22:19:09.792 INFO:teuthology.orchestra.run.smithi031.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-06-02T22:19:09.817 INFO:teuthology.orchestra.run.smithi031.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-06-02T22:19:09.843 INFO:teuthology.orchestra.run.smithi031.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 982 kB/s | 90 kB 00:00 2024-06-02T22:19:09.877 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:09.902 INFO:teuthology.orchestra.run.smithi031.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-06-02T22:19:09.927 INFO:teuthology.orchestra.run.smithi031.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-06-02T22:19:09.960 INFO:teuthology.orchestra.run.smithi031.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-06-02T22:19:09.985 INFO:teuthology.orchestra.run.smithi031.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 716 kB/s | 59 kB 00:00 2024-06-02T22:19:09.999 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:10.011 INFO:teuthology.orchestra.run.smithi031.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2024-06-02T22:19:10.028 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:10.036 INFO:teuthology.orchestra.run.smithi031.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-06-02T22:19:10.070 INFO:teuthology.orchestra.run.smithi031.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-06-02T22:19:10.087 INFO:teuthology.orchestra.run.smithi031.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-02T22:19:10.111 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:10.129 INFO:teuthology.orchestra.run.smithi031.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-06-02T22:19:10.141 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:19:10.154 INFO:teuthology.orchestra.run.smithi031.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2024-06-02T22:19:10.173 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T22:19:10.187 INFO:teuthology.orchestra.run.smithi031.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-06-02T22:19:10.288 INFO:teuthology.orchestra.run.smithi031.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-06-02T22:19:10.364 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T22:19:10.414 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T22:19:10.451 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:10.553 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:10.577 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:10.613 INFO:teuthology.orchestra.run.smithi031.stdout:(149/159): librados2-19.0.0-2946.g3d89accf.el9. 7.4 MB/s | 3.4 MB 00:00 2024-06-02T22:19:10.664 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:10.686 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:10.696 INFO:teuthology.orchestra.run.smithi031.stdout:(150/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-06-02T22:19:10.711 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:10.772 INFO:teuthology.orchestra.run.smithi031.stdout:(151/159): NetworkManager-1.47.91-1.el9.x86_64. 4.8 MB/s | 2.3 MB 00:00 2024-06-02T22:19:10.805 INFO:teuthology.orchestra.run.smithi031.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 385 kB/s | 41 kB 00:00 2024-06-02T22:19:10.839 INFO:teuthology.orchestra.run.smithi031.stdout:(153/159): NetworkManager-tui-1.47.91-1.el9.x86 3.7 MB/s | 248 kB 00:00 2024-06-02T22:19:10.864 INFO:teuthology.orchestra.run.smithi031.stdout:(154/159): elfutils-debuginfod-client-0.191-4.e 634 kB/s | 37 kB 00:00 2024-06-02T22:19:10.914 INFO:teuthology.orchestra.run.smithi031.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 2.7 MB/s | 207 kB 00:00 2024-06-02T22:19:10.920 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:10.998 INFO:teuthology.orchestra.run.smithi031.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 1.9 MB/s | 260 kB 00:00 2024-06-02T22:19:11.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:11.065 INFO:teuthology.orchestra.run.smithi031.stdout:(157/159): NetworkManager-libnm-1.47.91-1.el9.x 4.0 MB/s | 1.8 MB 00:00 2024-06-02T22:19:11.174 INFO:teuthology.orchestra.run.smithi031.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 1.3 MB 00:00 2024-06-02T22:19:11.209 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:11.270 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:11.352 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:11.454 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:11.457 INFO:teuthology.orchestra.run.smithi031.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 2.4 MB 00:00 2024-06-02T22:19:11.470 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:19:11.470 INFO:teuthology.orchestra.run.smithi031.stdout:Total 13 MB/s | 225 MB 00:17 2024-06-02T22:19:11.671 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:11.779 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T22:19:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T22:19:11.920 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T22:19:11.971 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T22:19:12.061 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T22:19:12.102 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T22:19:12.146 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T22:19:12.178 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T22:19:12.207 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T22:19:12.275 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T22:19:12.328 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T22:19:12.359 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T22:19:12.394 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T22:19:12.472 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T22:19:12.506 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T22:19:12.549 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T22:19:12.578 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T22:19:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T22:19:12.693 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T22:19:12.767 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T22:19:12.899 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T22:19:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T22:19:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T22:19:13.549 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T22:19:13.580 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T22:19:13.615 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T22:19:13.682 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T22:19:13.719 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T22:19:13.760 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T22:19:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T22:19:13.963 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T22:19:14.018 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T22:19:14.091 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T22:19:14.131 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T22:19:14.168 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T22:19:14.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T22:19:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T22:19:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T22:19:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T22:19:14.472 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T22:19:14.513 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T22:19:14.554 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T22:19:14.811 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-06-02T22:19:14.849 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T22:19:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T22:19:15.003 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T22:19:15.029 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T22:19:15.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T22:19:15.087 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-06-02T22:19:15.087 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-06-02T22:19:15.128 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T22:19:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T22:19:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T22:19:15.318 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T22:19:15.349 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T22:19:15.388 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T22:19:15.419 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T22:19:15.449 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T22:19:15.484 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T22:19:15.517 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T22:19:15.550 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T22:19:15.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T22:19:15.672 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T22:19:15.726 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T22:19:15.755 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T22:19:15.802 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T22:19:15.856 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-06-02T22:19:15.900 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T22:19:15.936 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T22:19:15.956 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T22:19:15.974 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T22:19:16.027 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T22:19:16.062 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T22:19:16.087 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T22:19:16.130 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T22:19:16.468 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T22:19:16.580 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:16.669 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T22:19:16.686 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:16.712 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T22:19:16.714 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:16.746 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T22:19:16.806 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:16.835 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:19:16.845 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T22:19:16.868 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T22:19:16.893 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T22:19:16.939 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T22:19:17.026 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T22:19:17.042 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T22:19:17.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T22:19:17.100 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T22:19:17.136 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:17.222 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:17.234 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T22:19:17.246 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:17.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T22:19:17.308 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:17.330 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:17.341 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T22:19:17.349 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:17.538 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:17.770 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-06-02T22:19:17.774 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-06-02T22:19:17.810 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:17.870 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:17.982 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:17.982 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T22:19:18.058 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T22:19:18.265 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:18.374 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T22:19:18.465 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T22:19:18.497 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T22:19:18.531 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T22:19:18.596 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T22:19:18.631 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T22:19:18.683 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T22:19:18.715 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T22:19:18.743 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T22:19:18.812 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T22:19:18.866 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T22:19:18.897 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T22:19:18.941 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T22:19:19.015 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T22:19:19.051 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T22:19:19.094 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T22:19:19.123 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T22:19:19.193 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T22:19:19.238 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T22:19:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T22:19:19.320 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T22:19:19.394 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T22:19:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T22:19:19.451 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T22:19:19.455 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T22:19:19.499 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T22:19:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T22:19:19.822 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:19.892 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:19.923 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T22:19:19.959 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T22:19:20.017 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T22:19:20.094 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T22:19:20.124 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T22:19:20.160 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T22:19:20.201 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T22:19:20.239 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T22:19:20.280 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T22:19:20.430 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T22:19:20.431 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T22:19:20.472 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:20.501 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T22:19:20.542 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:20.555 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T22:19:20.565 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T22:19:20.619 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T22:19:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T22:19:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T22:19:20.751 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T22:19:20.787 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T22:19:20.830 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T22:19:20.872 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T22:19:21.008 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T22:19:21.050 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T22:19:21.091 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T22:19:21.184 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T22:19:21.443 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T22:19:21.484 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T22:19:21.516 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T22:19:21.541 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T22:19:21.631 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T22:19:21.771 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T22:19:21.807 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T22:19:21.834 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T22:19:21.869 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T22:19:21.908 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T22:19:21.939 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T22:19:21.970 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T22:19:21.996 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T22:19:22.029 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T22:19:22.072 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T22:19:22.105 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T22:19:22.194 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T22:19:22.236 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T22:19:22.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T22:19:22.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T22:19:22.413 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T22:19:22.469 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T22:19:22.822 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:22.870 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:23.188 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T22:19:23.241 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T22:19:23.275 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T22:19:23.374 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T22:19:23.404 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:23.431 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T22:19:23.440 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:23.475 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T22:19:23.537 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:23.537 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T22:19:23.538 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T22:19:23.538 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:23.567 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:23.571 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T22:19:23.604 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T22:19:23.781 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T22:19:23.809 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T22:19:23.888 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T22:19:24.517 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T22:19:24.634 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T22:19:24.839 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-06-02T22:19:25.076 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T22:19:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T22:19:25.281 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T22:19:25.346 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T22:19:25.382 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T22:19:25.508 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T22:19:25.857 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T22:19:25.940 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T22:19:25.968 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T22:19:25.977 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T22:19:26.001 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T22:19:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:26.304 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:26.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T22:19:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:26.364 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:26.456 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:26.476 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:26.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T22:19:26.522 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:19:26.523 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T22:19:26.630 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T22:19:26.947 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T22:19:27.001 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T22:19:27.015 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T22:19:27.034 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:27.044 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:27.105 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:27.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T22:19:27.215 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:27.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:27.366 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T22:19:27.396 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:27.473 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T22:19:27.822 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:28.162 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T22:19:28.370 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:28.502 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T22:19:28.688 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:28.816 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:29.181 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T22:19:29.379 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:29.390 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T22:19:29.417 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T22:19:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T22:19:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T22:19:29.751 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T22:19:29.806 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T22:19:29.873 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T22:19:29.918 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T22:19:29.956 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:29.958 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T22:19:29.995 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:30.079 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T22:19:30.088 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:30.089 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T22:19:30.089 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T22:19:30.089 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:30.121 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:30.155 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T22:19:30.201 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T22:19:30.260 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T22:19:30.373 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T22:19:30.422 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T22:19:30.499 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T22:19:30.538 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T22:19:30.668 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T22:19:30.733 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T22:19:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T22:19:31.039 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T22:19:31.109 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T22:19:31.833 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T22:19:31.955 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T22:19:32.143 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T22:19:32.188 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T22:19:32.270 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T22:19:32.338 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T22:19:32.458 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T22:19:32.698 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T22:19:32.797 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T22:19:32.875 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T22:19:33.101 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T22:19:33.140 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T22:19:33.205 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T22:19:33.289 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T22:19:33.339 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T22:19:33.404 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T22:19:33.468 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T22:19:33.679 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T22:19:33.738 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T22:19:33.792 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T22:19:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T22:19:33.971 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T22:19:34.020 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T22:19:34.052 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T22:19:34.077 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T22:19:34.270 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T22:19:34.559 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T22:19:34.642 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T22:19:34.680 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T22:19:34.737 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T22:19:34.807 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T22:19:34.876 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T22:19:34.924 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T22:19:34.979 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T22:19:35.028 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T22:19:35.105 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T22:19:35.158 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T22:19:35.337 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-06-02T22:19:35.398 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T22:19:35.457 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T22:19:35.530 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T22:19:35.555 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:35.570 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:35.571 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:35.571 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T22:19:35.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:35.718 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T22:19:35.787 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T22:19:36.788 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T22:19:36.851 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T22:19:36.885 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T22:19:37.015 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T22:19:37.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:19:37.069 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:37.077 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T22:19:37.166 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T22:19:37.282 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T22:19:37.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:19:37.308 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:37.321 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T22:19:37.572 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T22:19:37.609 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T22:19:37.711 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T22:19:37.745 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:19:37.767 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:19:37.767 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:37.767 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T22:19:37.767 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:19:37.767 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:19:37.768 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:37.874 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T22:19:37.923 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T22:19:37.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T22:19:38.163 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T22:19:38.221 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T22:19:38.298 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T22:19:38.385 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T22:19:38.518 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T22:19:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T22:19:38.579 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T22:19:38.611 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T22:19:38.639 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T22:19:38.752 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T22:19:39.016 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:19:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:19:39.077 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T22:19:39.139 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T22:19:39.169 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:19:40.198 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:19:40.229 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:19:40.451 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T22:19:40.557 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T22:19:40.612 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T22:19:40.654 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T22:19:41.056 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T22:19:41.111 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:41.193 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:19:41.221 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:19:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T22:19:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T22:19:41.322 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:19:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T22:19:41.493 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T22:19:41.532 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:19:41.555 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:41.599 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:19:41.611 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:19:41.717 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T22:19:41.764 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T22:19:41.782 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-06-02T22:19:41.783 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T22:19:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:41.958 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:41.974 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:41.974 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:41.974 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T22:19:41.974 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T22:19:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T22:19:42.655 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T22:19:42.685 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:19:42.708 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:19:42.708 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:42.708 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T22:19:42.708 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:19:42.709 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:19:42.709 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:42.753 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:19:42.775 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:19:42.775 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:42.775 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T22:19:42.775 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:42.820 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:19:42.842 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:19:42.843 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:42.843 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T22:19:42.843 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:19:42.843 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:19:42.843 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:43.154 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:19:43.176 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:19:43.176 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:43.176 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T22:19:43.176 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:19:43.176 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:19:43.177 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:43.453 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:19:43.479 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:19:43.479 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:43.479 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T22:19:43.479 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:19:43.479 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:19:43.480 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:43.704 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:19:43.727 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:44.171 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:19:44.194 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:44.301 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T22:19:44.358 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T22:19:44.413 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T22:19:44.608 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T22:19:44.654 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T22:19:44.733 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T22:19:44.821 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T22:19:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:44.960 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T22:19:45.013 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T22:19:45.045 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T22:19:45.073 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T22:19:45.541 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:19:45.571 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:19:45.588 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T22:19:45.602 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T22:19:45.658 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:45.664 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T22:19:45.694 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:19:45.823 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T22:19:45.823 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T22:19:45.824 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T22:19:45.824 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:19:45.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:46.735 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:19:46.787 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:19:47.666 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T22:19:47.708 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T22:19:47.748 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T22:19:47.758 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:19:47.780 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T22:19:47.788 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:19:47.808 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T22:19:47.890 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:19:47.990 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T22:19:48.038 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T22:19:48.051 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T22:19:48.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T22:19:48.082 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:19:48.105 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:19:48.105 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:48.105 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T22:19:48.105 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:19:48.106 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:19:48.106 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:48.111 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T22:19:48.140 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T22:19:48.157 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:19:48.168 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:19:48.195 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:19:48.267 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T22:19:48.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T22:19:48.729 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:48.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:48.788 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:49.212 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T22:19:49.243 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:19:49.266 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:19:49.267 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:49.267 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T22:19:49.267 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:19:49.267 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:19:49.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:49.310 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:19:49.333 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:19:49.333 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:49.333 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T22:19:49.333 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:49.386 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:19:49.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T22:19:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T22:19:49.711 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:19:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T22:19:49.734 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:19:49.734 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:49.734 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T22:19:49.735 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:19:49.735 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:19:49.735 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:19:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T22:19:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T22:19:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:19:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T22:19:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T22:19:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:19:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:19:50.063 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T22:19:50.063 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:19:50.133 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:19:50.156 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T22:19:50.161 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:50.161 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:50.349 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:19:50.417 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:19:50.442 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T22:19:50.505 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:19:54.239 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T22:19:54.281 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T22:19:54.321 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T22:19:54.354 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T22:19:54.381 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T22:19:54.562 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T22:19:54.610 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T22:19:54.643 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T22:19:54.675 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T22:19:54.704 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T22:19:54.742 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:19:55.363 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:55.406 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:55.427 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:19:56.260 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T22:19:56.263 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:19:56.263 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T22:19:56.263 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T22:19:56.264 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T22:19:56.265 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T22:19:56.266 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T22:19:56.267 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T22:19:56.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T22:19:56.269 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T22:19:56.270 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T22:19:56.271 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T22:19:56.272 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T22:19:56.273 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T22:19:56.274 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T22:19:56.274 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T22:19:56.274 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T22:19:56.274 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T22:19:56.274 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T22:19:56.275 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T22:19:56.276 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T22:19:56.277 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T22:19:56.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T22:19:56.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T22:19:56.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T22:19:56.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T22:19:56.278 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T22:19:56.336 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T22:19:56.377 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T22:19:56.458 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T22:19:56.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T22:19:56.522 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:19:56.548 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T22:19:56.574 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T22:19:56.574 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:19:56.642 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:19:56.675 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T22:19:56.675 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:19:56.742 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:19:56.768 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T22:19:56.773 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:56.773 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:56.953 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:19:56.953 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:19:57.037 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:19:57.062 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T22:19:57.133 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:19:59.082 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T22:19:59.082 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:59.082 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-06-02T22:19:59.082 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T22:19:59.083 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.084 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:19:59.085 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.086 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T22:19:59.087 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T22:19:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T22:19:59.089 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T22:19:59.090 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T22:19:59.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T22:19:59.092 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T22:19:59.093 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:19:59.094 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-06-02T22:19:59.095 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-06-02T22:19:59.525 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:19:59.541 DEBUG:teuthology.parallel:result is None 2024-06-02T22:19:59.766 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:59.816 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T22:19:59.816 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:19:59.816 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T22:19:59.816 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:01.545 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:20:01.634 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T22:20:01.634 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:01.634 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T22:20:01.634 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:20:01.634 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T22:20:01.635 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:01.912 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:20:02.012 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T22:20:02.012 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:02.013 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T22:20:02.013 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:20:02.013 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T22:20:02.013 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:20:02.615 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T22:20:02.616 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T22:20:02.617 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T22:20:02.628 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T22:20:02.628 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T22:20:02.628 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T22:20:02.628 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T22:20:02.629 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T22:20:02.630 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T22:20:02.631 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T22:20:02.632 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T22:20:02.633 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T22:20:02.634 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T22:20:02.635 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T22:20:02.636 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:20:02.637 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T22:20:02.638 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T22:20:02.638 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T22:20:02.638 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T22:20:02.638 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T22:20:02.638 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T22:20:02.641 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:20:02.641 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T22:20:02.641 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T22:20:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T22:20:02.643 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:02.643 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T22:20:02.643 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:20:02.643 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T22:20:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T22:20:02.827 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T22:20:02.903 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T22:20:03.152 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T22:20:03.210 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T22:20:03.305 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T22:20:03.413 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T22:20:03.595 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T22:20:03.661 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T22:20:03.700 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T22:20:03.733 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T22:20:04.422 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:20:04.461 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T22:20:04.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T22:20:04.621 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T22:20:04.655 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:20:05.416 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T22:20:05.417 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.418 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.419 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T22:20:05.420 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T22:20:05.421 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T22:20:05.422 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T22:20:05.423 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T22:20:05.424 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T22:20:05.425 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T22:20:05.426 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.427 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T22:20:05.428 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T22:20:05.429 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T22:20:05.430 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T22:20:05.430 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T22:20:05.430 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:20:05.430 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-06-02T22:20:05.860 DEBUG:teuthology.parallel:result is None 2024-06-02T22:20:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T22:20:06.048 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:20:07.213 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T22:20:07.240 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:20:07.393 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T22:20:07.580 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T22:20:07.617 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:20:07.693 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T22:20:07.693 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:07.693 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T22:20:07.694 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:20:07.694 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T22:20:07.694 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:07.759 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:20:07.801 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T22:20:07.938 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T22:20:08.020 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T22:20:09.097 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T22:20:09.128 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T22:20:09.190 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:09.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:20:09.323 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T22:20:09.323 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:09.323 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T22:20:09.323 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:09.413 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:20:09.506 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T22:20:09.507 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:09.507 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T22:20:09.507 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:20:09.507 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T22:20:09.507 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:09.897 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T22:20:09.982 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:15.169 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T22:20:15.224 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T22:20:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T22:20:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T22:20:15.382 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T22:20:15.683 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T22:20:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T22:20:15.798 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T22:20:15.838 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T22:20:15.886 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T22:20:15.930 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:20:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:20:16.993 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:20:17.057 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T22:20:18.531 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T22:20:18.649 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T22:20:18.714 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T22:20:18.867 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T22:20:18.909 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T22:20:18.941 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:20:18.976 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T22:20:19.018 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T22:20:19.018 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:20:19.159 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T22:20:19.238 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T22:20:19.239 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:20:19.383 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T22:20:19.422 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T22:20:19.457 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:20:19.457 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:20:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T22:20:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:20:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T22:20:20.008 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T22:20:20.132 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:20:20.400 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T22:20:20.400 INFO:teuthology.orchestra.run.smithi031.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-02T22:20:20.401 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:26.295 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T22:20:26.295 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T22:20:26.295 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T22:20:26.295 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T22:20:26.295 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T22:20:26.296 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T22:20:26.297 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T22:20:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T22:20:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T22:20:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T22:20:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T22:20:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T22:20:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T22:20:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T22:20:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T22:20:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T22:20:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T22:20:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T22:20:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:28.650 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T22:20:28.651 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.652 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.653 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T22:20:28.654 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T22:20:28.655 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T22:20:28.656 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.657 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T22:20:28.658 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T22:20:28.659 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T22:20:28.660 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T22:20:28.661 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.662 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T22:20:28.663 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T22:20:28.664 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:20:28.664 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-06-02T22:20:29.366 DEBUG:teuthology.parallel:result is None 2024-06-02T22:20:29.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:29.587 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T22:20:29.644 INFO:teuthology.orchestra.run.smithi031.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.645 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.645 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T22:20:29.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:29.793 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T22:20:29.820 INFO:teuthology.orchestra.run.smithi098.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.820 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.820 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T22:20:29.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:29.970 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T22:20:29.997 INFO:teuthology.orchestra.run.smithi178.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.997 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T22:20:29.997 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T22:20:29.999 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T22:20:29.999 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:20:29.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T22:20:30.066 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:20:30.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T22:20:30.098 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:20:30.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T22:20:30.129 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T22:20:30.129 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:20:30.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T22:20:30.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T22:20:30.300 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:20:30.300 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T22:20:30.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T22:20:30.396 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:20:30.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T22:20:30.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T22:20:30.492 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T22:20:30.492 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:20:30.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T22:20:30.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T22:20:30.655 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:20:30.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T22:20:30.683 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T22:20:30.750 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:20:30.750 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T22:20:30.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T22:20:30.837 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T22:20:30.838 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:20:30.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T22:20:30.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T22:20:31.015 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:20:31.015 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T22:20:31.043 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T22:20:31.111 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:20:31.111 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T22:20:31.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T22:20:31.199 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-02T22:20:31.289 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-02T22:20:31.289 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:31.290 INFO:tasks.cephadm:Cluster fsid is 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:20:31.290 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-02T22:20:31.290 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.31', 'mon.b': '172.21.15.98', 'mon.c': '172.21.15.178'} 2024-06-02T22:20:31.290 INFO:tasks.cephadm:First mon is mon.a on smithi031 2024-06-02T22:20:31.290 INFO:tasks.cephadm:First mgr is x 2024-06-02T22:20:31.290 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-02T22:20:31.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname $(hostname -s) 2024-06-02T22:20:31.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-06-02T22:20:31.387 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2024-06-02T22:20:31.410 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-02T22:20:31.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:31.630 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-02T22:20:31.840 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:20:31.842 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-02T22:20:31.842 DEBUG:teuthology.orchestra.run.smithi031:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:32.295 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 22:20 /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:32.295 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:32.877 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 22:20 /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:32.877 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:33.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 2 22:20 /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:33.277 DEBUG:teuthology.orchestra.run.smithi031:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:33.339 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:33.358 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T22:20:33.391 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-02T22:20:33.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T22:20:33.396 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T22:20:33.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-02T22:20:34.201 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T22:20:34.243 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T22:20:34.948 INFO:teuthology.orchestra.run.smithi031.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T22:21:14.489 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-06-02T22:21:14.489 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:21:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T22:21:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-06-02T22:21:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T22:21:14.490 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-06-02T22:21:14.490 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2024-06-02T22:21:16.589 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: "repo_digests": [ 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:21:22.540 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:21:22.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph 2024-06-02T22:21:22.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-06-02T22:21:22.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2024-06-02T22:21:22.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /etc/ceph 2024-06-02T22:21:22.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-06-02T22:21:22.881 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2024-06-02T22:21:22.908 INFO:tasks.cephadm:Writing seed config... 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-02T22:21:22.910 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-02T22:21:22.911 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-02T22:21:22.912 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-02T22:21:22.913 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-02T22:21:22.914 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-02T22:21:22.914 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-02T22:21:22.914 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-02T22:21:22.914 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-02T22:21:22.914 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-06-02T22:21:22.915 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:21:22.915 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-02T22:21:22.977 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 52c9257e-212e-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-02T22:21:22.977 DEBUG:teuthology.orchestra.run.smithi031:mon.a> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service 2024-06-02T22:21:23.024 DEBUG:teuthology.orchestra.run.smithi031:mgr.x> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-02T22:21:23.070 INFO:tasks.cephadm:Bootstrapping... 2024-06-02T22:21:23.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.31 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:21:23.344 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-06-02T22:21:23.344 INFO:teuthology.orchestra.run.smithi031.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', '52c9257e-212e-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.31', '--skip-admin-label'] 2024-06-02T22:21:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-02T22:21:23.345 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying podman|docker is present... 2024-06-02T22:21:23.405 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout 5.0.2 2024-06-02T22:21:23.406 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying lvm2 is present... 2024-06-02T22:21:23.406 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying time synchronization is in place... 2024-06-02T22:21:23.422 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T22:21:23.422 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T22:21:23.443 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T22:21:23.443 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:21:23.465 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout enabled 2024-06-02T22:21:23.484 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout active 2024-06-02T22:21:23.484 INFO:teuthology.orchestra.run.smithi031.stdout:Unit chronyd.service is enabled and running 2024-06-02T22:21:23.484 INFO:teuthology.orchestra.run.smithi031.stdout:Repeating the final host check... 2024-06-02T22:21:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout 5.0.2 2024-06-02T22:21:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-02T22:21:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl is present 2024-06-02T22:21:23.545 INFO:teuthology.orchestra.run.smithi031.stdout:lvcreate is present 2024-06-02T22:21:23.559 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T22:21:23.560 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T22:21:23.573 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T22:21:23.573 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:21:23.589 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout enabled 2024-06-02T22:21:23.605 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout active 2024-06-02T22:21:23.605 INFO:teuthology.orchestra.run.smithi031.stdout:Unit chronyd.service is enabled and running 2024-06-02T22:21:23.606 INFO:teuthology.orchestra.run.smithi031.stdout:Host looks OK 2024-06-02T22:21:23.606 INFO:teuthology.orchestra.run.smithi031.stdout:Cluster fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:23.606 INFO:teuthology.orchestra.run.smithi031.stdout:Acquiring lock 139769683658112 on /run/cephadm/52c9257e-212e-11ef-bc9b-c7b262605968.lock 2024-06-02T22:21:23.606 INFO:teuthology.orchestra.run.smithi031.stdout:Lock 139769683658112 acquired on /run/cephadm/52c9257e-212e-11ef-bc9b-c7b262605968.lock 2024-06-02T22:21:23.607 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying IP 172.21.15.31 port 3300 ... 2024-06-02T22:21:23.607 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying IP 172.21.15.31 port 6789 ... 2024-06-02T22:21:23.608 INFO:teuthology.orchestra.run.smithi031.stdout:Base mon IP(s) is [172.21.15.31:3300, 172.21.15.31:6789], mon addrv is [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2024-06-02T22:21:23.618 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.31 metric 100 2024-06-02T22:21:23.618 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.31 metric 100 2024-06-02T22:21:23.627 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-02T22:21:23.628 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-02T22:21:23.628 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-02T22:21:23.636 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-02T22:21:23.636 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-02T22:21:23.636 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T22:21:23.636 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-02T22:21:23.637 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2024-06-02T22:21:23.637 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T22:21:23.638 INFO:teuthology.orchestra.run.smithi031.stdout:Mon IP `172.21.15.31` is in CIDR network `172.21.0.0/20` 2024-06-02T22:21:23.638 INFO:teuthology.orchestra.run.smithi031.stdout:Mon IP `172.21.15.31` is in CIDR network `172.21.0.0/20` 2024-06-02T22:21:23.638 INFO:teuthology.orchestra.run.smithi031.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-02T22:21:23.640 INFO:teuthology.orchestra.run.smithi031.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-02T22:21:23.641 INFO:teuthology.orchestra.run.smithi031.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T22:21:24.311 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-02T22:21:24.312 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-02T22:21:24.312 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Getting image source signatures 2024-06-02T22:21:24.312 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-02T22:21:24.312 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-02T22:21:24.312 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-02T22:21:24.313 INFO:teuthology.orchestra.run.smithi031.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-02T22:21:25.582 INFO:teuthology.orchestra.run.smithi031.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-02T22:21:25.583 INFO:teuthology.orchestra.run.smithi031.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-02T22:21:25.583 INFO:teuthology.orchestra.run.smithi031.stdout:Extracting ceph user uid/gid from container image... 2024-06-02T22:21:26.752 INFO:teuthology.orchestra.run.smithi031.stdout:stat: stdout 167 167 2024-06-02T22:21:26.752 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial keys... 2024-06-02T22:21:27.914 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBn8Fxm6/dPCxAAcrzO05kZo1zJP039olOC2A== 2024-06-02T22:21:29.002 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBo8Fxm2hYTFRAAChZ0pYZVsPWf/NYI3vLfsA== 2024-06-02T22:21:30.110 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph-authtool: stdout AQBp8FxmWOxZHBAAwC3G6RB0i/+7syHT1y+c5g== 2024-06-02T22:21:30.112 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial monmap... 2024-06-02T22:21:31.264 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool for a [v2:172.21.15.31:3300,v1:172.21.15.31:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: set fsid to 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:21:31.265 INFO:teuthology.orchestra.run.smithi031.stdout:Creating mon... 2024-06-02T22:21:32.386 INFO:teuthology.orchestra.run.smithi031.stdout:create mon.a on 2024-06-02T22:21:32.777 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-02T22:21:33.026 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-02T22:21:33.330 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target. 2024-06-02T22:21:33.330 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target. 2024-06-02T22:21:33.744 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a 2024-06-02T22:21:33.744 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-02T22:21:34.057 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target.wants/ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968@.service. 2024-06-02T22:21:34.750 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 podman[31380]: 2024-06-02 22:21:34.495004166 +0000 UTC m=+0.159192886 container create 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5) 2024-06-02T22:21:34.750 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 podman[31380]: 2024-06-02 22:21:34.749226343 +0000 UTC m=+0.413415106 container init 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:21:34.928 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T22:21:34.928 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-06-02T22:21:34.953 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T22:21:34.953 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:21:34.953 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-06-02T22:21:34.953 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T22:21:34.954 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mon to start... 2024-06-02T22:21:34.955 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mon... 2024-06-02T22:21:35.107 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 podman[31380]: 2024-06-02 22:21:34.759742776 +0000 UTC m=+0.423931500 container start 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-02T22:21:35.107 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 ceph-mon[31398]: mkfs 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:35.107 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 ceph-mon[31398]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T22:21:35.107 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 bash[31380]: 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 2024-06-02T22:21:35.107 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:34 smithi031 systemd[1]: Started Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: monmap epoch 1 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: last_changed 2024-06-02T22:21:30.635685+0000 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: min_mon_release 19 (squid) 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: election_strategy: 1 2024-06-02T22:21:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:21:36.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: fsmap 2024-06-02T22:21:36.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T22:21:36.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: mgrmap e1: no daemons active 2024-06-02T22:21:36.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:35 smithi031 ceph-mon[31398]: from='client.? 172.21.15.31:0/843126598' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-02T22:21:36.434 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout cluster: 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout id: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout services: 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.873787s) 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:36.441 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout data: 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout pgs: 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.612+0000 7f89a3000700 1 Processor -- start 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.612+0000 7f89a3000700 1 -- start start 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.612+0000 7f89a3000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.612+0000 7f89a3000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f899c108820 con 0x7f899c107e30 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.614+0000 7f89a1c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.614+0000 7f89a1c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58878/0 (socket says 172.21.15.31:58878) 2024-06-02T22:21:36.442 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.614+0000 7f89a1c00700 1 -- 172.21.15.31:0/1424047517 learned_addr learned my addr 172.21.15.31:0/1424047517 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.614+0000 7f89a1c00700 1 -- 172.21.15.31:0/1424047517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c108f90 con 0x7f899c107e30 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.615+0000 7f89a1c00700 1 --2- 172.21.15.31:0/1424047517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e80 tx=0x7f899000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69833ca427f927e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.615+0000 7f899be00700 1 -- 172.21.15.31:0/1424047517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990017070 con 0x7f899c107e30 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.615+0000 7f899be00700 1 -- 172.21.15.31:0/1424047517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990003a20 con 0x7f899c107e30 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.615+0000 7f899be00700 1 -- 172.21.15.31:0/1424047517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990003d20 con 0x7f899c107e30 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 -- 172.21.15.31:0/1424047517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 msgr2=0x7f899c108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 --2- 172.21.15.31:0/1424047517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e80 tx=0x7f899000b330 comp rx=0 tx=0).stop 2024-06-02T22:21:36.443 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 -- 172.21.15.31:0/1424047517 shutdown_connections 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 --2- 172.21.15.31:0/1424047517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c108250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 -- 172.21.15.31:0/1424047517 >> 172.21.15.31:0/1424047517 conn(0x7f899c103410 msgr2=0x7f899c105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 -- 172.21.15.31:0/1424047517 shutdown_connections 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.616+0000 7f89a3000700 1 -- 172.21.15.31:0/1424047517 wait complete. 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.617+0000 7f89a3000700 1 Processor -- start 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.617+0000 7f89a3000700 1 -- start start 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.618+0000 7f89a3000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.618+0000 7f89a3000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f899c1094c0 con 0x7f899c107e30 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.618+0000 7f89a1c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.618+0000 7f89a1c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58892/0 (socket says 172.21.15.31:58892) 2024-06-02T22:21:36.444 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.618+0000 7f89a1c00700 1 -- 172.21.15.31:0/843126598 learned_addr learned my addr 172.21.15.31:0/843126598 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f89a1c00700 1 -- 172.21.15.31:0/843126598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c19ba80 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f89a1c00700 1 --2- 172.21.15.31:0/843126598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8990004000 tx=0x7f8990004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990022020 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8990018040 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8990017070 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.619+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c19bd10 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.620+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c19ea00 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.620+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8990025020 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.620+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f899000f050 con 0x7f899c107e30 2024-06-02T22:21:36.445 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.621+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c063af0 con 0x7f899c107e30 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.624+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f899002c030 con 0x7f899c107e30 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.706+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f899c02dde0 con 0x7f899c107e30 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.707+0000 7f899a000700 1 -- 172.21.15.31:0/843126598 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f899001ede0 con 0x7f899c107e30 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.708+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 msgr2=0x7f899c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.708+0000 7f89a3000700 1 --2- 172.21.15.31:0/843126598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8990004000 tx=0x7f8990004ad0 comp rx=0 tx=0).stop 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.709+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 shutdown_connections 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.709+0000 7f89a3000700 1 --2- 172.21.15.31:0/843126598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f899c107e30 0x7f899c19b540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.709+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 >> 172.21.15.31:0/843126598 conn(0x7f899c103410 msgr2=0x7f899c1921e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.709+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 shutdown_connections 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:35.709+0000 7f89a3000700 1 -- 172.21.15.31:0/843126598 wait complete. 2024-06-02T22:21:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:mon is available 2024-06-02T22:21:36.447 INFO:teuthology.orchestra.run.smithi031.stdout:Assimilating anything we can from ceph.conf... 2024-06-02T22:21:37.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:37 smithi031 ceph-mon[31398]: from='client.? 172.21.15.31:0/1291705727' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T22:21:37.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:37 smithi031 ceph-mon[31398]: from='client.? 172.21.15.31:0/1291705727' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-02T22:21:37.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:37.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T22:21:37.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout fsid = 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.31:3300,v1:172.21.15.31:6789] 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T22:21:37.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.045+0000 7f31cce00700 1 Processor -- start 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.045+0000 7f31cce00700 1 -- start start 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.046+0000 7f31cce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.046+0000 7f31cce00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8108a60 con 0x7f31c8108070 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.047+0000 7f31c5e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.047+0000 7f31c5e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58902/0 (socket says 172.21.15.31:58902) 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.047+0000 7f31c5e00700 1 -- 172.21.15.31:0/385883954 learned_addr learned my addr 172.21.15.31:0/385883954 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.047+0000 7f31c5e00700 1 -- 172.21.15.31:0/385883954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c81091d0 con 0x7f31c8108070 2024-06-02T22:21:37.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.048+0000 7f31c5e00700 1 --2- 172.21.15.31:0/385883954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098a0 tx=0x7f31b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6182ac7a0e3cfda server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.048+0000 7f31c4a00700 1 -- 172.21.15.31:0/385883954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8004160 con 0x7f31c8108070 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.048+0000 7f31c4a00700 1 -- 172.21.15.31:0/385883954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8004300 con 0x7f31c8108070 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.048+0000 7f31c4a00700 1 -- 172.21.15.31:0/385883954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b80036a0 con 0x7f31c8108070 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 -- 172.21.15.31:0/385883954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 msgr2=0x7f31c8108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 --2- 172.21.15.31:0/385883954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f31b80098a0 tx=0x7f31b8009bb0 comp rx=0 tx=0).stop 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 -- 172.21.15.31:0/385883954 shutdown_connections 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 --2- 172.21.15.31:0/385883954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c8108490 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 -- 172.21.15.31:0/385883954 >> 172.21.15.31:0/385883954 conn(0x7f31c81035f0 msgr2=0x7f31c8105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 -- 172.21.15.31:0/385883954 shutdown_connections 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.049+0000 7f31cce00700 1 -- 172.21.15.31:0/385883954 wait complete. 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.050+0000 7f31cce00700 1 Processor -- start 2024-06-02T22:21:37.844 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.050+0000 7f31cce00700 1 -- start start 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31cce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31cce00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8109700 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31c5e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31c5e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58904/0 (socket says 172.21.15.31:58904) 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31c5e00700 1 -- 172.21.15.31:0/1291705727 learned_addr learned my addr 172.21.15.31:0/1291705727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.051+0000 7f31c5e00700 1 -- 172.21.15.31:0/1291705727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c819bb70 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31c5e00700 1 --2- 172.21.15.31:0/1291705727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f31b8000c00 tx=0x7f31b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8003db0 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8011630 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31b8011950 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c819be00 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c819eaf0 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f31b8011af0 con 0x7f31c8108070 2024-06-02T22:21:37.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.052+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f31b801c450 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.053+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c8063af0 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.056+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f31b8032020 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.134+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f31c802deb0 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.141+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f31b8004260 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.142+0000 7f31bea00700 1 -- 172.21.15.31:0/1291705727 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31b801cb60 con 0x7f31c8108070 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.143+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 msgr2=0x7f31c819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.143+0000 7f31cce00700 1 --2- 172.21.15.31:0/1291705727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f31b8000c00 tx=0x7f31b8004750 comp rx=0 tx=0).stop 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.143+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 shutdown_connections 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.143+0000 7f31cce00700 1 --2- 172.21.15.31:0/1291705727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8108070 0x7f31c819b630 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.144+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 >> 172.21.15.31:0/1291705727 conn(0x7f31c81035f0 msgr2=0x7f31c8192330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.144+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 shutdown_connections 2024-06-02T22:21:37.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:37.144+0000 7f31cce00700 1 -- 172.21.15.31:0/1291705727 wait complete. 2024-06-02T22:21:37.847 INFO:teuthology.orchestra.run.smithi031.stdout:Generating new minimal ceph.conf... 2024-06-02T22:21:38.862 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:38 smithi031 ceph-mon[31398]: from='client.? 172.21.15.31:0/886217192' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:21:39.196 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.409+0000 7fcd5fc00700 1 Processor -- start 2024-06-02T22:21:39.196 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.409+0000 7fcd5fc00700 1 -- start start 2024-06-02T22:21:39.196 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.410+0000 7fcd5fc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:39.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.410+0000 7fcd5fc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58109fa0 con 0x7fcd581095b0 2024-06-02T22:21:39.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.410+0000 7fcd5d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:39.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.410+0000 7fcd5d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58912/0 (socket says 172.21.15.31:58912) 2024-06-02T22:21:39.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.411+0000 7fcd5d200700 1 -- 172.21.15.31:0/1885286408 learned_addr learned my addr 172.21.15.31:0/1885286408 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:39.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.411+0000 7fcd5d200700 1 -- 172.21.15.31:0/1885286408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5810a120 con 0x7fcd581095b0 2024-06-02T22:21:39.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.411+0000 7fcd5d200700 1 --2- 172.21.15.31:0/1885286408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0098a0 tx=0x7fcd4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111bf6f1c1738b28 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:39.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.412+0000 7fcd57400700 1 -- 172.21.15.31:0/1885286408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c004160 con 0x7fcd581095b0 2024-06-02T22:21:39.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.412+0000 7fcd57400700 1 -- 172.21.15.31:0/1885286408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd4c004300 con 0x7fcd581095b0 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.412+0000 7fcd57400700 1 -- 172.21.15.31:0/1885286408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c011b50 con 0x7fcd581095b0 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.412+0000 7fcd5fc00700 1 -- 172.21.15.31:0/1885286408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 msgr2=0x7fcd581099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.412+0000 7fcd5fc00700 1 --2- 172.21.15.31:0/1885286408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0098a0 tx=0x7fcd4c009bb0 comp rx=0 tx=0).stop 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.413+0000 7fcd5fc00700 1 -- 172.21.15.31:0/1885286408 shutdown_connections 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.413+0000 7fcd5fc00700 1 --2- 172.21.15.31:0/1885286408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd581099d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.413+0000 7fcd5fc00700 1 -- 172.21.15.31:0/1885286408 >> 172.21.15.31:0/1885286408 conn(0x7fcd58101bd0 msgr2=0x7fcd58104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.413+0000 7fcd5fc00700 1 -- 172.21.15.31:0/1885286408 shutdown_connections 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.413+0000 7fcd5fc00700 1 -- 172.21.15.31:0/1885286408 wait complete. 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.414+0000 7fcd5fc00700 1 Processor -- start 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.414+0000 7fcd5fc00700 1 -- start start 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.414+0000 7fcd5fc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:39.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.414+0000 7fcd5fc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58106e10 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.415+0000 7fcd5d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.415+0000 7fcd5d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58914/0 (socket says 172.21.15.31:58914) 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.415+0000 7fcd5d200700 1 -- 172.21.15.31:0/886217192 learned_addr learned my addr 172.21.15.31:0/886217192 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.415+0000 7fcd5d200700 1 -- 172.21.15.31:0/886217192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5819c400 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.415+0000 7fcd5d200700 1 --2- 172.21.15.31:0/886217192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c000c00 tx=0x7fcd4c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c003b20 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd4c003cc0 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5819c6f0 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd4c024910 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5819f380 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd4c022020 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.416+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd4c011e00 con 0x7fcd581095b0 2024-06-02T22:21:39.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.417+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd58063af0 con 0x7fcd581095b0 2024-06-02T22:21:39.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.420+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcd4c01acd0 con 0x7fcd581095b0 2024-06-02T22:21:39.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.498+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fcd5819f9a0 con 0x7fcd581095b0 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.499+0000 7fcd55600700 1 -- 172.21.15.31:0/886217192 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fcd4c02d3f0 con 0x7fcd581095b0 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.500+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 msgr2=0x7fcd5819bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.500+0000 7fcd5fc00700 1 --2- 172.21.15.31:0/886217192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c000c00 tx=0x7fcd4c011c10 comp rx=0 tx=0).stop 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.500+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 shutdown_connections 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.500+0000 7fcd5fc00700 1 --2- 172.21.15.31:0/886217192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd581095b0 0x7fcd5819bec0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.500+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 >> 172.21.15.31:0/886217192 conn(0x7fcd58101bd0 msgr2=0x7fcd581026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.501+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 shutdown_connections 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:38.501+0000 7fcd5fc00700 1 -- 172.21.15.31:0/886217192 wait complete. 2024-06-02T22:21:39.204 INFO:teuthology.orchestra.run.smithi031.stdout:Restarting the monitor... 2024-06-02T22:21:39.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:39 smithi031 systemd[1]: Stopping Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:21:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a[31394]: 2024-06-02T22:21:39.719+0000 7fc007400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:21:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a[31394]: 2024-06-02T22:21:39.719+0000 7fc007400700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-02T22:21:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:39 smithi031 podman[31643]: 2024-06-02 22:21:39.946024574 +0000 UTC m=+0.351158511 container died 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-02T22:21:40.602 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:40 smithi031 podman[31643]: 2024-06-02 22:21:40.39684875 +0000 UTC m=+0.801982738 container cleanup 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-02T22:21:40.602 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:40 smithi031 bash[31643]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a 2024-06-02T22:21:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:40 smithi031 podman[31656]: 2024-06-02 22:21:40.60119213 +0000 UTC m=+0.634553220 container remove 9c940f125b3d71678f92290b4a999c72163767cfc37506f10a62c5d4ba7f4473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:21:41.541 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-02T22:21:41.542 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 systemd[1]: Stopped Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:21:41.542 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service: Consumed 2.063s CPU time. 2024-06-02T22:21:41.542 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 systemd[1]: Starting Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:21:41.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 podman[31748]: 2024-06-02 22:21:41.44823226 +0000 UTC m=+0.034224031 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:21:41.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:41 smithi031 podman[31748]: 2024-06-02 22:21:41.577823327 +0000 UTC m=+0.163815125 container create 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 podman[31748]: 2024-06-02 22:21:50.050299126 +0000 UTC m=+8.636290988 container init 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 podman[31748]: 2024-06-02 22:21:50.062717715 +0000 UTC m=+8.648709523 container start 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: pidfile_write: ignore empty --pid-file 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: load: jerasure load: lrc 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: RocksDB version: 7.9.2 2024-06-02T22:21:50.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Git sha 0 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: DB SUMMARY 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: DB Session ID: JMKEPS2OS2H0ZWDPZLY7 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: CURRENT file: CURRENT 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105416 ; 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.error_if_exists: 0 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.create_if_missing: 0 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.paranoid_checks: 1 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T22:21:50.335 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.env: 0x55bd59ea2c60 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.info_log: 0x55bd893dfb60 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T22:21:50.336 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.statistics: (nil) 2024-06-02T22:21:50.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.use_fsync: 0 2024-06-02T22:21:50.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_log_file_size: 0 2024-06-02T22:21:50.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T22:21:50.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T22:21:50.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_fallocate: 1 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.use_direct_reads: 0 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T22:21:50.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.db_log_dir: 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.wal_dir: 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.write_buffer_manager: 0x55bd893b01e0 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T22:21:50.340 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.unordered_write: 0 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.row_cache: None 2024-06-02T22:21:50.341 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.wal_filter: None 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.two_write_queues: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.wal_compression: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.atomic_flush: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.log_readahead_size: 0 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T22:21:50.342 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_background_jobs: 2 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_background_compactions: -1 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_subcompactions: 1 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T22:21:50.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_open_files: -1 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_background_flushes: -1 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Compression algorithms supported: 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kZSTD supported: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kXpressCompression supported: 0 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kZlibCompression supported: 1 2024-06-02T22:21:50.344 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kSnappyCompression supported: 1 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kLZ4Compression supported: 1 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: kBZip2Compression supported: 0 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.merge_operator: 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_filter: None 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T22:21:50.345 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bd893dfc80) 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: cache_index_and_filter_blocks: 1 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: pin_top_level_index_and_filter: 1 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: index_type: 0 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: data_block_index_type: 0 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: index_shortening: 1 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: checksum: 4 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: no_block_cache: 0 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_cache: 0x55bd893e1090 2024-06-02T22:21:50.346 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_cache_name: BinnedLRUCache 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_cache_options: 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: capacity : 536870912 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: num_shard_bits : 4 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: strict_capacity_limit : 0 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: high_pri_pool_ratio: 0.000 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_cache_compressed: (nil) 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: persistent_cache: (nil) 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_size: 4096 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_size_deviation: 10 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_restart_interval: 16 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: index_block_restart_interval: 1 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: metadata_block_size: 4096 2024-06-02T22:21:50.347 INFO:journalctl@ceph.mon.a.smithi031.stdout: partition_filters: 0 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: use_delta_encoding: 1 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: filter_policy: bloomfilter 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: whole_key_filtering: 1 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: verify_compression: 0 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: read_amp_bytes_per_bit: 0 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: format_version: 5 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: enable_index_compression: 1 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: block_align: 0 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: max_auto_readahead_size: 262144 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: prepopulate_block_cache: 0 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: initial_auto_readahead_size: 8192 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T22:21:50.348 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression: NoCompression 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.num_levels: 7 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T22:21:50.349 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:21:50.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T22:21:50.351 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T22:21:50.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T22:21:50.354 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.table_properties_collectors: 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.inplace_update_support: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.bloom_locality: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.max_successive_merges: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T22:21:50.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.ttl: 2592000 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enable_blob_files: false 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.min_blob_size: 0 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T22:21:50.356 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5bbad646-a5bc-473b-b7f1-51cc2c0b3ab6 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717366910123457, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717366910125559, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100481, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98392, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14328, "raw_average_key_size": 49, "raw_value_size": 90603, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717366910, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5bbad646-a5bc-473b-b7f1-51cc2c0b3ab6", "db_session_id": "JMKEPS2OS2H0ZWDPZLY7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717366910125725, "job": 1, "event": "recovery_finished"} 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T22:21:50.357 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bd894d0000 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: DB pointer 0x55bd894ba000 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: ** DB Stats ** 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:21:50.358 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: ** Compaction Stats [default] ** 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: L0 2/0 99.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: Sum 2/0 99.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: ** Compaction Stats [default] ** 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 68.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.359 INFO:journalctl@ceph.mon.a.smithi031.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Cumulative compaction: 0.00 GB write, 13.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Interval compaction: 0.00 GB write, 13.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Block cache BinnedLRUCache@0x55bd893e1090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.2e-05 secs_since: 0 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-02T22:21:50.360 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: starting mon.a rank 0 at public addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] at bind addrs [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???) e1 preinit fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).mds e1 new map 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).mds e1 print_map 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: e1 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: legacy client fscid: -1 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout: No filesystems configured 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:21:50.361 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: monmap epoch 1 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: last_changed 2024-06-02T22:21:30.635685+0000 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: min_mon_release 19 (squid) 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: election_strategy: 1 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: fsmap 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 ceph-mon[31767]: mgrmap e1: no daemons active 2024-06-02T22:21:50.362 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 bash[31748]: 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f 2024-06-02T22:21:50.363 INFO:teuthology.orchestra.run.smithi031.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-02T22:21:50.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:50 smithi031 systemd[1]: Started Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.005+0000 7fcd53600700 1 Processor -- start 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.006+0000 7fcd53600700 1 -- start start 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.006+0000 7fcd53600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.006+0000 7fcd53600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c07d1b0 con 0x7fcd4c07e730 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.007+0000 7fcd50c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.007+0000 7fcd50c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51882/0 (socket says 172.21.15.31:51882) 2024-06-02T22:21:51.817 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.007+0000 7fcd50c00700 1 -- 172.21.15.31:0/927356100 learned_addr learned my addr 172.21.15.31:0/927356100 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.008+0000 7fcd50c00700 1 -- 172.21.15.31:0/927356100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c07d330 con 0x7fcd4c07e730 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.008+0000 7fcd50c00700 1 --2- 172.21.15.31:0/927356100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd400098a0 tx=0x7fcd40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f44757852338d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.008+0000 7fcd4b400700 1 -- 172.21.15.31:0/927356100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40004160 con 0x7fcd4c07e730 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd4b400700 1 -- 172.21.15.31:0/927356100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd40004300 con 0x7fcd4c07e730 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd4b400700 1 -- 172.21.15.31:0/927356100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40011b50 con 0x7fcd4c07e730 2024-06-02T22:21:51.818 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd53600700 1 -- 172.21.15.31:0/927356100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 msgr2=0x7fcd4c07cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd53600700 1 --2- 172.21.15.31:0/927356100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd400098a0 tx=0x7fcd40009bb0 comp rx=0 tx=0).stop 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd53600700 1 -- 172.21.15.31:0/927356100 shutdown_connections 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd53600700 1 --2- 172.21.15.31:0/927356100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c07cbe0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.009+0000 7fcd53600700 1 -- 172.21.15.31:0/927356100 >> 172.21.15.31:0/927356100 conn(0x7fcd4c103560 msgr2=0x7fcd4c1059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.010+0000 7fcd53600700 1 -- 172.21.15.31:0/927356100 shutdown_connections 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.010+0000 7fcd53600700 1 -- 172.21.15.31:0/927356100 wait complete. 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.011+0000 7fcd53600700 1 Processor -- start 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.011+0000 7fcd53600700 1 -- start start 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.011+0000 7fcd53600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.011+0000 7fcd53600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c10e590 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.012+0000 7fcd50c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.012+0000 7fcd50c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51884/0 (socket says 172.21.15.31:51884) 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.012+0000 7fcd50c00700 1 -- 172.21.15.31:0/747789154 learned_addr learned my addr 172.21.15.31:0/747789154 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.012+0000 7fcd50c00700 1 -- 172.21.15.31:0/747789154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c19e650 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd50c00700 1 --2- 172.21.15.31:0/747789154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd40011b60 tx=0x7fcd40011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40003b20 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd40003cc0 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd40024840 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c19e8e0 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a15d0 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.013+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd40022020 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.014+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd40011e00 con 0x7fcd4c07e730 2024-06-02T22:21:51.823 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.014+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c063af0 con 0x7fcd4c07e730 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.018+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcd40043dd0 con 0x7fcd4c07e730 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.096+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fcd4c1a17a0 con 0x7fcd4c07e730 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.100+0000 7fcd49600700 1 -- 172.21.15.31:0/747789154 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fcd40032020 con 0x7fcd4c07e730 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.101+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 msgr2=0x7fcd4c19e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.101+0000 7fcd53600700 1 --2- 172.21.15.31:0/747789154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd40011b60 tx=0x7fcd40011c40 comp rx=0 tx=0).stop 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.102+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 shutdown_connections 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.102+0000 7fcd53600700 1 --2- 172.21.15.31:0/747789154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd4c07e730 0x7fcd4c19e110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.102+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 >> 172.21.15.31:0/747789154 conn(0x7fcd4c103560 msgr2=0x7fcd4c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.102+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 shutdown_connections 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:51.102+0000 7fcd53600700 1 -- 172.21.15.31:0/747789154 wait complete. 2024-06-02T22:21:51.824 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-02T22:21:51.847 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:21:51.848 INFO:teuthology.orchestra.run.smithi031.stdout:Creating mgr... 2024-06-02T22:21:51.849 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-02T22:21:51.850 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-02T22:21:52.330 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T22:21:52.330 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Failed to reset failed state of unit ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-02T22:21:52.352 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:52 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/747789154' entity='client.admin' 2024-06-02T22:21:52.596 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968.target.wants/ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-52c9257e-212e-11ef-bc9b-c7b262605968@.service. 2024-06-02T22:21:53.010 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:52 smithi031 systemd[1]: Starting Ceph mgr.x for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:21:53.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 podman[31982]: 2024-06-02 22:21:52.913992779 +0000 UTC m=+0.036332832 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T22:21:53.372 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 podman[31982]: 2024-06-02 22:21:53.009531982 +0000 UTC m=+0.131872073 container create 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc) 2024-06-02T22:21:53.533 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T22:21:53.533 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-06-02T22:21:53.550 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T22:21:53.550 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:21:53.550 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-06-02T22:21:53.550 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T22:21:53.574 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T22:21:53.574 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr to start... 2024-06-02T22:21:53.591 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr... 2024-06-02T22:21:53.692 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 podman[31982]: 2024-06-02 22:21:53.415058708 +0000 UTC m=+0.537398836 container init 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-06-02T22:21:53.692 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 podman[31982]: 2024-06-02 22:21:53.425503076 +0000 UTC m=+0.547843193 container start 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-02T22:21:53.692 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 bash[31982]: 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 2024-06-02T22:21:53.692 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 systemd[1]: Started Ceph mgr.x for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:21:53.945 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:53.691+0000 7f1ab69d5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:21:54.256 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:54.002+0000 7f1ab69d5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:21:54.256 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:54.156+0000 7f1ab69d5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:21:54.619 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:54 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3727097396' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T22:21:54.870 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:54.619+0000 7f1ab69d5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:21:54.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:54.739+0000 7f1ab69d5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:21:55.688 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T22:21:55.689 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T22:21:55.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T22:21:55.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:55.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T22:21:55.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T22:21:55.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T22:21:55.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T22:21:55.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T22:21:55.699 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T22:21:55.700 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T22:21:34.835857+0000", 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.302+0000 7f10fe200700 1 Processor -- start 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.303+0000 7f10fe200700 1 -- start start 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.303+0000 7f10fe200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.303+0000 7f10fe200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f10f807bec0 con 0x7f10f8108a20 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.304+0000 7f10f7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.304+0000 7f10f7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51918/0 (socket says 172.21.15.31:51918) 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.304+0000 7f10f7400700 1 -- 172.21.15.31:0/4275680201 learned_addr learned my addr 172.21.15.31:0/4275680201 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:55.701 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.305+0000 7f10f7400700 1 -- 172.21.15.31:0/4275680201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f810b350 con 0x7f10f8108a20 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.305+0000 7f10f7400700 1 --2- 172.21.15.31:0/4275680201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098a0 tx=0x7f10e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495c948514c44f4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.305+0000 7f10f6000700 1 -- 172.21.15.31:0/4275680201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e8004160 con 0x7f10f8108a20 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.305+0000 7f10f6000700 1 -- 172.21.15.31:0/4275680201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10e8004300 con 0x7f10f8108a20 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.305+0000 7f10f6000700 1 -- 172.21.15.31:0/4275680201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e8011b50 con 0x7f10f8108a20 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 -- 172.21.15.31:0/4275680201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 msgr2=0x7f10f810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 --2- 172.21.15.31:0/4275680201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098a0 tx=0x7f10e8009bb0 comp rx=0 tx=0).stop 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 -- 172.21.15.31:0/4275680201 shutdown_connections 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 --2- 172.21.15.31:0/4275680201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f810ae10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 -- 172.21.15.31:0/4275680201 >> 172.21.15.31:0/4275680201 conn(0x7f10f8102450 msgr2=0x7f10f8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 -- 172.21.15.31:0/4275680201 shutdown_connections 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.306+0000 7f10fe200700 1 -- 172.21.15.31:0/4275680201 wait complete. 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.307+0000 7f10fe200700 1 Processor -- start 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10fe200700 1 -- start start 2024-06-02T22:21:55.702 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10fe200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:55.703 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10fe200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f10f810c380 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10f7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10f7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51922/0 (socket says 172.21.15.31:51922) 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.308+0000 7f10f7400700 1 -- 172.21.15.31:0/3727097396 learned_addr learned my addr 172.21.15.31:0/3727097396 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.309+0000 7f10f7400700 1 -- 172.21.15.31:0/3727097396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f819e600 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.309+0000 7f10f7400700 1 --2- 172.21.15.31:0/3727097396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10e8011b60 tx=0x7f10e8011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.309+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e8003b20 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.309+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10e8003cc0 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.310+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10e8024840 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.310+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f819e890 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.310+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f81a1580 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.310+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10e8022020 con 0x7f10f8108a20 2024-06-02T22:21:55.705 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.310+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f10e8011e00 con 0x7f10f8108a20 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.311+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f8063af0 con 0x7f10f8108a20 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.314+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f10e8043dd0 con 0x7f10f8108a20 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.396+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f10f81a1b40 con 0x7f10f8108a20 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.397+0000 7f10efe00700 1 -- 172.21.15.31:0/3727097396 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f10e8032030 con 0x7f10f8108a20 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 msgr2=0x7f10f819e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 --2- 172.21.15.31:0/3727097396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f10e8011b60 tx=0x7f10e8011c40 comp rx=0 tx=0).stop 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 shutdown_connections 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 --2- 172.21.15.31:0/3727097396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10f8108a20 0x7f10f819e0c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 >> 172.21.15.31:0/3727097396 conn(0x7f10f8102450 msgr2=0x7f10f8102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 shutdown_connections 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:54.399+0000 7f10fe200700 1 -- 172.21.15.31:0/3727097396 wait complete. 2024-06-02T22:21:55.706 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (1/15)... 2024-06-02T22:21:56.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:56.423+0000 7f1ab69d5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:21:56.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:56.657+0000 7f1ab69d5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:21:57.269 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:56.876+0000 7f1ab69d5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:21:57.621 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:57.268+0000 7f1ab69d5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:21:57.621 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:57.396+0000 7f1ab69d5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:21:57.935 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:57.656+0000 7f1ab69d5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:21:57.935 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:57.933+0000 7f1ab69d5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:21:58.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:21:58 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3247657570' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T22:21:59.063 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:58 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:58.786+0000 7f1ab69d5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:21:59.078 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T22:21:59.080 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T22:21:59.080 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-06-02T22:21:59.086 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:59.086 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T22:21:59.087 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T22:21:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T22:21:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T22:21:34.835857+0000", 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.302+0000 7f8427400700 1 Processor -- start 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.302+0000 7f8427400700 1 -- start start 2024-06-02T22:21:59.090 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.303+0000 7f8427400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.303+0000 7f8427400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f84201089e0 con 0x7f8420107ff0 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.303+0000 7f8424a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.304+0000 7f8424a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51932/0 (socket says 172.21.15.31:51932) 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.304+0000 7f8424a00700 1 -- 172.21.15.31:0/2639157096 learned_addr learned my addr 172.21.15.31:0/2639157096 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.304+0000 7f8424a00700 1 -- 172.21.15.31:0/2639157096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201091a0 con 0x7f8420107ff0 2024-06-02T22:21:59.091 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.304+0000 7f8424a00700 1 --2- 172.21.15.31:0/2639157096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84140098a0 tx=0x7f8414009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3199faf721efa693 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.305+0000 7f841f400700 1 -- 172.21.15.31:0/2639157096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8414004160 con 0x7f8420107ff0 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.305+0000 7f841f400700 1 -- 172.21.15.31:0/2639157096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8414004300 con 0x7f8420107ff0 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.305+0000 7f841f400700 1 -- 172.21.15.31:0/2639157096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8414011b50 con 0x7f8420107ff0 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.305+0000 7f8427400700 1 -- 172.21.15.31:0/2639157096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 msgr2=0x7f8420108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.305+0000 7f8427400700 1 --2- 172.21.15.31:0/2639157096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84140098a0 tx=0x7f8414009bb0 comp rx=0 tx=0).stop 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.306+0000 7f8427400700 1 -- 172.21.15.31:0/2639157096 shutdown_connections 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.306+0000 7f8427400700 1 --2- 172.21.15.31:0/2639157096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f8420108410 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.306+0000 7f8427400700 1 -- 172.21.15.31:0/2639157096 >> 172.21.15.31:0/2639157096 conn(0x7f8420103590 msgr2=0x7f84201059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:59.095 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.306+0000 7f8427400700 1 -- 172.21.15.31:0/2639157096 shutdown_connections 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.306+0000 7f8427400700 1 -- 172.21.15.31:0/2639157096 wait complete. 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.307+0000 7f8427400700 1 Processor -- start 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.308+0000 7f8427400700 1 -- start start 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.308+0000 7f8427400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.308+0000 7f8427400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f842010c550 con 0x7f8420107ff0 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.309+0000 7f8424a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.309+0000 7f8424a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51944/0 (socket says 172.21.15.31:51944) 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.309+0000 7f8424a00700 1 -- 172.21.15.31:0/3247657570 learned_addr learned my addr 172.21.15.31:0/3247657570 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.309+0000 7f8424a00700 1 -- 172.21.15.31:0/3247657570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842007e950 con 0x7f8420107ff0 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.309+0000 7f8424a00700 1 --2- 172.21.15.31:0/3247657570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8414009fb0 tx=0x7f8414011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:21:59.096 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84140038b0 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8414011e50 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842007cb40 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8414019550 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842007d080 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8414019be0 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.310+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8414024730 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.311+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420063af0 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.314+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8414003a50 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.392+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f842007d3c0 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.393+0000 7f841d600700 1 -- 172.21.15.31:0/3247657570 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f84140249d0 con 0x7f8420107ff0 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.394+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 msgr2=0x7f842007e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:21:59.097 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.394+0000 7f8427400700 1 --2- 172.21.15.31:0/3247657570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8414009fb0 tx=0x7f8414011bf0 comp rx=0 tx=0).stop 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.394+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 shutdown_connections 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.394+0000 7f8427400700 1 --2- 172.21.15.31:0/3247657570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8420107ff0 0x7f842007e410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.394+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 >> 172.21.15.31:0/3247657570 conn(0x7f8420103590 msgr2=0x7f84201040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.395+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 shutdown_connections 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:21:58.395+0000 7f8427400700 1 -- 172.21.15.31:0/3247657570 wait complete. 2024-06-02T22:21:59.098 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (2/15)... 2024-06-02T22:21:59.621 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:59.366+0000 7f1ab69d5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:21:59.621 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:59.500+0000 7f1ab69d5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:22:00.120 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:21:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:21:59.773+0000 7f1ab69d5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:22:00.870 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:00 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:00.443+0000 7f1ab69d5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:22:00.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:00 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:00.570+0000 7f1ab69d5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:22:01.231 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:00 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:00.905+0000 7f1ab69d5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:22:01.232 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:01.091+0000 7f1ab69d5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:22:01.232 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:01.231+0000 7f1ab69d5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:22:01.575 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:01.391+0000 7f1ab69d5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:22:01.850 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:01.800+0000 7f1ab69d5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:22:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:01 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/51985786' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T22:22:02.539 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T22:22:02.540 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T22:22:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T22:22:02.542 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.543 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T22:21:34.835857+0000", 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.736+0000 7f3b2a600700 1 Processor -- start 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.736+0000 7f3b2a600700 1 -- start start 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.736+0000 7f3b2a600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.736+0000 7f3b2a600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2407d1b0 con 0x7f3b2407e730 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.737+0000 7f3b23400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.737+0000 7f3b23400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44204/0 (socket says 172.21.15.31:44204) 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.737+0000 7f3b23400700 1 -- 172.21.15.31:0/2976318715 learned_addr learned my addr 172.21.15.31:0/2976318715 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:02.544 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.737+0000 7f3b23400700 1 -- 172.21.15.31:0/2976318715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2407d330 con 0x7f3b2407e730 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.738+0000 7f3b23400700 1 --2- 172.21.15.31:0/2976318715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b140098a0 tx=0x7f3b14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e59b9fe1022f3c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.738+0000 7f3b22a00700 1 -- 172.21.15.31:0/2976318715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14004160 con 0x7f3b2407e730 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.738+0000 7f3b22a00700 1 -- 172.21.15.31:0/2976318715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b14004300 con 0x7f3b2407e730 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.738+0000 7f3b22a00700 1 -- 172.21.15.31:0/2976318715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14011b50 con 0x7f3b2407e730 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 -- 172.21.15.31:0/2976318715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 msgr2=0x7f3b2407cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 --2- 172.21.15.31:0/2976318715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b140098a0 tx=0x7f3b14009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 -- 172.21.15.31:0/2976318715 shutdown_connections 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 --2- 172.21.15.31:0/2976318715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2407cbe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 -- 172.21.15.31:0/2976318715 >> 172.21.15.31:0/2976318715 conn(0x7f3b24103560 msgr2=0x7f3b241059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 -- 172.21.15.31:0/2976318715 shutdown_connections 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.739+0000 7f3b2a600700 1 -- 172.21.15.31:0/2976318715 wait complete. 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.740+0000 7f3b2a600700 1 Processor -- start 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.740+0000 7f3b2a600700 1 -- start start 2024-06-02T22:22:02.545 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b2a600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b2a600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410e590 con 0x7f3b2407e730 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b23400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b23400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44206/0 (socket says 172.21.15.31:44206) 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b23400700 1 -- 172.21.15.31:0/51985786 learned_addr learned my addr 172.21.15.31:0/51985786 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.741+0000 7f3b23400700 1 -- 172.21.15.31:0/51985786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2419e640 con 0x7f3b2407e730 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b23400700 1 --2- 172.21.15.31:0/51985786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b14011b60 tx=0x7f3b14011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14003b20 con 0x7f3b2407e730 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b14003cc0 con 0x7f3b2407e730 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14024840 con 0x7f3b2407e730 2024-06-02T22:22:02.546 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2419e8d0 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.742+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b241a15c0 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.743+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3b14022020 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.743+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b14011e00 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.743+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b24063af0 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.746+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3b14043dd0 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.849+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3b241a1790 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.850+0000 7f3b20c00700 1 -- 172.21.15.31:0/51985786 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f3b14032020 con 0x7f3b2407e730 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 msgr2=0x7f3b2419e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 --2- 172.21.15.31:0/51985786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b14011b60 tx=0x7f3b14011c40 comp rx=0 tx=0).stop 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 shutdown_connections 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 --2- 172.21.15.31:0/51985786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b2407e730 0x7f3b2419e100 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 >> 172.21.15.31:0/51985786 conn(0x7f3b24103560 msgr2=0x7f3b241040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 shutdown_connections 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:01.852+0000 7f3b2a600700 1 -- 172.21.15.31:0/51985786 wait complete. 2024-06-02T22:22:02.547 INFO:teuthology.orchestra.run.smithi031.stdout:mgr not available, waiting (3/15)... 2024-06-02T22:22:02.870 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:02.630+0000 7f1ab69d5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:22:03.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:02.928+0000 7f1ab69d5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:22:03.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: Activating manager daemon x 2024-06-02T22:22:03.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: mgrmap e2: x(active, starting, since 0.0110273s) 2024-06-02T22:22:03.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T22:22:03.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: Manager daemon x is now available 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' 2024-06-02T22:22:03.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:02 smithi031 ceph-mon[31767]: from='mgr.14100 172.21.15.31:0/3961915930' entity='mgr.x' 2024-06-02T22:22:05.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:04 smithi031 ceph-mon[31767]: mgrmap e3: x(active, since 1.02108s) 2024-06-02T22:22:06.176 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:05 smithi031 ceph-mon[31767]: mgrmap e4: x(active, since 2s) 2024-06-02T22:22:06.176 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:05 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/226149943' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T22:22:06.186 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 0 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.187 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T22:22:06.188 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:06.188 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T22:22:06.188 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T22:22:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T22:22:06.196 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T22:22:06.197 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T22:22:06.198 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ], 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T22:21:34.835857+0000", 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout }, 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.182+0000 7fbcf7e00700 1 Processor -- start 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.182+0000 7fbcf7e00700 1 -- start start 2024-06-02T22:22:06.199 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.183+0000 7fbcf7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.183+0000 7fbcf7e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0108a60 con 0x7fbcf0108070 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.183+0000 7fbcf5400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.183+0000 7fbcf5400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44264/0 (socket says 172.21.15.31:44264) 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.183+0000 7fbcf5400700 1 -- 172.21.15.31:0/3484999781 learned_addr learned my addr 172.21.15.31:0/3484999781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.184+0000 7fbcf5400700 1 -- 172.21.15.31:0/3484999781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01091d0 con 0x7fbcf0108070 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.184+0000 7fbcf5400700 1 --2- 172.21.15.31:0/3484999781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbce40098a0 tx=0x7fbce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4f31a1214a59d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.184+0000 7fbcefe00700 1 -- 172.21.15.31:0/3484999781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4004160 con 0x7fbcf0108070 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.184+0000 7fbcefe00700 1 -- 172.21.15.31:0/3484999781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbce4004300 con 0x7fbcf0108070 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.184+0000 7fbcefe00700 1 -- 172.21.15.31:0/3484999781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4011b50 con 0x7fbcf0108070 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 -- 172.21.15.31:0/3484999781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 msgr2=0x7fbcf0108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/3484999781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbce40098a0 tx=0x7fbce4009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 -- 172.21.15.31:0/3484999781 shutdown_connections 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/3484999781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf0108490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 -- 172.21.15.31:0/3484999781 >> 172.21.15.31:0/3484999781 conn(0x7fbcf01035f0 msgr2=0x7fbcf0105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 -- 172.21.15.31:0/3484999781 shutdown_connections 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.185+0000 7fbcf7e00700 1 -- 172.21.15.31:0/3484999781 wait complete. 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf7e00700 1 Processor -- start 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf7e00700 1 -- start start 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf7e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf010c580 con 0x7fbcf0108070 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf5400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf5400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44272/0 (socket says 172.21.15.31:44272) 2024-06-02T22:22:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.187+0000 7fbcf5400700 1 -- 172.21.15.31:0/226149943 learned_addr learned my addr 172.21.15.31:0/226149943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcf5400700 1 -- 172.21.15.31:0/226149943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf019c450 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcf5400700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000c00 tx=0x7fbce4011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4003b20 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbce4003cc0 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf019c6e0 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.188+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce4024910 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.189+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf019f3d0 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.190+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fbce4022020 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.190+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf0063af0 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.190+0000 7fbcee000700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 0x7fbcd803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.190+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbce4011e00 con 0x7fbcf0108070 2024-06-02T22:22:06.202 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.191+0000 7fbcf4a00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 0x7fbcd803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.191+0000 7fbcf4a00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 0x7fbcd803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc006fd0 tx=0x7fbcdc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.197+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbce404ca90 con 0x7fbcf0108070 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.517+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbcf019f5a0 con 0x7fbcf0108070 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.518+0000 7fbcee000700 1 -- 172.21.15.31:0/226149943 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fbcf019f5a0 con 0x7fbcf0108070 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.521+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 msgr2=0x7fbcd803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.521+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 0x7fbcd803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc006fd0 tx=0x7fbcdc006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.521+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 msgr2=0x7fbcf019bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.521+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbce4000c00 tx=0x7fbce4011c10 comp rx=0 tx=0).stop 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 shutdown_connections 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fbcd8039050 0x7fbcd803b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 --2- 172.21.15.31:0/226149943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbcf0108070 0x7fbcf019bf10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 >> 172.21.15.31:0/226149943 conn(0x7fbcf01035f0 msgr2=0x7fbcf0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:06.203 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 shutdown_connections 2024-06-02T22:22:06.204 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:05.522+0000 7fbcf7e00700 1 -- 172.21.15.31:0/226149943 wait complete. 2024-06-02T22:22:06.204 INFO:teuthology.orchestra.run.smithi031.stdout:mgr is available 2024-06-02T22:22:07.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:07 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2909555403' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T22:22:07.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout fsid = 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 2024-06-02T22:22:07.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T22:22:07.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T22:22:07.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T22:22:07.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T22:22:07.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T22:22:07.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.832+0000 7fe01e800700 1 Processor -- start 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.833+0000 7fe01e800700 1 -- start start 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.833+0000 7fe01e800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.833+0000 7fe01e800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810ab60 con 0x7fe01810a170 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.833+0000 7fe017400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.834+0000 7fe017400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44282/0 (socket says 172.21.15.31:44282) 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.834+0000 7fe017400700 1 -- 172.21.15.31:0/2739090068 learned_addr learned my addr 172.21.15.31:0/2739090068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.834+0000 7fe017400700 1 -- 172.21.15.31:0/2739090068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01810b380 con 0x7fe01810a170 2024-06-02T22:22:07.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.834+0000 7fe017400700 1 --2- 172.21.15.31:0/2739090068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe008009e80 tx=0x7fe00800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3197c452ff55ef29 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe016a00700 1 -- 172.21.15.31:0/2739090068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe008017070 con 0x7fe01810a170 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe016a00700 1 -- 172.21.15.31:0/2739090068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe00800b8c0 con 0x7fe01810a170 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe016a00700 1 -- 172.21.15.31:0/2739090068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0080045c0 con 0x7fe01810a170 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 -- 172.21.15.31:0/2739090068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 msgr2=0x7fe01810a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 --2- 172.21.15.31:0/2739090068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe008009e80 tx=0x7fe00800b330 comp rx=0 tx=0).stop 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 -- 172.21.15.31:0/2739090068 shutdown_connections 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 --2- 172.21.15.31:0/2739090068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01810a590 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 -- 172.21.15.31:0/2739090068 >> 172.21.15.31:0/2739090068 conn(0x7fe01807d640 msgr2=0x7fe01807da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.835+0000 7fe01e800700 1 -- 172.21.15.31:0/2739090068 shutdown_connections 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.836+0000 7fe01e800700 1 -- 172.21.15.31:0/2739090068 wait complete. 2024-06-02T22:22:07.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.836+0000 7fe01e800700 1 Processor -- start 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe01e800700 1 -- start start 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe01e800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe01e800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810e730 con 0x7fe01810a170 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe017400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe017400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44284/0 (socket says 172.21.15.31:44284) 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.837+0000 7fe017400700 1 -- 172.21.15.31:0/2909555403 learned_addr learned my addr 172.21.15.31:0/2909555403 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe017400700 1 -- 172.21.15.31:0/2909555403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01819e620 con 0x7fe01810a170 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe017400700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe008004210 tx=0x7fe00800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe008020020 con 0x7fe01810a170 2024-06-02T22:22:07.841 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe008003b50 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01819e8b0 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe008017040 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.838+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181a15a0 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.840+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe018063af0 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.840+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fe008023020 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.840+0000 7fe014c00700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 0x7fdffc03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.841+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe00800f050 con 0x7fe01810a170 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.841+0000 7fe00fe00700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 0x7fdffc03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.842+0000 7fe00fe00700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 0x7fdffc03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:07.842 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:06.846+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe00802a020 con 0x7fe01810a170 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.074+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe0181a1770 con 0x7fe01810a170 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.076+0000 7fe014c00700 1 -- 172.21.15.31:0/2909555403 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fe0181a1770 con 0x7fe01810a170 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.080+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 msgr2=0x7fdffc03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.080+0000 7fe01e800700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 0x7fdffc03b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 msgr2=0x7fe01819e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe008004210 tx=0x7fe00800bd50 comp rx=0 tx=0).stop 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 shutdown_connections 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7fdffc039050 0x7fdffc03b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 --2- 172.21.15.31:0/2909555403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01810a170 0x7fe01819e0e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 >> 172.21.15.31:0/2909555403 conn(0x7fe01807d640 msgr2=0x7fe018107cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 shutdown_connections 2024-06-02T22:22:07.843 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:07.081+0000 7fe01e800700 1 -- 172.21.15.31:0/2909555403 wait complete. 2024-06-02T22:22:07.844 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling cephadm module... 2024-06-02T22:22:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:08 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1370662651' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-02T22:22:09.121 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: ignoring --setuser ceph since I am not root 2024-06-02T22:22:09.121 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: ignoring --setgroup ceph since I am not root 2024-06-02T22:22:09.513 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:09.156+0000 7efeace65200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:22:09.513 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:09.404+0000 7efeace65200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.499+0000 7f8e93600700 1 Processor -- start 2024-06-02T22:22:09.525 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e93600700 1 -- start start 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e93600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e93600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c108930 con 0x7f8e8c107fb0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e90c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e90c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44292/0 (socket says 172.21.15.31:44292) 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.500+0000 7f8e90c00700 1 -- 172.21.15.31:0/3762909292 learned_addr learned my addr 172.21.15.31:0/3762909292 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.501+0000 7f8e90c00700 1 -- 172.21.15.31:0/3762909292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c1090f0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.501+0000 7f8e90c00700 1 --2- 172.21.15.31:0/3762909292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e800098a0 tx=0x7f8e80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acd4a070c39baa3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.501+0000 7f8e8b400700 1 -- 172.21.15.31:0/3762909292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e80004160 con 0x7f8e8c107fb0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e8b400700 1 -- 172.21.15.31:0/3762909292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e80004300 con 0x7f8e8c107fb0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e8b400700 1 -- 172.21.15.31:0/3762909292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e80011b50 con 0x7f8e8c107fb0 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 -- 172.21.15.31:0/3762909292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 msgr2=0x7f8e8c1083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:09.526 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 --2- 172.21.15.31:0/3762909292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e800098a0 tx=0x7f8e80009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 -- 172.21.15.31:0/3762909292 shutdown_connections 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 --2- 172.21.15.31:0/3762909292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c1083f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 -- 172.21.15.31:0/3762909292 >> 172.21.15.31:0/3762909292 conn(0x7f8e8c103600 msgr2=0x7f8e8c105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 -- 172.21.15.31:0/3762909292 shutdown_connections 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.502+0000 7f8e93600700 1 -- 172.21.15.31:0/3762909292 wait complete. 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.503+0000 7f8e93600700 1 Processor -- start 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e93600700 1 -- start start 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e93600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e93600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c10c3b0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e90c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e90c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44300/0 (socket says 172.21.15.31:44300) 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.504+0000 7f8e90c00700 1 -- 172.21.15.31:0/1370662651 learned_addr learned my addr 172.21.15.31:0/1370662651 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:09.527 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e90c00700 1 -- 172.21.15.31:0/1370662651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c19c420 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e90c00700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000c00 tx=0x7f8e80011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e80003b20 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e80003cc0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e80024910 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c19c6b0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.505+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c19f3a0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.507+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c10c530 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.507+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f8e80022020 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.508+0000 7f8e89600700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 0x7f8e7403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.508+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e80011e00 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.508+0000 7f8e8be00700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 0x7f8e7403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.509+0000 7f8e8be00700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 0x7f8e7403b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e78006fd0 tx=0x7f8e78006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.513+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e8001ad80 con 0x7f8e8c107fb0 2024-06-02T22:22:09.528 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.807+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f8e8c19f9f0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.861+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f8e80017ca0 con 0x7f8e8c107fb0 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.864+0000 7f8e89600700 1 -- 172.21.15.31:0/1370662651 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f8e8001a950 con 0x7f8e8c107fb0 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 msgr2=0x7f8e7403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 0x7f8e7403b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e78006fd0 tx=0x7f8e78006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 msgr2=0x7f8e8c19bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000c00 tx=0x7f8e80011c10 comp rx=0 tx=0).stop 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 shutdown_connections 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f8e74039050 0x7f8e7403b510 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e78006fd0 tx=0x7f8e78006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 --2- 172.21.15.31:0/1370662651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e8c107fb0 0x7f8e8c19bee0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8e80000c00 tx=0x7f8e80011c10 comp rx=0 tx=0).stop 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.866+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 >> 172.21.15.31:0/1370662651 conn(0x7f8e8c103600 msgr2=0x7f8e8c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.867+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 shutdown_connections 2024-06-02T22:22:09.529 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:08.867+0000 7f8e93600700 1 -- 172.21.15.31:0/1370662651 wait complete. 2024-06-02T22:22:09.813 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:09.544+0000 7efeace65200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:22:10.091 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1370662651' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-02T22:22:10.091 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-mon[31767]: mgrmap e5: x(active, since 5s) 2024-06-02T22:22:10.091 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:09.971+0000 7efeace65200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:22:10.370 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:10.090+0000 7efeace65200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:22:11.094 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:10 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/863323371' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.118+0000 7f7858e00700 1 Processor -- start 2024-06-02T22:22:11.112 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.118+0000 7f7858e00700 1 -- start start 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7858e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7858e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f78541076c0 con 0x7f7854106cd0 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7853400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7853400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44336/0 (socket says 172.21.15.31:44336) 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7853400700 1 -- 172.21.15.31:0/2120781295 learned_addr learned my addr 172.21.15.31:0/2120781295 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.119+0000 7f7853400700 1 -- 172.21.15.31:0/2120781295 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7854107ed0 con 0x7f7854106cd0 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.120+0000 7f7853400700 1 --2- 172.21.15.31:0/2120781295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78440098a0 tx=0x7f7844009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986e2f3ff209d066 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.120+0000 7f7852000700 1 -- 172.21.15.31:0/2120781295 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844004160 con 0x7f7854106cd0 2024-06-02T22:22:11.113 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.120+0000 7f7852000700 1 -- 172.21.15.31:0/2120781295 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7844004300 con 0x7f7854106cd0 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.120+0000 7f7852000700 1 -- 172.21.15.31:0/2120781295 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844011b50 con 0x7f7854106cd0 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 -- 172.21.15.31:0/2120781295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 msgr2=0x7f78541070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 --2- 172.21.15.31:0/2120781295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78440098a0 tx=0x7f7844009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 -- 172.21.15.31:0/2120781295 shutdown_connections 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 --2- 172.21.15.31:0/2120781295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f78541070f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 -- 172.21.15.31:0/2120781295 >> 172.21.15.31:0/2120781295 conn(0x7f78541022d0 msgr2=0x7f78541046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 -- 172.21.15.31:0/2120781295 shutdown_connections 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.121+0000 7f7858e00700 1 -- 172.21.15.31:0/2120781295 wait complete. 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.122+0000 7f7858e00700 1 Processor -- start 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7858e00700 1 -- start start 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7858e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7858e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f785410b280 con 0x7f7854106cd0 2024-06-02T22:22:11.114 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7853400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7853400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44348/0 (socket says 172.21.15.31:44348) 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.123+0000 7f7853400700 1 -- 172.21.15.31:0/863323371 learned_addr learned my addr 172.21.15.31:0/863323371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f7853400700 1 -- 172.21.15.31:0/863323371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785419e530 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f7853400700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7844011670 tx=0x7f7844011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78440039c0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7844011e50 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f784401a5c0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785419e7c0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.124+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a14b0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7854063af0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f7844024430 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f784be00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 0x7f783803b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f784404d4b0 con 0x7f7854106cd0 2024-06-02T22:22:11.115 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f7852a00700 1 -- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 msgr2=0x7f783803b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.126+0000 7f7852a00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 0x7f783803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.136+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f784404ced0 con 0x7f7854106cd0 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.327+0000 7f7852a00700 1 -- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 msgr2=0x7f783803b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.327+0000 7f7852a00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 0x7f783803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.422+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f785402df70 con 0x7f7854106cd0 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.423+0000 7f784be00700 1 -- 172.21.15.31:0/863323371 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f784402d3f0 con 0x7f7854106cd0 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.425+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 msgr2=0x7f783803b4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.425+0000 7f7858e00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 0x7f783803b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.425+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 msgr2=0x7f785419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.425+0000 7f7858e00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7844011670 tx=0x7f7844011b60 comp rx=0 tx=0).stop 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 shutdown_connections 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f7838039000 0x7f783803b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 --2- 172.21.15.31:0/863323371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7854106cd0 0x7f785419dff0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:11.116 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 >> 172.21.15.31:0/863323371 conn(0x7f78541022d0 msgr2=0x7f7854103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:11.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 shutdown_connections 2024-06-02T22:22:11.117 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:10.426+0000 7f7858e00700 1 -- 172.21.15.31:0/863323371 wait complete. 2024-06-02T22:22:11.117 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for the mgr to restart... 2024-06-02T22:22:11.117 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr epoch 5... 2024-06-02T22:22:11.956 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:11.723+0000 7efeace65200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:22:11.957 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:11.955+0000 7efeace65200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:22:12.285 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:12.176+0000 7efeace65200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:22:12.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:12.568+0000 7efeace65200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:22:12.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:12.695+0000 7efeace65200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:22:13.218 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:12.954+0000 7efeace65200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:22:13.218 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:13.217+0000 7efeace65200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:22:14.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:14.041+0000 7efeace65200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:22:14.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:14.614+0000 7efeace65200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:22:14.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:14.747+0000 7efeace65200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:22:15.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:15.021+0000 7efeace65200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:22:16.121 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:15.694+0000 7efeace65200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:22:16.121 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:15.821+0000 7efeace65200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:22:16.475 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:16.158+0000 7efeace65200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:22:16.476 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:16.343+0000 7efeace65200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:22:16.476 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:16.474+0000 7efeace65200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:22:16.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:16.630+0000 7efeace65200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:22:17.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:17.005+0000 7efeace65200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:22:18.092 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:17.793+0000 7efeace65200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:18.092+0000 7efeace65200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: Active manager daemon x restarted 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: Activating manager daemon x 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: osdmap e2: 0 total, 0 up, 0 in 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: mgrmap e6: x(active, starting, since 0.00895284s) 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:22:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T22:22:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T22:22:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T22:22:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T22:22:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:18 smithi031 ceph-mon[31767]: Manager daemon x is now available 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: Found migration_current of "None". Setting to last migration. 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T22:22:19.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T22:22:19.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:19.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:19.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:19 smithi031 ceph-mon[31767]: mgrmap e7: x(active, since 1.0124s) 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.673+0000 7f53c2e00700 1 Processor -- start 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.673+0000 7f53c2e00700 1 -- start start 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.674+0000 7f53c2e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.674+0000 7f53c2e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc07e150 con 0x7f53bc07dd30 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.674+0000 7f53c1a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.675+0000 7f53c1a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47396/0 (socket says 172.21.15.31:47396) 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.675+0000 7f53c1a00700 1 -- 172.21.15.31:0/3738371179 learned_addr learned my addr 172.21.15.31:0/3738371179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.675+0000 7f53c1a00700 1 -- 172.21.15.31:0/3738371179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc07c830 con 0x7f53bc07dd30 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.675+0000 7f53c1a00700 1 --2- 172.21.15.31:0/3738371179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53b00098a0 tx=0x7f53b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891b6ae8a9a438e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.676+0000 7f53bbe00700 1 -- 172.21.15.31:0/3738371179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b0004160 con 0x7f53bc07dd30 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.676+0000 7f53bbe00700 1 -- 172.21.15.31:0/3738371179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53b0004300 con 0x7f53bc07dd30 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.676+0000 7f53bbe00700 1 -- 172.21.15.31:0/3738371179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b0011b50 con 0x7f53bc07dd30 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.676+0000 7f53c2e00700 1 -- 172.21.15.31:0/3738371179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 msgr2=0x7f53bc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.676+0000 7f53c2e00700 1 --2- 172.21.15.31:0/3738371179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53b00098a0 tx=0x7f53b0009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.677+0000 7f53c2e00700 1 -- 172.21.15.31:0/3738371179 shutdown_connections 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.677+0000 7f53c2e00700 1 --2- 172.21.15.31:0/3738371179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc07c2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.926 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.677+0000 7f53c2e00700 1 -- 172.21.15.31:0/3738371179 >> 172.21.15.31:0/3738371179 conn(0x7f53bc1034c0 msgr2=0x7f53bc1058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.677+0000 7f53c2e00700 1 -- 172.21.15.31:0/3738371179 shutdown_connections 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.677+0000 7f53c2e00700 1 -- 172.21.15.31:0/3738371179 wait complete. 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.678+0000 7f53c2e00700 1 Processor -- start 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.678+0000 7f53c2e00700 1 -- start start 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.678+0000 7f53c2e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.678+0000 7f53c2e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc10e260 con 0x7f53bc07dd30 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.679+0000 7f53c1a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:19.927 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.679+0000 7f53c1a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47410/0 (socket says 172.21.15.31:47410) 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.679+0000 7f53c1a00700 1 -- 172.21.15.31:0/2003233232 learned_addr learned my addr 172.21.15.31:0/2003233232 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.679+0000 7f53c1a00700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc19e490 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.679+0000 7f53c1a00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53b0011b60 tx=0x7f53b0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.680+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b0003970 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.680+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53b0003b10 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.680+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b0024610 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.680+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc19e720 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.680+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc1a1410 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.681+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f53b001a430 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.682+0000 7f53ba000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.682+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f53a403bc70 con 0x7f53a40390a0 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.682+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53b0011e00 con 0x7f53bc07dd30 2024-06-02T22:22:19.928 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.682+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.682+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.883+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:11.883+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:12.284+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:12.284+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:13.085+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:13.085+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:14.687+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:14.687+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:17.891+0000 7f53c1000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/3345202686 2024-06-02T22:22:19.929 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:17.891+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:18.103+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f53b00248c0 con 0x7f53bc07dd30 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:18.103+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 msgr2=0x7f53a403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:18.103+0000 7f53ba000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.107+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f53b004e740 con 0x7f53bc07dd30 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.108+0000 7f53ba000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 0x7f53a403eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.108+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f53b0012ea0 con 0x7f53a403caf0 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.110+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 0x7f53a403eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.113+0000 7f53c1000700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 0x7f53a403eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003a10 tx=0x7f53a80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.114+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f53b0012ea0 con 0x7f53a403caf0 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.122+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f53bc063af0 con 0x7f53a403caf0 2024-06-02T22:22:19.930 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53ba000700 1 -- 172.21.15.31:0/2003233232 <== mgr.14120 v2:172.21.15.31:6800/4252327404 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f53bc063af0 con 0x7f53a403caf0 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 msgr2=0x7f53a403eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53c2e00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 0x7f53a403eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003a10 tx=0x7f53a80092b0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 msgr2=0x7f53bc19df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53c2e00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f53b0011b60 tx=0x7f53b0011c40 comp rx=0 tx=0).stop 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.123+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 shutdown_connections 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f53a403caf0 0x7f53a403eee0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53bc07dd30 0x7f53bc19df50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 --2- 172.21.15.31:0/2003233232 >> [v2:172.21.15.31:6800/3345202686,v1:172.21.15.31:6801/3345202686] conn(0x7f53a40390a0 0x7f53a403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 >> 172.21.15.31:0/2003233232 conn(0x7f53bc1034c0 msgr2=0x7f53bc104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 shutdown_connections 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:19.124+0000 7f53c2e00700 1 -- 172.21.15.31:0/2003233232 wait complete. 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:mgr epoch 5 is available 2024-06-02T22:22:19.931 INFO:teuthology.orchestra.run.smithi031.stdout:Setting orchestrator backend to cephadm... 2024-06-02T22:22:20.218 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:20 smithi031 ceph-mon[31767]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T22:22:20.218 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:20 smithi031 ceph-mon[31767]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T22:22:20.218 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:20 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:19] ENGINE Bus STARTING 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:20] ENGINE Serving on http://172.21.15.31:8765 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:20] ENGINE Serving on https://172.21.15.31:7150 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:20] ENGINE Bus STARTED 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: mgrmap e8: x(active, since 2s) 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:21 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.524+0000 7f0d3b400700 1 Processor -- start 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.524+0000 7f0d3b400700 1 -- start start 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.524+0000 7f0d3b400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.524+0000 7f0d3b400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340829d0 con 0x7f0d34081fe0 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.525+0000 7f0d38a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:21.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.525+0000 7f0d38a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38426/0 (socket says 172.21.15.31:38426) 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.525+0000 7f0d38a00700 1 -- 172.21.15.31:0/1677559323 learned_addr learned my addr 172.21.15.31:0/1677559323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.525+0000 7f0d38a00700 1 -- 172.21.15.31:0/1677559323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3410f7d0 con 0x7f0d34081fe0 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.526+0000 7f0d38a00700 1 --2- 172.21.15.31:0/1677559323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d280098a0 tx=0x7f0d28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bea103c77f85755 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.526+0000 7f0d33400700 1 -- 172.21.15.31:0/1677559323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d28004160 con 0x7f0d34081fe0 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.526+0000 7f0d33400700 1 -- 172.21.15.31:0/1677559323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d28004300 con 0x7f0d34081fe0 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.526+0000 7f0d33400700 1 -- 172.21.15.31:0/1677559323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d28011b50 con 0x7f0d34081fe0 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 -- 172.21.15.31:0/1677559323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 msgr2=0x7f0d34082400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 --2- 172.21.15.31:0/1677559323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d280098a0 tx=0x7f0d28009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 -- 172.21.15.31:0/1677559323 shutdown_connections 2024-06-02T22:22:21.482 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 --2- 172.21.15.31:0/1677559323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d34082400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 -- 172.21.15.31:0/1677559323 >> 172.21.15.31:0/1677559323 conn(0x7f0d3407d6a0 msgr2=0x7f0d3407fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 -- 172.21.15.31:0/1677559323 shutdown_connections 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.527+0000 7f0d3b400700 1 -- 172.21.15.31:0/1677559323 wait complete. 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.528+0000 7f0d3b400700 1 Processor -- start 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.529+0000 7f0d3b400700 1 -- start start 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.529+0000 7f0d3b400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.529+0000 7f0d3b400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d34112b80 con 0x7f0d34081fe0 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.529+0000 7f0d38a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.530+0000 7f0d38a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38436/0 (socket says 172.21.15.31:38436) 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.530+0000 7f0d38a00700 1 -- 172.21.15.31:0/676100308 learned_addr learned my addr 172.21.15.31:0/676100308 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.530+0000 7f0d38a00700 1 -- 172.21.15.31:0/676100308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d341a2a00 con 0x7f0d34081fe0 2024-06-02T22:22:21.483 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.530+0000 7f0d38a00700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d28011b60 tx=0x7f0d28011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.530+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d28003970 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.531+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d28003b10 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.531+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d28024610 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.531+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d341a2c90 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.531+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d341a5980 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.532+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0d2801a9f0 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.532+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d34063af0 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.532+0000 7f0d31600700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 0x7f0d1c03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.532+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0d28011e00 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.533+0000 7f0d33e00700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 0x7f0d1c03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.533+0000 7f0d33e00700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 0x7f0d1c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d24006fd0 tx=0x7f0d24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.539+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0d28016260 con 0x7f0d34081fe0 2024-06-02T22:22:21.484 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.787+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f0d3407e8f0 con 0x7f0d1c0390a0 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.805+0000 7f0d31600700 1 -- 172.21.15.31:0/676100308 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0d3407e8f0 con 0x7f0d1c0390a0 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.808+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 msgr2=0x7f0d1c03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.808+0000 7f0d3b400700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 0x7f0d1c03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d24006fd0 tx=0x7f0d24006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.808+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 msgr2=0x7f0d341a24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.808+0000 7f0d3b400700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d28011b60 tx=0x7f0d28011c40 comp rx=0 tx=0).stop 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 shutdown_connections 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f0d1c0390a0 0x7f0d1c03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 --2- 172.21.15.31:0/676100308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d34081fe0 0x7f0d341a24c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 >> 172.21.15.31:0/676100308 conn(0x7f0d3407d6a0 msgr2=0x7f0d3407e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 shutdown_connections 2024-06-02T22:22:21.485 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:20.809+0000 7f0d3b400700 1 -- 172.21.15.31:0/676100308 wait complete. 2024-06-02T22:22:23.127 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-02T22:22:23.128 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.114+0000 7f179f600700 1 Processor -- start 2024-06-02T22:22:23.128 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179f600700 1 -- start start 2024-06-02T22:22:23.128 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179f600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:23.129 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179f600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f179810abd0 con 0x7f179810a1e0 2024-06-02T22:22:23.129 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:23.129 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38448/0 (socket says 172.21.15.31:38448) 2024-06-02T22:22:23.129 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.115+0000 7f179cc00700 1 -- 172.21.15.31:0/4210403909 learned_addr learned my addr 172.21.15.31:0/4210403909 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:23.129 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.116+0000 7f179cc00700 1 -- 172.21.15.31:0/4210403909 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179810b3e0 con 0x7f179810a1e0 2024-06-02T22:22:23.130 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.116+0000 7f179cc00700 1 --2- 172.21.15.31:0/4210403909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f178c0098a0 tx=0x7f178c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96086fc5afdfc03 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:23.130 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.116+0000 7f1797400700 1 -- 172.21.15.31:0/4210403909 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f178c004160 con 0x7f179810a1e0 2024-06-02T22:22:23.130 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.116+0000 7f1797400700 1 -- 172.21.15.31:0/4210403909 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f178c004300 con 0x7f179810a1e0 2024-06-02T22:22:23.130 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.116+0000 7f1797400700 1 -- 172.21.15.31:0/4210403909 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f178c011b50 con 0x7f179810a1e0 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 -- 172.21.15.31:0/4210403909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 msgr2=0x7f179810a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 --2- 172.21.15.31:0/4210403909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f178c0098a0 tx=0x7f178c009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 -- 172.21.15.31:0/4210403909 shutdown_connections 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 --2- 172.21.15.31:0/4210403909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179810a1e0 0x7f179810a600 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 -- 172.21.15.31:0/4210403909 >> 172.21.15.31:0/4210403909 conn(0x7f179807d670 msgr2=0x7f179807daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.117+0000 7f179f600700 1 -- 172.21.15.31:0/4210403909 shutdown_connections 2024-06-02T22:22:23.131 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.118+0000 7f179f600700 1 -- 172.21.15.31:0/4210403909 wait complete. 2024-06-02T22:22:23.132 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179f600700 1 Processor -- start 2024-06-02T22:22:23.132 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179f600700 1 -- start start 2024-06-02T22:22:23.133 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179f600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:23.133 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179f600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f179810e790 con 0x7f179819e320 2024-06-02T22:22:23.133 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38454/0 (socket says 172.21.15.31:38454) 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.119+0000 7f179cc00700 1 -- 172.21.15.31:0/553959889 learned_addr learned my addr 172.21.15.31:0/553959889 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.120+0000 7f179cc00700 1 -- 172.21.15.31:0/553959889 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179819ec80 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.120+0000 7f179cc00700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c0119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.120+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f178c0038b0 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.120+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f178c003a50 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.120+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179819ef10 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.121+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f178c01b440 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.121+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17981a19f0 con 0x7f179819e320 2024-06-02T22:22:23.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.122+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f178c01a440 con 0x7f179819e320 2024-06-02T22:22:23.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.122+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1798063af0 con 0x7f179819e320 2024-06-02T22:22:23.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.122+0000 7f1795600700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 0x7f178003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.122+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f178c04d590 con 0x7f179819e320 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.123+0000 7f1797e00700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 0x7f178003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.124+0000 7f1797e00700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 0x7f178003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1788006fd0 tx=0x7f1788006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.128+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f178c0172b0 con 0x7f179819e320 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.360+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f1798108510 con 0x7f1780039050 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.362+0000 7f1795600700 1 -- 172.21.15.31:0/553959889 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f1798108510 con 0x7f1780039050 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 msgr2=0x7f178003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 0x7f178003b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1788006fd0 tx=0x7f1788006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 msgr2=0x7f179819e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c0119e0 comp rx=0 tx=0).stop 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 shutdown_connections 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f1780039050 0x7f178003b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:23.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 --2- 172.21.15.31:0/553959889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f179819e320 0x7f179819e740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:23.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 >> 172.21.15.31:0/553959889 conn(0x7f179807d670 msgr2=0x7f1798107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:23.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 shutdown_connections 2024-06-02T22:22:23.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:22.366+0000 7f179f600700 1 -- 172.21.15.31:0/553959889 wait complete. 2024-06-02T22:22:23.138 INFO:teuthology.orchestra.run.smithi031.stdout:Generating ssh key... 2024-06-02T22:22:23.289 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:23 smithi031 ceph-mon[31767]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:24.872 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: Generating public/private rsa key pair. 2024-06-02T22:22:24.872 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: Your identification has been saved in /tmp/tmphq56saoh/key. 2024-06-02T22:22:24.872 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: Your public key has been saved in /tmp/tmphq56saoh/key.pub. 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: The key fingerprint is: 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: SHA256:4K7jcZRmWYw2T9kx5kGTLOpGTT13ta7WxIJUuwGxiM4 ceph-52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: The key's randomart image is: 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: +---[RSA 3072]----+ 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | +B+.. ..| 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | o+=*== o .| 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | ===oo= + . | 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | o=O. . . = | 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | oBES . o + | 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | =o = | 2024-06-02T22:22:24.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | ..o o . | 2024-06-02T22:22:24.874 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | .+ . | 2024-06-02T22:22:24.874 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: | .o. | 2024-06-02T22:22:24.874 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: +----[SHA256]-----+ 2024-06-02T22:22:25.295 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.750+0000 7fa9af200700 1 Processor -- start 2024-06-02T22:22:25.303 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.750+0000 7fa9af200700 1 -- start start 2024-06-02T22:22:25.303 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.751+0000 7fa9af200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.751+0000 7fa9af200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b007bdd0 con 0x7fa9b0108950 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.751+0000 7fa9ade00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.752+0000 7fa9ade00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38470/0 (socket says 172.21.15.31:38470) 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.752+0000 7fa9ade00700 1 -- 172.21.15.31:0/3905579239 learned_addr learned my addr 172.21.15.31:0/3905579239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.752+0000 7fa9ade00700 1 -- 172.21.15.31:0/3905579239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b010b280 con 0x7fa9b0108950 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.752+0000 7fa9ade00700 1 --2- 172.21.15.31:0/3905579239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b54c2ca0632455 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9aca00700 1 -- 172.21.15.31:0/3905579239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0004160 con 0x7fa9b0108950 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9aca00700 1 -- 172.21.15.31:0/3905579239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9a0004300 con 0x7fa9b0108950 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9aca00700 1 -- 172.21.15.31:0/3905579239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0011b50 con 0x7fa9b0108950 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9af200700 1 -- 172.21.15.31:0/3905579239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 msgr2=0x7fa9b010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:25.304 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9af200700 1 --2- 172.21.15.31:0/3905579239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9af200700 1 -- 172.21.15.31:0/3905579239 shutdown_connections 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9af200700 1 --2- 172.21.15.31:0/3905579239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b010ad40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.753+0000 7fa9af200700 1 -- 172.21.15.31:0/3905579239 >> 172.21.15.31:0/3905579239 conn(0x7fa9b0102300 msgr2=0x7fa9b0104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.754+0000 7fa9af200700 1 -- 172.21.15.31:0/3905579239 shutdown_connections 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.754+0000 7fa9af200700 1 -- 172.21.15.31:0/3905579239 wait complete. 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.755+0000 7fa9af200700 1 Processor -- start 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.755+0000 7fa9af200700 1 -- start start 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.755+0000 7fa9af200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.755+0000 7fa9af200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b010c170 con 0x7fa9b0108950 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.755+0000 7fa9ade00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:25.305 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9ade00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38472/0 (socket says 172.21.15.31:38472) 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9ade00700 1 -- 172.21.15.31:0/328871080 learned_addr learned my addr 172.21.15.31:0/328871080 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9ade00700 1 -- 172.21.15.31:0/328871080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b019e490 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9ade00700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0011b60 tx=0x7fa9a0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0003b20 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.756+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9a0003cc0 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.757+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9a0024840 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.757+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b019e720 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.757+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b01a1410 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.758+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa9a0022020 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.758+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b0063af0 con 0x7fa9b0108950 2024-06-02T22:22:25.306 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.758+0000 7fa9a6a00700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 0x7fa99403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.758+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa9a0011e00 con 0x7fa9b0108950 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.759+0000 7fa9ad400700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 0x7fa99403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.759+0000 7fa9ad400700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 0x7fa99403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa99c006fd0 tx=0x7fa99c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.764+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa9a000b3e0 con 0x7fa9b0108950 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:23.986+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa9b01034a0 con 0x7fa9940390a0 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.546+0000 7fa9a6a00700 1 -- 172.21.15.31:0/328871080 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa9b01034a0 con 0x7fa9940390a0 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 msgr2=0x7fa99403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 0x7fa99403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa99c006fd0 tx=0x7fa99c006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:25.307 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 msgr2=0x7fa9b019df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0011b60 tx=0x7fa9a0011c40 comp rx=0 tx=0).stop 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 shutdown_connections 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fa9940390a0 0x7fa99403b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 --2- 172.21.15.31:0/328871080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9b0108950 0x7fa9b019df50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.549+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 >> 172.21.15.31:0/328871080 conn(0x7fa9b0102300 msgr2=0x7fa9b0102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.550+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 shutdown_connections 2024-06-02T22:22:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:24.550+0000 7fa9af200700 1 -- 172.21.15.31:0/328871080 wait complete. 2024-06-02T22:22:25.603 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:25 smithi031 ceph-mon[31767]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:25.603 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:25 smithi031 ceph-mon[31767]: Generating ssh key... 2024-06-02T22:22:25.603 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:25 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:25.603 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:25 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:26.815 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:22:26.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.904+0000 7fe082e00700 1 Processor -- start 2024-06-02T22:22:26.824 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.904+0000 7fe082e00700 1 -- start start 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.904+0000 7fe082e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.904+0000 7fe082e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c108a60 con 0x7fe07c108070 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.905+0000 7fe07be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.905+0000 7fe07be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38478/0 (socket says 172.21.15.31:38478) 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.905+0000 7fe07be00700 1 -- 172.21.15.31:0/4241929811 learned_addr learned my addr 172.21.15.31:0/4241929811 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:26.825 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.905+0000 7fe07be00700 1 -- 172.21.15.31:0/4241929811 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1091d0 con 0x7fe07c108070 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.906+0000 7fe07be00700 1 --2- 172.21.15.31:0/4241929811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0098a0 tx=0x7fe06c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b892185e9cb63154 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.906+0000 7fe07b400700 1 -- 172.21.15.31:0/4241929811 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe06c004160 con 0x7fe07c108070 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.906+0000 7fe07b400700 1 -- 172.21.15.31:0/4241929811 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe06c004300 con 0x7fe07c108070 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.906+0000 7fe07b400700 1 -- 172.21.15.31:0/4241929811 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe06c011b50 con 0x7fe07c108070 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 -- 172.21.15.31:0/4241929811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 msgr2=0x7fe07c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 --2- 172.21.15.31:0/4241929811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0098a0 tx=0x7fe06c009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:26.826 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 -- 172.21.15.31:0/4241929811 shutdown_connections 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 --2- 172.21.15.31:0/4241929811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c108490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 -- 172.21.15.31:0/4241929811 >> 172.21.15.31:0/4241929811 conn(0x7fe07c1035f0 msgr2=0x7fe07c105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 -- 172.21.15.31:0/4241929811 shutdown_connections 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.907+0000 7fe082e00700 1 -- 172.21.15.31:0/4241929811 wait complete. 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.908+0000 7fe082e00700 1 Processor -- start 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.908+0000 7fe082e00700 1 -- start start 2024-06-02T22:22:26.827 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.908+0000 7fe082e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe082e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10c580 con 0x7fe07c108070 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe07be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe07be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38484/0 (socket says 172.21.15.31:38484) 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe07be00700 1 -- 172.21.15.31:0/561810556 learned_addr learned my addr 172.21.15.31:0/561810556 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe07be00700 1 -- 172.21.15.31:0/561810556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c07e950 con 0x7fe07c108070 2024-06-02T22:22:26.828 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.909+0000 7fe07be00700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe06c011670 tx=0x7fe06c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.910+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe06c0039c0 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.910+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe06c011e50 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.910+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c07cb40 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.910+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe06c01a5c0 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.910+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c07d080 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.911+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe06c024430 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.911+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c063af0 con 0x7fe07c108070 2024-06-02T22:22:26.829 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.912+0000 7fe079600700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 0x7fe06003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.912+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe06c04d4f0 con 0x7fe07c108070 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.912+0000 7fe073400700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 0x7fe06003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.913+0000 7fe073400700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 0x7fe06003b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe064006fd0 tx=0x7fe064006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:25.917+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe06c04ce40 con 0x7fe07c108070 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.147+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe07c104860 con 0x7fe060039050 2024-06-02T22:22:26.830 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.148+0000 7fe079600700 1 -- 172.21.15.31:0/561810556 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe07c104860 con 0x7fe060039050 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 msgr2=0x7fe06003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 0x7fe06003b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe064006fd0 tx=0x7fe064006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 msgr2=0x7fe07c07e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe06c011670 tx=0x7fe06c011b60 comp rx=0 tx=0).stop 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 shutdown_connections 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe060039050 0x7fe06003b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:26.831 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 --2- 172.21.15.31:0/561810556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe07c108070 0x7fe07c07e410 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:26.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 >> 172.21.15.31:0/561810556 conn(0x7fe07c1035f0 msgr2=0x7fe07c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:26.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 shutdown_connections 2024-06-02T22:22:26.832 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:26.152+0000 7fe082e00700 1 -- 172.21.15.31:0/561810556 wait complete. 2024-06-02T22:22:26.832 INFO:teuthology.orchestra.run.smithi031.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-02T22:22:26.832 INFO:teuthology.orchestra.run.smithi031.stdout:Adding key to root@localhost authorized_keys... 2024-06-02T22:22:26.833 INFO:teuthology.orchestra.run.smithi031.stdout:Adding host smithi031... 2024-06-02T22:22:27.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:27 smithi031 ceph-mon[31767]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:28.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:28 smithi031 ceph-mon[31767]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi031", "addr": "172.21.15.31", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:30.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:30 smithi031 ceph-mon[31767]: Deploying cephadm binary to smithi031 2024-06-02T22:22:35.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Added host 'smithi031' with addr '172.21.15.31' 2024-06-02T22:22:35.034 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.496+0000 7fe383e00700 1 Processor -- start 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.496+0000 7fe383e00700 1 -- start start 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.496+0000 7fe383e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.496+0000 7fe383e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe3841087a0 con 0x7fe384107e40 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.497+0000 7fe382a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.497+0000 7fe382a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38486/0 (socket says 172.21.15.31:38486) 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.497+0000 7fe382a00700 1 -- 172.21.15.31:0/4253125403 learned_addr learned my addr 172.21.15.31:0/4253125403 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.497+0000 7fe382a00700 1 -- 172.21.15.31:0/4253125403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe384108920 con 0x7fe384107e40 2024-06-02T22:22:35.035 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.497+0000 7fe382a00700 1 --2- 172.21.15.31:0/4253125403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe3740098a0 tx=0x7fe374009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efa4c1fa952abe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:35.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.498+0000 7fe382000700 1 -- 172.21.15.31:0/4253125403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe374004160 con 0x7fe384107e40 2024-06-02T22:22:35.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.498+0000 7fe382000700 1 -- 172.21.15.31:0/4253125403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe374004300 con 0x7fe384107e40 2024-06-02T22:22:35.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.498+0000 7fe382000700 1 -- 172.21.15.31:0/4253125403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe374011b50 con 0x7fe384107e40 2024-06-02T22:22:35.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.498+0000 7fe383e00700 1 -- 172.21.15.31:0/4253125403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 msgr2=0x7fe384108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:35.039 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.498+0000 7fe383e00700 1 --2- 172.21.15.31:0/4253125403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe3740098a0 tx=0x7fe374009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.499+0000 7fe383e00700 1 -- 172.21.15.31:0/4253125403 shutdown_connections 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.499+0000 7fe383e00700 1 --2- 172.21.15.31:0/4253125403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe384108260 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.499+0000 7fe383e00700 1 -- 172.21.15.31:0/4253125403 >> 172.21.15.31:0/4253125403 conn(0x7fe3841034c0 msgr2=0x7fe3841058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.499+0000 7fe383e00700 1 -- 172.21.15.31:0/4253125403 shutdown_connections 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.499+0000 7fe383e00700 1 -- 172.21.15.31:0/4253125403 wait complete. 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.500+0000 7fe383e00700 1 Processor -- start 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.500+0000 7fe383e00700 1 -- start start 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.500+0000 7fe383e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe383e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe384109de0 con 0x7fe384107e40 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe382a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe382a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38498/0 (socket says 172.21.15.31:38498) 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe382a00700 1 -- 172.21.15.31:0/3011699095 learned_addr learned my addr 172.21.15.31:0/3011699095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe382a00700 1 -- 172.21.15.31:0/3011699095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38419e4e0 con 0x7fe384107e40 2024-06-02T22:22:35.040 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.501+0000 7fe382a00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fb0 tx=0x7fe374011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.502+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3740038b0 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.502+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe374011e50 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.502+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe374019420 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.502+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38419e770 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.502+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3841a1460 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.503+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe374003a50 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.503+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe384063af0 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.504+0000 7fe37b400700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 0x7fe36803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.504+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe37404d2f0 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.504+0000 7fe37be00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 0x7fe36803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.505+0000 7fe37be00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 0x7fe36803b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006fd0 tx=0x7fe36c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.509+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe37404cc40 con 0x7fe384107e40 2024-06-02T22:22:35.041 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:27.742+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi031", "addr": "172.21.15.31", "target": ["mon-mgr", ""]}) -- 0x7fe3841046e0 con 0x7fe368039050 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.242+0000 7fe37b400700 1 -- 172.21.15.31:0/3011699095 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe3841046e0 con 0x7fe368039050 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 msgr2=0x7fe36803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 0x7fe36803b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006fd0 tx=0x7fe36c006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 msgr2=0x7fe38419dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe374009fb0 tx=0x7fe374011bf0 comp rx=0 tx=0).stop 2024-06-02T22:22:35.042 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 shutdown_connections 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fe368039050 0x7fe36803b510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 --2- 172.21.15.31:0/3011699095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe384107e40 0x7fe38419dfa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 >> 172.21.15.31:0/3011699095 conn(0x7fe3841034c0 msgr2=0x7fe384103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.246+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 shutdown_connections 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:34.247+0000 7fe383e00700 1 -- 172.21.15.31:0/3011699095 wait complete. 2024-06-02T22:22:35.043 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying unmanaged mon service... 2024-06-02T22:22:35.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:35 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:35.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:35 smithi031 ceph-mon[31767]: Added host smithi031 2024-06-02T22:22:35.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:35 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.783+0000 7f438f600700 1 Processor -- start 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.783+0000 7f438f600700 1 -- start start 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.784+0000 7f438f600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.784+0000 7f438f600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4388108930 con 0x7f4388107fb0 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.784+0000 7f438cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.784+0000 7f438cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36864/0 (socket says 172.21.15.31:36864) 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.784+0000 7f438cc00700 1 -- 172.21.15.31:0/171664404 learned_addr learned my addr 172.21.15.31:0/171664404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.785+0000 7f438cc00700 1 -- 172.21.15.31:0/171664404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43881090f0 con 0x7f4388107fb0 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.785+0000 7f438cc00700 1 --2- 172.21.15.31:0/171664404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f437c0098a0 tx=0x7f437c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fc7a654b9f6840 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.785+0000 7f4387400700 1 -- 172.21.15.31:0/171664404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f437c004160 con 0x7f4388107fb0 2024-06-02T22:22:37.235 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.785+0000 7f4387400700 1 -- 172.21.15.31:0/171664404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f437c004300 con 0x7f4388107fb0 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.785+0000 7f4387400700 1 -- 172.21.15.31:0/171664404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f437c011b50 con 0x7f4388107fb0 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.786+0000 7f438f600700 1 -- 172.21.15.31:0/171664404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 msgr2=0x7f43881083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.786+0000 7f438f600700 1 --2- 172.21.15.31:0/171664404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f437c0098a0 tx=0x7f437c009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.786+0000 7f438f600700 1 -- 172.21.15.31:0/171664404 shutdown_connections 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.786+0000 7f438f600700 1 --2- 172.21.15.31:0/171664404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f43881083f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.786+0000 7f438f600700 1 -- 172.21.15.31:0/171664404 >> 172.21.15.31:0/171664404 conn(0x7f4388103600 msgr2=0x7f4388105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.787+0000 7f438f600700 1 -- 172.21.15.31:0/171664404 shutdown_connections 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.787+0000 7f438f600700 1 -- 172.21.15.31:0/171664404 wait complete. 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.788+0000 7f438f600700 1 Processor -- start 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.788+0000 7f438f600700 1 -- start start 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.788+0000 7f438f600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.788+0000 7f438f600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f438810c3b0 con 0x7f4388107fb0 2024-06-02T22:22:37.236 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.789+0000 7f438cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.789+0000 7f438cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36870/0 (socket says 172.21.15.31:36870) 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.789+0000 7f438cc00700 1 -- 172.21.15.31:0/1011398584 learned_addr learned my addr 172.21.15.31:0/1011398584 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.789+0000 7f438cc00700 1 -- 172.21.15.31:0/1011398584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438819e620 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.789+0000 7f438cc00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f437c000c00 tx=0x7f437c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.790+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f437c003b20 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.790+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f437c003cc0 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.790+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f437c024910 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.790+0000 7f438f600700 1 -- 172.21.15.31:0/1011398584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438819e8b0 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.790+0000 7f438f600700 1 -- 172.21.15.31:0/1011398584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43881a15a0 con 0x7f4388107fb0 2024-06-02T22:22:37.237 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.791+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438810c530 con 0x7f4388107fb0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.792+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f437c022020 con 0x7f4388107fb0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.792+0000 7f4385600700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 0x7f437003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.792+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f437c011e00 con 0x7f4388107fb0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.793+0000 7f4387e00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 0x7f437003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.793+0000 7f4387e00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 0x7f437003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4374006fd0 tx=0x7f4374006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:35.799+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f437c01ad80 con 0x7f4388107fb0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.047+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4388063230 con 0x7f43700390a0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.058+0000 7f4385600700 1 -- 172.21.15.31:0/1011398584 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4388063230 con 0x7f43700390a0 2024-06-02T22:22:37.238 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 msgr2=0x7f437003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 0x7f437003b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4374006fd0 tx=0x7f4374006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 msgr2=0x7f438819e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f437c000c00 tx=0x7f437c011c10 comp rx=0 tx=0).stop 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 shutdown_connections 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f43700390a0 0x7f437003b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 --2- 172.21.15.31:0/1011398584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4388107fb0 0x7f438819e0e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.061+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 >> 172.21.15.31:0/1011398584 conn(0x7f4388103600 msgr2=0x7f43881041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.062+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 shutdown_connections 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:36.062+0000 7f437aa00700 1 -- 172.21.15.31:0/1011398584 wait complete. 2024-06-02T22:22:37.239 INFO:teuthology.orchestra.run.smithi031.stdout:Deploying unmanaged mgr service... 2024-06-02T22:22:37.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:37 smithi031 ceph-mon[31767]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:37.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:37 smithi031 ceph-mon[31767]: Saving service mon spec with placement count:5 2024-06-02T22:22:37.355 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:37 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:38.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:38 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:38.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:38 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:38.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:38 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:39.334 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-02T22:22:39.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.329+0000 7f252f800700 1 Processor -- start 2024-06-02T22:22:39.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.329+0000 7f252f800700 1 -- start start 2024-06-02T22:22:39.335 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.330+0000 7f252f800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:39.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.330+0000 7f252f800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f252807bec0 con 0x7f2528106810 2024-06-02T22:22:39.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.330+0000 7f252ce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:39.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.330+0000 7f252ce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36886/0 (socket says 172.21.15.31:36886) 2024-06-02T22:22:39.336 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.330+0000 7f252ce00700 1 -- 172.21.15.31:0/2797396277 learned_addr learned my addr 172.21.15.31:0/2797396277 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.331+0000 7f252ce00700 1 -- 172.21.15.31:0/2797396277 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2528107170 con 0x7f2528106810 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.331+0000 7f252ce00700 1 --2- 172.21.15.31:0/2797396277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098a0 tx=0x7f251c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ffbc961770b46f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.331+0000 7f2527400700 1 -- 172.21.15.31:0/2797396277 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f251c004160 con 0x7f2528106810 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.332+0000 7f2527400700 1 -- 172.21.15.31:0/2797396277 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f251c004300 con 0x7f2528106810 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.332+0000 7f2527400700 1 -- 172.21.15.31:0/2797396277 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f251c011b20 con 0x7f2528106810 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.332+0000 7f252f800700 1 -- 172.21.15.31:0/2797396277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 msgr2=0x7f2528106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.332+0000 7f252f800700 1 --2- 172.21.15.31:0/2797396277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098a0 tx=0x7f251c009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:39.337 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.333+0000 7f252f800700 1 -- 172.21.15.31:0/2797396277 shutdown_connections 2024-06-02T22:22:39.340 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.333+0000 7f252f800700 1 --2- 172.21.15.31:0/2797396277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f2528106c30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:39.340 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.333+0000 7f252f800700 1 -- 172.21.15.31:0/2797396277 >> 172.21.15.31:0/2797396277 conn(0x7f2528102450 msgr2=0x7f2528104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:39.340 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.333+0000 7f252f800700 1 -- 172.21.15.31:0/2797396277 shutdown_connections 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.333+0000 7f252f800700 1 -- 172.21.15.31:0/2797396277 wait complete. 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.334+0000 7f252f800700 1 Processor -- start 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.334+0000 7f252f800700 1 -- start start 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.334+0000 7f252f800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.334+0000 7f252f800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2528108240 con 0x7f2528106810 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.335+0000 7f252ce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.335+0000 7f252ce00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36898/0 (socket says 172.21.15.31:36898) 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.335+0000 7f252ce00700 1 -- 172.21.15.31:0/1837583699 learned_addr learned my addr 172.21.15.31:0/1837583699 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.335+0000 7f252ce00700 1 -- 172.21.15.31:0/1837583699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252810c7f0 con 0x7f2528106810 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.335+0000 7f252ce00700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f251c0117e0 tx=0x7f251c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.336+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f251c003ba0 con 0x7f2528106810 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.336+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f251c01a910 con 0x7f2528106810 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.336+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f251c0248f0 con 0x7f2528106810 2024-06-02T22:22:39.341 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.336+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252810ca80 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.336+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2528108fc0 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.337+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252810cc50 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.337+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f251c022020 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.338+0000 7f2525600700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 0x7f251003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.338+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f251c04d530 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.338+0000 7f2527e00700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 0x7f251003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.339+0000 7f2527e00700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 0x7f251003b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2514006fd0 tx=0x7f2514006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.343+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f252810cc50 con 0x7f2528106810 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.603+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2528197720 con 0x7f25100390a0 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.609+0000 7f2525600700 1 -- 172.21.15.31:0/1837583699 <== mgr.14120 v2:172.21.15.31:6800/4252327404 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2528197720 con 0x7f25100390a0 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.612+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 msgr2=0x7f251003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.612+0000 7f252f800700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 0x7f251003b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2514006fd0 tx=0x7f2514006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:39.342 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.612+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 msgr2=0x7f252810c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:39.343 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.612+0000 7f252f800700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f251c0117e0 tx=0x7f251c011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:39.343 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 shutdown_connections 2024-06-02T22:22:39.343 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f25100390a0 0x7f251003b560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:39.343 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 --2- 172.21.15.31:0/1837583699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2528106810 0x7f252810c2b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:39.344 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 >> 172.21.15.31:0/1837583699 conn(0x7f2528102450 msgr2=0x7f2528194c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:39.344 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 shutdown_connections 2024-06-02T22:22:39.344 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:38.613+0000 7f252f800700 1 -- 172.21.15.31:0/1837583699 wait complete. 2024-06-02T22:22:39.940 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:39 smithi031 ceph-mon[31767]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:22:39.940 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:39 smithi031 ceph-mon[31767]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:39.940 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:39 smithi031 ceph-mon[31767]: Saving service mgr spec with placement count:2 2024-06-02T22:22:41.469 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:41 smithi031 ceph-mon[31767]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:22:41.469 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1945650845' entity='client.admin' 2024-06-02T22:22:41.480 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.940+0000 7f4fc9a00700 1 Processor -- start 2024-06-02T22:22:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.940+0000 7f4fc9a00700 1 -- start start 2024-06-02T22:22:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.941+0000 7f4fc9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.941+0000 7f4fc9a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41077d0 con 0x7f4fc4106e70 2024-06-02T22:22:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.941+0000 7f4fc2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.941+0000 7f4fc2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36906/0 (socket says 172.21.15.31:36906) 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.941+0000 7f4fc2a00700 1 -- 172.21.15.31:0/1898478726 learned_addr learned my addr 172.21.15.31:0/1898478726 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.942+0000 7f4fc2a00700 1 -- 172.21.15.31:0/1898478726 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc4108060 con 0x7f4fc4106e70 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.942+0000 7f4fc2a00700 1 --2- 172.21.15.31:0/1898478726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bb40 tx=0x7f4fb400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abb6433be720084 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.942+0000 7f4fc1600700 1 -- 172.21.15.31:0/1898478726 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb400dbe0 con 0x7f4fc4106e70 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.943+0000 7f4fc1600700 1 -- 172.21.15.31:0/1898478726 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb4004510 con 0x7f4fc4106e70 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.943+0000 7f4fc1600700 1 -- 172.21.15.31:0/1898478726 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb4010470 con 0x7f4fc4106e70 2024-06-02T22:22:41.486 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.943+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1898478726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 msgr2=0x7f4fc4107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.943+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1898478726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bb40 tx=0x7f4fb400be50 comp rx=0 tx=0).stop 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.944+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1898478726 shutdown_connections 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.944+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1898478726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc4107290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.944+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1898478726 >> 172.21.15.31:0/1898478726 conn(0x7f4fc41024a0 msgr2=0x7f4fc41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.944+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1898478726 shutdown_connections 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.944+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1898478726 wait complete. 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.945+0000 7f4fc9a00700 1 Processor -- start 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.945+0000 7f4fc9a00700 1 -- start start 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.945+0000 7f4fc9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.945+0000 7f4fc9a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc407b870 con 0x7f4fc4106e70 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.946+0000 7f4fc2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:41.487 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.946+0000 7f4fc2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36914/0 (socket says 172.21.15.31:36914) 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.946+0000 7f4fc2a00700 1 -- 172.21.15.31:0/1945650845 learned_addr learned my addr 172.21.15.31:0/1945650845 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.946+0000 7f4fc2a00700 1 -- 172.21.15.31:0/1945650845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419e620 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.946+0000 7f4fc2a00700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40046e0 tx=0x7f4fb40040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.947+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb4010720 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.947+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb401d070 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.947+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419e8b0 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.947+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb4021b10 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.947+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a15a0 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.948+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc4063af0 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.949+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4fb401f030 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.949+0000 7f4fbb400700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 0x7f4fa803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.949+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4fb404d320 con 0x7f4fc4106e70 2024-06-02T22:22:41.488 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.950+0000 7f4fc2000700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 0x7f4fa803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.951+0000 7f4fc2000700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 0x7f4fa803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0006fd0 tx=0x7f4fb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:39.955+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4fb4015070 con 0x7f4fc4106e70 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.206+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f4fc4193190 con 0x7f4fc4106e70 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.213+0000 7f4fbb400700 1 -- 172.21.15.31:0/1945650845 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4fc4193190 con 0x7f4fc4106e70 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.217+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 msgr2=0x7f4fa803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.217+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 0x7f4fa803b560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0006fd0 tx=0x7f4fb0006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.217+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 msgr2=0x7f4fc419e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.217+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40046e0 tx=0x7f4fb40040b0 comp rx=0 tx=0).stop 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 shutdown_connections 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f4fa80390a0 0x7f4fa803b560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 --2- 172.21.15.31:0/1945650845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fc4106e70 0x7f4fc419e0e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 >> 172.21.15.31:0/1945650845 conn(0x7f4fc41024a0 msgr2=0x7f4fc4190270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:41.489 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 shutdown_connections 2024-06-02T22:22:41.490 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:40.218+0000 7f4fc9a00700 1 -- 172.21.15.31:0/1945650845 wait complete. 2024-06-02T22:22:42.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:42 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:42.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:42 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1099955532' entity='client.admin' 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.085+0000 7fb134200700 1 Processor -- start 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.085+0000 7fb134200700 1 -- start start 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.086+0000 7fb134200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.086+0000 7fb134200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c07c830 con 0x7fb12c07ddf0 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.087+0000 7fb131800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.087+0000 7fb131800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47878/0 (socket says 172.21.15.31:47878) 2024-06-02T22:22:43.104 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.087+0000 7fb131800700 1 -- 172.21.15.31:0/2755998404 learned_addr learned my addr 172.21.15.31:0/2755998404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.087+0000 7fb131800700 1 -- 172.21.15.31:0/2755998404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c07c9b0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.088+0000 7fb131800700 1 --2- 172.21.15.31:0/2755998404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1200098a0 tx=0x7fb120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f83305eddae5317 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.088+0000 7fb12be00700 1 -- 172.21.15.31:0/2755998404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb120004160 con 0x7fb12c07ddf0 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.088+0000 7fb12be00700 1 -- 172.21.15.31:0/2755998404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb120004300 con 0x7fb12c07ddf0 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.088+0000 7fb12be00700 1 -- 172.21.15.31:0/2755998404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb120011b20 con 0x7fb12c07ddf0 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 -- 172.21.15.31:0/2755998404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 msgr2=0x7fb12c07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 --2- 172.21.15.31:0/2755998404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1200098a0 tx=0x7fb120009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 -- 172.21.15.31:0/2755998404 shutdown_connections 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 --2- 172.21.15.31:0/2755998404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c07c2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 -- 172.21.15.31:0/2755998404 >> 172.21.15.31:0/2755998404 conn(0x7fb12c103600 msgr2=0x7fb12c105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 -- 172.21.15.31:0/2755998404 shutdown_connections 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.089+0000 7fb134200700 1 -- 172.21.15.31:0/2755998404 wait complete. 2024-06-02T22:22:43.105 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.090+0000 7fb134200700 1 Processor -- start 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb134200700 1 -- start start 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb134200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb134200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb12c10e560 con 0x7fb12c07ddf0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb131800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb131800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47886/0 (socket says 172.21.15.31:47886) 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.091+0000 7fb131800700 1 -- 172.21.15.31:0/1099955532 learned_addr learned my addr 172.21.15.31:0/1099955532 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb131800700 1 -- 172.21.15.31:0/1099955532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12c19e560 con 0x7fb12c07ddf0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb131800700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1200117e0 tx=0x7fb120011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb120003ba0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb12001a910 con 0x7fb12c07ddf0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12c19e7f0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.106 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.092+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1200248f0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.093+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12c19ec50 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.094+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb120022020 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.094+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12c063af0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.094+0000 7fb12a000700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 0x7fb11403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.094+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb12004d470 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.095+0000 7fb130e00700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 0x7fb11403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.095+0000 7fb130e00700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 0x7fb11403b560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb118006fd0 tx=0x7fb118006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.100+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb12001ab70 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.337+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fb12c1a1620 con 0x7fb12c07ddf0 2024-06-02T22:22:43.107 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.341+0000 7fb12a000700 1 -- 172.21.15.31:0/1099955532 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fb1200212c0 con 0x7fb12c07ddf0 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.344+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 msgr2=0x7fb11403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 0x7fb11403b560 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb118006fd0 tx=0x7fb118006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 msgr2=0x7fb12c19e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1200117e0 tx=0x7fb120011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 shutdown_connections 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7fb1140390a0 0x7fb11403b560 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 --2- 172.21.15.31:0/1099955532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb12c07ddf0 0x7fb12c19e020 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 >> 172.21.15.31:0/1099955532 conn(0x7fb12c103600 msgr2=0x7fb12c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 shutdown_connections 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:42.345+0000 7fb134200700 1 -- 172.21.15.31:0/1099955532 wait complete. 2024-06-02T22:22:43.108 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling the dashboard module... 2024-06-02T22:22:43.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:43 smithi031 ceph-mon[31767]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:22:44.903 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:44 smithi031 ceph-mon[31767]: from='mgr.14120 172.21.15.31:0/2073775943' entity='mgr.x' 2024-06-02T22:22:44.903 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:44 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2850719663' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-02T22:22:45.181 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: ignoring --setuser ceph since I am not root 2024-06-02T22:22:45.181 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: ignoring --setgroup ceph since I am not root 2024-06-02T22:22:45.181 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:45.080+0000 7fa88a9a5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:22:45.465 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:45.328+0000 7fa88a9a5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:22:45.759 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:45.466+0000 7fa88a9a5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:22:46.119 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:45.879+0000 7fa88a9a5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:22:46.119 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:45.997+0000 7fa88a9a5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:22:46.119 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2850719663' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-02T22:22:46.119 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:45 smithi031 ceph-mon[31767]: mgrmap e9: x(active, since 26s) 2024-06-02T22:22:46.133 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.761+0000 7ff410e00700 1 Processor -- start 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.761+0000 7ff410e00700 1 -- start start 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.762+0000 7ff410e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.762+0000 7ff410e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c108930 con 0x7ff40c107fb0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.762+0000 7ff409e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.762+0000 7ff409e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47902/0 (socket says 172.21.15.31:47902) 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.762+0000 7ff409e00700 1 -- 172.21.15.31:0/3769244186 learned_addr learned my addr 172.21.15.31:0/3769244186 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.763+0000 7ff409e00700 1 -- 172.21.15.31:0/3769244186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c1090f0 con 0x7ff40c107fb0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.763+0000 7ff409e00700 1 --2- 172.21.15.31:0/3769244186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098a0 tx=0x7ff3fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4929d1cf8caabeb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.763+0000 7ff409400700 1 -- 172.21.15.31:0/3769244186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc004160 con 0x7ff40c107fb0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.763+0000 7ff409400700 1 -- 172.21.15.31:0/3769244186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3fc004300 con 0x7ff40c107fb0 2024-06-02T22:22:46.134 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.763+0000 7ff409400700 1 -- 172.21.15.31:0/3769244186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc011b20 con 0x7ff40c107fb0 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.764+0000 7ff410e00700 1 -- 172.21.15.31:0/3769244186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 msgr2=0x7ff40c1083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.764+0000 7ff410e00700 1 --2- 172.21.15.31:0/3769244186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098a0 tx=0x7ff3fc009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.764+0000 7ff410e00700 1 -- 172.21.15.31:0/3769244186 shutdown_connections 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.764+0000 7ff410e00700 1 --2- 172.21.15.31:0/3769244186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c1083f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.764+0000 7ff410e00700 1 -- 172.21.15.31:0/3769244186 >> 172.21.15.31:0/3769244186 conn(0x7ff40c103600 msgr2=0x7ff40c105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.765+0000 7ff410e00700 1 -- 172.21.15.31:0/3769244186 shutdown_connections 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.765+0000 7ff410e00700 1 -- 172.21.15.31:0/3769244186 wait complete. 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.766+0000 7ff410e00700 1 Processor -- start 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.766+0000 7ff410e00700 1 -- start start 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.766+0000 7ff410e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:46.135 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.766+0000 7ff410e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c10c3b0 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.767+0000 7ff409e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.767+0000 7ff409e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47912/0 (socket says 172.21.15.31:47912) 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.767+0000 7ff409e00700 1 -- 172.21.15.31:0/2850719663 learned_addr learned my addr 172.21.15.31:0/2850719663 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.767+0000 7ff409e00700 1 -- 172.21.15.31:0/2850719663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c19e5c0 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.767+0000 7ff409e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0117e0 tx=0x7ff3fc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.768+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc003bf0 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.768+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3fc01a910 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.768+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc024970 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.768+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c19e850 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.768+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c19ecb0 con 0x7ff40c107fb0 2024-06-02T22:22:46.136 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.769+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40c063af0 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.769+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff3fc022020 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.770+0000 7ff402a00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 0x7ff3f003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.770+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff3fc04d3e0 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.770+0000 7ff403e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 0x7ff3f003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.771+0000 7ff403e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 0x7ff3f003b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006fd0 tx=0x7ff3f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:43.775+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff3fc0212c0 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.073+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff40c1a1680 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.760+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff3fc01ab70 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.764+0000 7ff402a00700 1 -- 172.21.15.31:0/2850719663 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ff3fc02d3f0 con 0x7ff40c107fb0 2024-06-02T22:22:46.137 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.766+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 msgr2=0x7ff3f003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.766+0000 7ff410e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 0x7ff3f003b560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4006fd0 tx=0x7ff3f4006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.766+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 msgr2=0x7ff40c19e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.766+0000 7ff410e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0117e0 tx=0x7ff3fc011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.767+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 shutdown_connections 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.767+0000 7ff410e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ff3f00390a0 0x7ff3f003b560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.767+0000 7ff410e00700 1 --2- 172.21.15.31:0/2850719663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff40c107fb0 0x7ff40c19e080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.767+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 >> 172.21.15.31:0/2850719663 conn(0x7ff40c103600 msgr2=0x7ff40c1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.767+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 shutdown_connections 2024-06-02T22:22:46.138 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:44.768+0000 7ff410e00700 1 -- 172.21.15.31:0/2850719663 wait complete. 2024-06-02T22:22:47.798 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:47 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/120165455' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T22:22:47.798 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:47 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:47.619+0000 7fa88a9a5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:22:48.079 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:47 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:47.856+0000 7fa88a9a5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:22:48.079 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:48.078+0000 7fa88a9a5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.127+0000 7ffa66e00700 1 Processor -- start 2024-06-02T22:22:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.127+0000 7ffa66e00700 1 -- start start 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.128+0000 7ffa66e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.128+0000 7ffa66e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6007c850 con 0x7ffa6007de10 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.128+0000 7ffa5fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.128+0000 7ffa5fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47942/0 (socket says 172.21.15.31:47942) 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.128+0000 7ffa5fe00700 1 -- 172.21.15.31:0/2812744798 learned_addr learned my addr 172.21.15.31:0/2812744798 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.129+0000 7ffa5fe00700 1 -- 172.21.15.31:0/2812744798 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6007c9d0 con 0x7ffa6007de10 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.129+0000 7ffa5fe00700 1 --2- 172.21.15.31:0/2812744798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa500098a0 tx=0x7ffa50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8996bf99e9a18931 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.129+0000 7ffa5ea00700 1 -- 172.21.15.31:0/2812744798 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50004160 con 0x7ffa6007de10 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.129+0000 7ffa5ea00700 1 -- 172.21.15.31:0/2812744798 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa50004300 con 0x7ffa6007de10 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.129+0000 7ffa5ea00700 1 -- 172.21.15.31:0/2812744798 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50011b20 con 0x7ffa6007de10 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 -- 172.21.15.31:0/2812744798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 msgr2=0x7ffa6007c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 --2- 172.21.15.31:0/2812744798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa500098a0 tx=0x7ffa50009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 -- 172.21.15.31:0/2812744798 shutdown_connections 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 --2- 172.21.15.31:0/2812744798 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6007c310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 -- 172.21.15.31:0/2812744798 >> 172.21.15.31:0/2812744798 conn(0x7ffa60103600 msgr2=0x7ffa60105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 -- 172.21.15.31:0/2812744798 shutdown_connections 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.130+0000 7ffa66e00700 1 -- 172.21.15.31:0/2812744798 wait complete. 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.131+0000 7ffa66e00700 1 Processor -- start 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa66e00700 1 -- start start 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa66e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa66e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6010e5a0 con 0x7ffa6007de10 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa5fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa5fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47948/0 (socket says 172.21.15.31:47948) 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.132+0000 7ffa5fe00700 1 -- 172.21.15.31:0/120165455 learned_addr learned my addr 172.21.15.31:0/120165455 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa5fe00700 1 -- 172.21.15.31:0/120165455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6019e560 con 0x7ffa6007de10 2024-06-02T22:22:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa5fe00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa500117e0 tx=0x7ffa50011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa50003ba0 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa5001a910 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6019e7f0 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa500248f0 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.133+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6019ec50 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ffa50022020 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60063af0 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa5cc00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 0x7ffa4403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffa5004d760 con 0x7ffa6007de10 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa5f400700 1 -- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 msgr2=0x7ffa4403b610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.135+0000 7ffa5f400700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 0x7ffa4403b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:22:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.141+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffa5001a430 con 0x7ffa6007de10 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.336+0000 7ffa5f400700 1 -- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 msgr2=0x7ffa4403b610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.336+0000 7ffa5f400700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 0x7ffa4403b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.427+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ffa601a1600 con 0x7ffa6007de10 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.428+0000 7ffa5cc00700 1 -- 172.21.15.31:0/120165455 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ffa5002d770 con 0x7ffa6007de10 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 msgr2=0x7ffa4403b610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 0x7ffa4403b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 msgr2=0x7ffa6019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa500117e0 tx=0x7ffa50011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 shutdown_connections 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7ffa44039150 0x7ffa4403b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 --2- 172.21.15.31:0/120165455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa6007de10 0x7ffa6019e020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 >> 172.21.15.31:0/120165455 conn(0x7ffa60103600 msgr2=0x7ffa60104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 shutdown_connections 2024-06-02T22:22:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:47.431+0000 7ffa66e00700 1 -- 172.21.15.31:0/120165455 wait complete. 2024-06-02T22:22:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for the mgr to restart... 2024-06-02T22:22:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:Waiting for mgr epoch 9... 2024-06-02T22:22:48.762 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:48.483+0000 7fa88a9a5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:22:48.762 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:48.612+0000 7fa88a9a5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:22:49.120 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:48.874+0000 7fa88a9a5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:22:49.620 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:49 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:49.139+0000 7fa88a9a5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:22:50.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:49 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:49.962+0000 7fa88a9a5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:22:50.870 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:50 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:50.538+0000 7fa88a9a5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:22:50.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:50 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:50.673+0000 7fa88a9a5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:22:51.370 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:50 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:50.950+0000 7fa88a9a5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:22:52.097 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:51.627+0000 7fa88a9a5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:22:52.097 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:51.757+0000 7fa88a9a5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:22:52.097 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:52.096+0000 7fa88a9a5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:22:52.371 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:52.284+0000 7fa88a9a5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:22:52.762 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:52.416+0000 7fa88a9a5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:22:52.762 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:52.578+0000 7fa88a9a5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:22:53.082 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:52.960+0000 7fa88a9a5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:22:54.069 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:53.765+0000 7fa88a9a5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:22:54.370 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:22:54.068+0000 7fa88a9a5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: Active manager daemon x restarted 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: Activating manager daemon x 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: osdmap e3: 0 total, 0 up, 0 in 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: mgrmap e10: x(active, starting, since 0.00919557s) 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T22:22:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:54 smithi031 ceph-mon[31767]: Manager daemon x is now available 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:54] ENGINE Bus STARTING 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:54] ENGINE Serving on https://172.21.15.31:7150 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:54] ENGINE Serving on http://172.21.15.31:8765 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: [02/Jun/2024:22:22:54] ENGINE Bus STARTED 2024-06-02T22:22:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:55 smithi031 ceph-mon[31767]: mgrmap e11: x(active, since 1.01302s) 2024-06-02T22:22:55.833 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout { 2024-06-02T22:22:55.837 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-02T22:22:55.837 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T22:22:55.837 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout } 2024-06-02T22:22:55.837 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.761+0000 7f71e6200700 1 Processor -- start 2024-06-02T22:22:55.837 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.761+0000 7f71e6200700 1 -- start start 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.762+0000 7f71e6200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.762+0000 7f71e6200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0108930 con 0x7f71e0107fb0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.762+0000 7f71df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.762+0000 7f71df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47960/0 (socket says 172.21.15.31:47960) 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.762+0000 7f71df400700 1 -- 172.21.15.31:0/297800498 learned_addr learned my addr 172.21.15.31:0/297800498 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.763+0000 7f71df400700 1 -- 172.21.15.31:0/297800498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e01090f0 con 0x7f71e0107fb0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.763+0000 7f71df400700 1 --2- 172.21.15.31:0/297800498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71d00098a0 tx=0x7f71d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b73be2f09c9612c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.764+0000 7f71de000700 1 -- 172.21.15.31:0/297800498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71d0004160 con 0x7f71e0107fb0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.764+0000 7f71de000700 1 -- 172.21.15.31:0/297800498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d0004300 con 0x7f71e0107fb0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.764+0000 7f71de000700 1 -- 172.21.15.31:0/297800498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71d0011b20 con 0x7f71e0107fb0 2024-06-02T22:22:55.838 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.764+0000 7f71e6200700 1 -- 172.21.15.31:0/297800498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 msgr2=0x7f71e01083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.764+0000 7f71e6200700 1 --2- 172.21.15.31:0/297800498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71d00098a0 tx=0x7f71d0009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.765+0000 7f71e6200700 1 -- 172.21.15.31:0/297800498 shutdown_connections 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.765+0000 7f71e6200700 1 --2- 172.21.15.31:0/297800498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e01083f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.765+0000 7f71e6200700 1 -- 172.21.15.31:0/297800498 >> 172.21.15.31:0/297800498 conn(0x7f71e0103600 msgr2=0x7f71e0105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.765+0000 7f71e6200700 1 -- 172.21.15.31:0/297800498 shutdown_connections 2024-06-02T22:22:55.839 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.765+0000 7f71e6200700 1 -- 172.21.15.31:0/297800498 wait complete. 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.766+0000 7f71e6200700 1 Processor -- start 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.766+0000 7f71e6200700 1 -- start start 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.766+0000 7f71e6200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.766+0000 7f71e6200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71e010c3b0 con 0x7f71e0107fb0 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.767+0000 7f71df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.767+0000 7f71df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47966/0 (socket says 172.21.15.31:47966) 2024-06-02T22:22:55.840 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.767+0000 7f71df400700 1 -- 172.21.15.31:0/1471194079 learned_addr learned my addr 172.21.15.31:0/1471194079 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:55.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.767+0000 7f71df400700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e007e070 con 0x7f71e0107fb0 2024-06-02T22:22:55.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.767+0000 7f71df400700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71d00117e0 tx=0x7f71d0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:55.845 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.768+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71d0003bf0 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.768+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71d001a910 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.768+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e007c2b0 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.768+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71d0024970 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.768+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e007c710 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.769+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f71d0022020 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.770+0000 7f71d7e00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.770+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f71c403bc70 con 0x7f71c40390a0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.770+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f71d004da40 con 0x7f71e0107fb0 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.770+0000 7f71dea00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.770+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.971+0000 7f71dea00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:55.846 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:48.971+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:49.372+0000 7f71dea00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:49.372+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:50.173+0000 7f71dea00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:50.173+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:51.775+0000 7f71dea00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.31:6800/4252327404 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:51.775+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:54.079+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f71d001ab30 con 0x7f71e0107fb0 2024-06-02T22:22:55.847 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:54.079+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 msgr2=0x7f71c403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:54.079+0000 7f71d7e00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.081+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f71d002d3f0 con 0x7f71e0107fb0 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.081+0000 7f71d7e00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 0x7f71c403ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.081+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f71d0027e50 con 0x7f71c403cb60 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.082+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 0x7f71c403ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.083+0000 7f71dea00700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 0x7f71c403ef50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f71cc003a10 tx=0x7f71cc0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.085+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f71d0027e50 con 0x7f71c403cb60 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.093+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f71e010c530 con 0x7f71c403cb60 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.093+0000 7f71d7e00700 1 -- 172.21.15.31:0/1471194079 <== mgr.14152 v2:172.21.15.31:6800/784266653 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f71e010c530 con 0x7f71c403cb60 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 msgr2=0x7f71c403ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 0x7f71c403ef50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f71cc003a10 tx=0x7f71cc0092b0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 msgr2=0x7f71e007db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:55.848 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71d00117e0 tx=0x7f71d0011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 shutdown_connections 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71c403cb60 0x7f71c403ef50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e0107fb0 0x7f71e007db30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 --2- 172.21.15.31:0/1471194079 >> [v2:172.21.15.31:6800/4252327404,v1:172.21.15.31:6801/4252327404] conn(0x7f71c40390a0 0x7f71c403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 >> 172.21.15.31:0/1471194079 conn(0x7f71e0103600 msgr2=0x7f71e0104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 shutdown_connections 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:55.094+0000 7f71e6200700 1 -- 172.21.15.31:0/1471194079 wait complete. 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:mgr epoch 9 is available 2024-06-02T22:22:55.849 INFO:teuthology.orchestra.run.smithi031.stdout:Generating a dashboard self-signed certificate... 2024-06-02T22:22:56.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:56 smithi031 ceph-mon[31767]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T22:22:56.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:56 smithi031 ceph-mon[31767]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T22:22:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:57 smithi031 ceph-mon[31767]: mgrmap e12: x(active, since 2s) 2024-06-02T22:22:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:57 smithi031 ceph-mon[31767]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:22:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:22:57.797 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.593+0000 7f80f5c00700 1 Processor -- start 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.593+0000 7f80f5c00700 1 -- start start 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.593+0000 7f80f5c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.593+0000 7f80f5c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f80f007c700 con 0x7f80f0108a30 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.594+0000 7f80eea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.594+0000 7f80eea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52842/0 (socket says 172.21.15.31:52842) 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.594+0000 7f80eea00700 1 -- 172.21.15.31:0/939382775 learned_addr learned my addr 172.21.15.31:0/939382775 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.594+0000 7f80eea00700 1 -- 172.21.15.31:0/939382775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f010b360 con 0x7f80f0108a30 2024-06-02T22:22:57.799 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.595+0000 7f80eea00700 1 --2- 172.21.15.31:0/939382775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e00098a0 tx=0x7f80e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336eb48a8463c797 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:57.800 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.595+0000 7f80ed600700 1 -- 172.21.15.31:0/939382775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e0004160 con 0x7f80f0108a30 2024-06-02T22:22:57.800 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.595+0000 7f80ed600700 1 -- 172.21.15.31:0/939382775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e0004300 con 0x7f80f0108a30 2024-06-02T22:22:57.800 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.595+0000 7f80ed600700 1 -- 172.21.15.31:0/939382775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e0011b20 con 0x7f80f0108a30 2024-06-02T22:22:57.800 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 -- 172.21.15.31:0/939382775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 msgr2=0x7f80f010ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:57.800 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 --2- 172.21.15.31:0/939382775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80e00098a0 tx=0x7f80e0009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:57.801 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 -- 172.21.15.31:0/939382775 shutdown_connections 2024-06-02T22:22:57.801 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 --2- 172.21.15.31:0/939382775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f010ae20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:57.801 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 -- 172.21.15.31:0/939382775 >> 172.21.15.31:0/939382775 conn(0x7f80f01024a0 msgr2=0x7f80f01048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:57.801 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 -- 172.21.15.31:0/939382775 shutdown_connections 2024-06-02T22:22:57.801 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.596+0000 7f80f5c00700 1 -- 172.21.15.31:0/939382775 wait complete. 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.597+0000 7f80f5c00700 1 Processor -- start 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.597+0000 7f80f5c00700 1 -- start start 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.597+0000 7f80f5c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.597+0000 7f80f5c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f80f010c3c0 con 0x7f80f0108a30 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.598+0000 7f80eea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.598+0000 7f80eea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52848/0 (socket says 172.21.15.31:52848) 2024-06-02T22:22:57.803 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.598+0000 7f80eea00700 1 -- 172.21.15.31:0/169870585 learned_addr learned my addr 172.21.15.31:0/169870585 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:57.805 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.598+0000 7f80eea00700 1 -- 172.21.15.31:0/169870585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f019c380 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.598+0000 7f80eea00700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80e00117e0 tx=0x7f80e0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.599+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e0003ba0 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.599+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e001a910 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.599+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e00248f0 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.599+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f019c610 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.599+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f019ca70 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.600+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f80e0022020 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.600+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f0063af0 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.600+0000 7f80e7400700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 0x7f80d403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.600+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f80e004d5d0 con 0x7f80f0108a30 2024-06-02T22:22:57.806 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.601+0000 7f80ee000700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 0x7f80d403b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.602+0000 7f80ee000700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 0x7f80d403b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.607+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f80e001ab70 con 0x7f80f0108a30 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:56.845+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f80f0103600 con 0x7f80d4039100 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.051+0000 7f80e7400700 1 -- 172.21.15.31:0/169870585 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f80f0103600 con 0x7f80d4039100 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 msgr2=0x7f80d403b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 0x7f80d403b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80dc006fd0 tx=0x7f80dc006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:57.807 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 msgr2=0x7f80f019be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f80e00117e0 tx=0x7f80e0011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 shutdown_connections 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f80d4039100 0x7f80d403b5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 --2- 172.21.15.31:0/169870585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80f0108a30 0x7f80f019be40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.055+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 >> 172.21.15.31:0/169870585 conn(0x7f80f01024a0 msgr2=0x7f80f0102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.056+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 shutdown_connections 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:57.056+0000 7f80f5c00700 1 -- 172.21.15.31:0/169870585 wait complete. 2024-06-02T22:22:57.808 INFO:teuthology.orchestra.run.smithi031.stdout:Creating initial admin user... 2024-06-02T22:22:58.462 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:22:59.328 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:59 smithi031 ceph-mon[31767]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:22:59.328 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:22:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:22:59.690 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aiPBLyJ13e4Zyv.7DNPXe./4RY76oE0LxSMTv/OzS0ojz3IGVjsaG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717366978, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.461+0000 7f17ba400700 1 Processor -- start 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.462+0000 7f17ba400700 1 -- start start 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.462+0000 7f17ba400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.462+0000 7f17ba400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17b4108920 con 0x7f17b4107fc0 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.463+0000 7f17b3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.463+0000 7f17b3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52854/0 (socket says 172.21.15.31:52854) 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.463+0000 7f17b3400700 1 -- 172.21.15.31:0/1022052227 learned_addr learned my addr 172.21.15.31:0/1022052227 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.463+0000 7f17b3400700 1 -- 172.21.15.31:0/1022052227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b4109080 con 0x7f17b4107fc0 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.463+0000 7f17b3400700 1 --2- 172.21.15.31:0/1022052227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a40098a0 tx=0x7f17a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e516a81ad44076 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.464+0000 7f17b2000700 1 -- 172.21.15.31:0/1022052227 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4004160 con 0x7f17b4107fc0 2024-06-02T22:22:59.691 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.464+0000 7f17b2000700 1 -- 172.21.15.31:0/1022052227 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a4004300 con 0x7f17b4107fc0 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.464+0000 7f17b2000700 1 -- 172.21.15.31:0/1022052227 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4011b20 con 0x7f17b4107fc0 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 -- 172.21.15.31:0/1022052227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 msgr2=0x7f17b41083e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 --2- 172.21.15.31:0/1022052227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17a40098a0 tx=0x7f17a4009bb0 comp rx=0 tx=0).stop 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 -- 172.21.15.31:0/1022052227 shutdown_connections 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 --2- 172.21.15.31:0/1022052227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b41083e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 -- 172.21.15.31:0/1022052227 >> 172.21.15.31:0/1022052227 conn(0x7f17b4103600 msgr2=0x7f17b4105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 -- 172.21.15.31:0/1022052227 shutdown_connections 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.465+0000 7f17ba400700 1 -- 172.21.15.31:0/1022052227 wait complete. 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.466+0000 7f17ba400700 1 Processor -- start 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.466+0000 7f17ba400700 1 -- start start 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17ba400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17ba400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17b410c4c0 con 0x7f17b4107fc0 2024-06-02T22:22:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17b3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17b3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52856/0 (socket says 172.21.15.31:52856) 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17b3400700 1 -- 172.21.15.31:0/3182653111 learned_addr learned my addr 172.21.15.31:0/3182653111 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.467+0000 7f17b3400700 1 -- 172.21.15.31:0/3182653111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b419e540 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17b3400700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17a40117e0 tx=0x7f17a4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4003ba0 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a401a910 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a40248f0 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b419e7d0 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.468+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b419ec30 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.469+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f17a4022020 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.469+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b4063af0 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.470+0000 7f17abe00700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 0x7f179803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.470+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f17a404d690 con 0x7f17b4107fc0 2024-06-02T22:22:59.693 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.470+0000 7f17b2a00700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 0x7f179803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.471+0000 7f17b2a00700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 0x7f179803b610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006fd0 tx=0x7f17a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.476+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f17a401ab70 con 0x7f17b4107fc0 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.729+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f17b41a1640 con 0x7f1798039150 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.987+0000 7f17abe00700 1 -- 172.21.15.31:0/3182653111 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f17b41a1640 con 0x7f1798039150 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.990+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 msgr2=0x7f179803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.990+0000 7f17ba400700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 0x7f179803b610 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006fd0 tx=0x7f17a0006e40 comp rx=0 tx=0).stop 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.990+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 msgr2=0x7f17b419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.990+0000 7f17ba400700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17a40117e0 tx=0x7f17a4011ba0 comp rx=0 tx=0).stop 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 shutdown_connections 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1798039150 0x7f179803b610 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 --2- 172.21.15.31:0/3182653111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17b4107fc0 0x7f17b419e000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 >> 172.21.15.31:0/3182653111 conn(0x7f17b4103600 msgr2=0x7f17b4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:22:59.694 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 shutdown_connections 2024-06-02T22:22:59.695 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:22:58.991+0000 7f17ba400700 1 -- 172.21.15.31:0/3182653111 wait complete. 2024-06-02T22:22:59.695 INFO:teuthology.orchestra.run.smithi031.stdout:Fetching dashboard port number... 2024-06-02T22:23:00.539 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:00 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:01.745 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:01 smithi031 ceph-mon[31767]: mgrmap e13: x(active, since 6s) 2024-06-02T22:23:01.745 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:01 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1784501978' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-02T22:23:02.280 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stdout 8443 2024-06-02T22:23:02.281 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.281+0000 7f3856e00700 1 Processor -- start 2024-06-02T22:23:02.281 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.281+0000 7f3856e00700 1 -- start start 2024-06-02T22:23:02.281 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.282+0000 7f3856e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:02.281 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.282+0000 7f3856e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3850108930 con 0x7f3850107fb0 2024-06-02T22:23:02.282 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.282+0000 7f384fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.282+0000 7f384fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52860/0 (socket says 172.21.15.31:52860) 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.282+0000 7f384fe00700 1 -- 172.21.15.31:0/738047032 learned_addr learned my addr 172.21.15.31:0/738047032 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.283+0000 7f384fe00700 1 -- 172.21.15.31:0/738047032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38501090f0 con 0x7f3850107fb0 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.283+0000 7f384fe00700 1 --2- 172.21.15.31:0/738047032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38400098a0 tx=0x7f3840009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d205cc62ad46e3e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.283+0000 7f384f400700 1 -- 172.21.15.31:0/738047032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3840004160 con 0x7f3850107fb0 2024-06-02T22:23:02.283 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f384f400700 1 -- 172.21.15.31:0/738047032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3840004300 con 0x7f3850107fb0 2024-06-02T22:23:02.285 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f384f400700 1 -- 172.21.15.31:0/738047032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3840011b20 con 0x7f3850107fb0 2024-06-02T22:23:02.285 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f3856e00700 1 -- 172.21.15.31:0/738047032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 msgr2=0x7f38501083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:02.285 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f3856e00700 1 --2- 172.21.15.31:0/738047032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38400098a0 tx=0x7f3840009bb0 comp rx=0 tx=0).stop 2024-06-02T22:23:02.285 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f3856e00700 1 -- 172.21.15.31:0/738047032 shutdown_connections 2024-06-02T22:23:02.285 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f3856e00700 1 --2- 172.21.15.31:0/738047032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f38501083f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.284+0000 7f3856e00700 1 -- 172.21.15.31:0/738047032 >> 172.21.15.31:0/738047032 conn(0x7f3850103600 msgr2=0x7f3850105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.285+0000 7f3856e00700 1 -- 172.21.15.31:0/738047032 shutdown_connections 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.285+0000 7f3856e00700 1 -- 172.21.15.31:0/738047032 wait complete. 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f3856e00700 1 Processor -- start 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f3856e00700 1 -- start start 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f3856e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f3856e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f385010c3b0 con 0x7f3850107fb0 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f384fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f384fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52862/0 (socket says 172.21.15.31:52862) 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.286+0000 7f384fe00700 1 -- 172.21.15.31:0/1784501978 learned_addr learned my addr 172.21.15.31:0/1784501978 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f384fe00700 1 -- 172.21.15.31:0/1784501978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385019e5d0 con 0x7f3850107fb0 2024-06-02T22:23:02.286 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f384fe00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38400117e0 tx=0x7f3840011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:02.287 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3840003bf0 con 0x7f3850107fb0 2024-06-02T22:23:02.288 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f384001a910 con 0x7f3850107fb0 2024-06-02T22:23:02.288 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385019e860 con 0x7f3850107fb0 2024-06-02T22:23:02.288 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.287+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3840024970 con 0x7f3850107fb0 2024-06-02T22:23:02.288 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.288+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385019ecc0 con 0x7f3850107fb0 2024-06-02T22:23:02.288 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.289+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f3840022020 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.289+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3850063af0 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.289+0000 7f384d600700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 0x7f383403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.289+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f384004d920 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.290+0000 7f3847e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 0x7f383403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.290+0000 7f3847e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 0x7f383403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3838006fd0 tx=0x7f3838006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.295+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f38400212c0 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.538+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f38501a1690 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.538+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f384002d3f0 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.542+0000 7f384d600700 1 -- 172.21.15.31:0/1784501978 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f384000f6e0 con 0x7f3850107fb0 2024-06-02T22:23:02.289 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 msgr2=0x7f383403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 0x7f383403b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3838006fd0 tx=0x7f3838006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 msgr2=0x7f385019e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38400117e0 tx=0x7f3840011ba0 comp rx=0 tx=0).stop 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 shutdown_connections 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38340390a0 0x7f383403b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 --2- 172.21.15.31:0/1784501978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3850107fb0 0x7f385019e090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 >> 172.21.15.31:0/1784501978 conn(0x7f3850103600 msgr2=0x7f38501040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 shutdown_connections 2024-06-02T22:23:02.290 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:00.545+0000 7f3856e00700 1 -- 172.21.15.31:0/1784501978 wait complete. 2024-06-02T22:23:02.327 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T22:23:02.327 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout disabled 2024-06-02T22:23:02.354 INFO:teuthology.orchestra.run.smithi031.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T22:23:02.354 INFO:teuthology.orchestra.run.smithi031.stdout:systemctl: stdout inactive 2024-06-02T22:23:02.354 INFO:teuthology.orchestra.run.smithi031.stdout:firewalld.service is not enabled 2024-06-02T22:23:02.354 INFO:teuthology.orchestra.run.smithi031.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout:Ceph Dashboard is now available at: 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout: URL: https://smithi031.front.sepia.ceph.com:8443/ 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout: User: admin 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout: Password: tk9dkttajn 2024-06-02T22:23:02.360 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:02.361 INFO:teuthology.orchestra.run.smithi031.stdout:Saving cluster configuration to /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config directory 2024-06-02T22:23:02.362 INFO:teuthology.orchestra.run.smithi031.stdout:Enabling autotune for osd_memory_target 2024-06-02T22:23:03.961 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.989+0000 7f01e3600700 1 Processor -- start 2024-06-02T22:23:03.962 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.989+0000 7f01e3600700 1 -- start start 2024-06-02T22:23:03.962 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.989+0000 7f01e3600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:03.962 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.990+0000 7f01e3600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10abd0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.963 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.990+0000 7f01e0c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:03.963 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.990+0000 7f01e0c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60352/0 (socket says 172.21.15.31:60352) 2024-06-02T22:23:03.963 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.990+0000 7f01e0c00700 1 -- 172.21.15.31:0/1240830135 learned_addr learned my addr 172.21.15.31:0/1240830135 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:03.963 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.990+0000 7f01e0c00700 1 -- 172.21.15.31:0/1240830135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc10b3e0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.991+0000 7f01e0c00700 1 --2- 172.21.15.31:0/1240830135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098a0 tx=0x7f01d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff7d7c91111e5c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.991+0000 7f01db400700 1 -- 172.21.15.31:0/1240830135 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0004160 con 0x7f01dc10a1e0 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.991+0000 7f01db400700 1 -- 172.21.15.31:0/1240830135 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d0004300 con 0x7f01dc10a1e0 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.991+0000 7f01db400700 1 -- 172.21.15.31:0/1240830135 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0011b20 con 0x7f01dc10a1e0 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 -- 172.21.15.31:0/1240830135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 msgr2=0x7f01dc10a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 --2- 172.21.15.31:0/1240830135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f01d00098a0 tx=0x7f01d0009bb0 comp rx=0 tx=0).stop 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 -- 172.21.15.31:0/1240830135 shutdown_connections 2024-06-02T22:23:03.964 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 --2- 172.21.15.31:0/1240830135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc10a600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:03.971 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 -- 172.21.15.31:0/1240830135 >> 172.21.15.31:0/1240830135 conn(0x7f01dc07d670 msgr2=0x7f01dc07daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:03.971 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 -- 172.21.15.31:0/1240830135 shutdown_connections 2024-06-02T22:23:03.971 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.992+0000 7f01e3600700 1 -- 172.21.15.31:0/1240830135 wait complete. 2024-06-02T22:23:03.971 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.993+0000 7f01e3600700 1 Processor -- start 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.993+0000 7f01e3600700 1 -- start start 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e3600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e3600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc10e790 con 0x7f01dc10a1e0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e0c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e0c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60364/0 (socket says 172.21.15.31:60364) 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e0c00700 1 -- 172.21.15.31:0/1314048989 learned_addr learned my addr 172.21.15.31:0/1314048989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.994+0000 7f01e0c00700 1 -- 172.21.15.31:0/1314048989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc19e5e0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01e0c00700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01d0011b60 tx=0x7f01d0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0003b60 con 0x7f01dc10a1e0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d001a910 con 0x7f01dc10a1e0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d0024930 con 0x7f01dc10a1e0 2024-06-02T22:23:03.972 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc19e870 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.995+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc19ecd0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.996+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f01d0022020 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.996+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc063af0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.997+0000 7f01d9600700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 0x7f01c403b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.997+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f01d004d500 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.997+0000 7f01dbe00700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 0x7f01c403b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:02.998+0000 7f01dbe00700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 0x7f01c403b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006fd0 tx=0x7f01c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.002+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f01d000b3e0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.236+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f01dc1a1760 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.237+0000 7f01d9600700 1 -- 172.21.15.31:0/1314048989 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f01d002dde0 con 0x7f01dc10a1e0 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 msgr2=0x7f01c403b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:03.973 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 0x7f01c403b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f01c8006fd0 tx=0x7f01c8006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 msgr2=0x7f01dc19e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01d0011b60 tx=0x7f01d0011c40 comp rx=0 tx=0).stop 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 shutdown_connections 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01c40391a0 0x7f01c403b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 --2- 172.21.15.31:0/1314048989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01dc10a1e0 0x7f01dc19e0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 >> 172.21.15.31:0/1314048989 conn(0x7f01dc07d670 msgr2=0x7f01dc107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.240+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 shutdown_connections 2024-06-02T22:23:03.974 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:03.241+0000 7f01e3600700 1 -- 172.21.15.31:0/1314048989 wait complete. 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.622+0000 7f41f9a00700 1 Processor -- start 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.622+0000 7f41f9a00700 1 -- start start 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.623+0000 7f41f9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.623+0000 7f41f9a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f41f407be00 con 0x7f41f4108900 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.623+0000 7f41f3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.623+0000 7f41f3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60370/0 (socket says 172.21.15.31:60370) 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.623+0000 7f41f3e00700 1 -- 172.21.15.31:0/3391180520 learned_addr learned my addr 172.21.15.31:0/3391180520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.624+0000 7f41f3e00700 1 -- 172.21.15.31:0/3391180520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f410b230 con 0x7f41f4108900 2024-06-02T22:23:05.739 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.624+0000 7f41f3e00700 1 --2- 172.21.15.31:0/3391180520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e40098a0 tx=0x7f41e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36392cefee86884b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:05.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.624+0000 7f41f2a00700 1 -- 172.21.15.31:0/3391180520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e4004160 con 0x7f41f4108900 2024-06-02T22:23:05.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.624+0000 7f41f2a00700 1 -- 172.21.15.31:0/3391180520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41e4004300 con 0x7f41f4108900 2024-06-02T22:23:05.740 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.624+0000 7f41f2a00700 1 -- 172.21.15.31:0/3391180520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e4011b20 con 0x7f41f4108900 2024-06-02T22:23:05.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 -- 172.21.15.31:0/3391180520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 msgr2=0x7f41f410acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:05.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 --2- 172.21.15.31:0/3391180520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41e40098a0 tx=0x7f41e4009bb0 comp rx=0 tx=0).stop 2024-06-02T22:23:05.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 -- 172.21.15.31:0/3391180520 shutdown_connections 2024-06-02T22:23:05.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 --2- 172.21.15.31:0/3391180520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f410acf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:05.742 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 -- 172.21.15.31:0/3391180520 >> 172.21.15.31:0/3391180520 conn(0x7f41f41022d0 msgr2=0x7f41f41046f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 -- 172.21.15.31:0/3391180520 shutdown_connections 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.625+0000 7f41f9a00700 1 -- 172.21.15.31:0/3391180520 wait complete. 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.626+0000 7f41f9a00700 1 Processor -- start 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f9a00700 1 -- start start 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f9a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f41f410c1e0 con 0x7f41f4108900 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60386/0 (socket says 172.21.15.31:60386) 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.627+0000 7f41f3e00700 1 -- 172.21.15.31:0/4133712056 learned_addr learned my addr 172.21.15.31:0/4133712056 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f3e00700 1 -- 172.21.15.31:0/4133712056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f419c210 con 0x7f41f4108900 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f3e00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41e40117e0 tx=0x7f41e4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e4003ba0 con 0x7f41f4108900 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41e401a910 con 0x7f41f4108900 2024-06-02T22:23:05.743 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f419c4a0 con 0x7f41f4108900 2024-06-02T22:23:05.744 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41e40248f0 con 0x7f41f4108900 2024-06-02T22:23:05.744 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.628+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f419c900 con 0x7f41f4108900 2024-06-02T22:23:05.744 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.629+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f4063af0 con 0x7f41f4108900 2024-06-02T22:23:05.744 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.630+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f41e4022020 con 0x7f41f4108900 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.630+0000 7f41f0c00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 0x7f41d803b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.630+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f41e404d740 con 0x7f41f4108900 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.630+0000 7f41f3400700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 0x7f41d803b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.631+0000 7f41f3400700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 0x7f41d803b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006fd0 tx=0x7f41e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.635+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f41e401ab70 con 0x7f41f4108900 2024-06-02T22:23:05.746 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.979+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f41f419f420 con 0x7f41f4108900 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.984+0000 7f41f0c00700 1 -- 172.21.15.31:0/4133712056 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f41e40212c0 con 0x7f41f4108900 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 msgr2=0x7f41d803b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 0x7f41d803b660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006fd0 tx=0x7f41e0006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 msgr2=0x7f41f419bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41e40117e0 tx=0x7f41e4011ba0 comp rx=0 tx=0).stop 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 shutdown_connections 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41d80391a0 0x7f41d803b660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 --2- 172.21.15.31:0/4133712056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41f4108900 0x7f41f419bcd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 >> 172.21.15.31:0/4133712056 conn(0x7f41f41022d0 msgr2=0x7f41f4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.987+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 shutdown_connections 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr 2024-06-02T22:23:04.988+0000 7f41f9a00700 1 -- 172.21.15.31:0/4133712056 wait complete. 2024-06-02T22:23:05.747 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout:Or, if you are only running a single cluster on this host: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: ceph telemetry on 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout:For more information see: 2024-06-02T22:23:05.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.749 INFO:teuthology.orchestra.run.smithi031.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-02T22:23:05.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:05.749 INFO:teuthology.orchestra.run.smithi031.stdout:Bootstrap complete. 2024-06-02T22:23:05.873 INFO:tasks.cephadm:Fetching config... 2024-06-02T22:23:05.873 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:23:05.874 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-02T22:23:05.962 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-02T22:23:05.963 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:23:05.963 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-02T22:23:06.052 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-02T22:23:06.053 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:23:06.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-02T22:23:06.186 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-02T22:23:06.187 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:23:06.187 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-02T22:23:06.240 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-02T22:23:06.240 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T22:23:06.314 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:05 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/4133712056' entity='client.admin' 2024-06-02T22:23:06.360 INFO:teuthology.orchestra.run.smithi031.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:06.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T22:23:06.433 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:06.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T22:23:06.486 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCs8Q6he/zk2O9Jhy9zWf2EnxAWBI9ZpwfpetVrikhxRZABnSrXiOsH5GiCpOraXwcv5Nl5Vj5aVKyQxBpy8Ftdgu2tBDtLXKEvHxX1sDFqWoN7filKj9l4GZsZmSG0ZTwXZJURcSdOVubSkJNsKnYyLURbokXFM7I0SFtSS5q/gSo2mj0R951I/Z+uZwzB30g+gnb/EQVf/cChdWbLKN7jrA75bRUiAok9cPQryjw4liDBIvDw48FUYwi3l0d1o83Qft5vg7GNluV3XWXHTPBtTKPFnO0+2URi8RS13VRL9idUrrU/zoadRgDR2P1+bqMhZeYpcDFcsyzXR/ck2iUZuP891OYiSbZGdAcFkcbEqXiP9eQMP+qaW8eIciH6PUo0FNTGE9tzdsKmmnR+uNMMetm/xx+YVubCrcoR0sO7VKvJrkpOPgle2CZj33evqt1JI4+etVJKyjVhHdlSkx+/4o2y6qa7c8qJ6shJLLp35KcM26KwFwHitK/m0asPgRE= ceph-52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:06.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-02T22:23:06.935 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:09.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 -- 172.21.15.31:0/3413110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 msgr2=0x7f91f8104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:09.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 --2- 172.21.15.31:0/3413110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8104d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009910 tx=0x7f91ec009c20 comp rx=0 tx=0).stop 2024-06-02T22:23:09.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 -- 172.21.15.31:0/3413110 shutdown_connections 2024-06-02T22:23:09.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 --2- 172.21.15.31:0/3413110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8104d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:09.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 -- 172.21.15.31:0/3413110 >> 172.21.15.31:0/3413110 conn(0x7f91f80fc390 msgr2=0x7f91f80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:09.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.676+0000 7f9200800700 1 -- 172.21.15.31:0/3413110 shutdown_connections 2024-06-02T22:23:09.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.677+0000 7f9200800700 1 -- 172.21.15.31:0/3413110 wait complete. 2024-06-02T22:23:09.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.678+0000 7f9200800700 1 Processor -- start 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.678+0000 7f9200800700 1 -- start start 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f9200800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f9200800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f91f8107f20 con 0x7f91f8102980 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f91fde00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f91fde00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60406/0 (socket says 172.21.15.31:60406) 2024-06-02T22:23:09.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f91fde00700 1 -- 172.21.15.31:0/1224122481 learned_addr learned my addr 172.21.15.31:0/1224122481 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:09.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.679+0000 7f91fde00700 1 -- 172.21.15.31:0/1224122481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f8199c90 con 0x7f91f8102980 2024-06-02T22:23:09.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f91fde00700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004fa0 tx=0x7f91ec005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:09.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec027070 con 0x7f91f8102980 2024-06-02T22:23:09.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91ec00be40 con 0x7f91f8102980 2024-06-02T22:23:09.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec00f460 con 0x7f91f8102980 2024-06-02T22:23:09.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f8199f80 con 0x7f91f8102980 2024-06-02T22:23:09.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.680+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f819cc10 con 0x7f91f8102980 2024-06-02T22:23:09.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.682+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f91ec02a070 con 0x7f91f8102980 2024-06-02T22:23:09.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.682+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91f81086a0 con 0x7f91f8102980 2024-06-02T22:23:09.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.682+0000 7f91f2a00700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 0x7f91e003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:09.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.682+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f91ec01e030 con 0x7f91f8102980 2024-06-02T22:23:09.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.683+0000 7f91fd400700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 0x7f91e003b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:09.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.684+0000 7f91fd400700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 0x7f91e003b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:09.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.689+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f91ec013070 con 0x7f91f8102980 2024-06-02T22:23:09.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.923+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f91f802dde0 con 0x7f91f8102980 2024-06-02T22:23:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.927+0000 7f91f2a00700 1 -- 172.21.15.31:0/1224122481 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f91ec022830 con 0x7f91f8102980 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 msgr2=0x7f91e003b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 0x7f91e003b610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f91e8006fd0 tx=0x7f91e8006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 msgr2=0x7f91f8199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004fa0 tx=0x7f91ec005080 comp rx=0 tx=0).stop 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 shutdown_connections 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f91e0039150 0x7f91e003b610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 --2- 172.21.15.31:0/1224122481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91f8102980 0x7f91f8199750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:09.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.930+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 >> 172.21.15.31:0/1224122481 conn(0x7f91f80fc390 msgr2=0x7f91f80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.931+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 shutdown_connections 2024-06-02T22:23:09.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:09.931+0000 7f9200800700 1 -- 172.21.15.31:0/1224122481 wait complete. 2024-06-02T22:23:10.931 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-02T22:23:10.932 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-02T22:23:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:10 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1224122481' entity='client.admin' 2024-06-02T22:23:11.364 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:13.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 -- 172.21.15.31:0/2398934032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 msgr2=0x7ff988104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 --2- 172.21.15.31:0/2398934032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988104560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff978009910 tx=0x7ff978009c20 comp rx=0 tx=0).stop 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 -- 172.21.15.31:0/2398934032 shutdown_connections 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 --2- 172.21.15.31:0/2398934032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988104560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 -- 172.21.15.31:0/2398934032 >> 172.21.15.31:0/2398934032 conn(0x7ff9880ff6c0 msgr2=0x7ff988101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 -- 172.21.15.31:0/2398934032 shutdown_connections 2024-06-02T22:23:13.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.765+0000 7ff98d800700 1 -- 172.21.15.31:0/2398934032 wait complete. 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.766+0000 7ff98d800700 1 Processor -- start 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.766+0000 7ff98d800700 1 -- start start 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.767+0000 7ff98d800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.767+0000 7ff98d800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff98810a1d0 con 0x7ff988104140 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.767+0000 7ff986a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:13.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.767+0000 7ff986a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54706/0 (socket says 172.21.15.31:54706) 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.767+0000 7ff986a00700 1 -- 172.21.15.31:0/3522642462 learned_addr learned my addr 172.21.15.31:0/3522642462 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff986a00700 1 -- 172.21.15.31:0/3522642462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff988199d50 con 0x7ff988104140 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff986a00700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff978027070 con 0x7ff988104140 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff97800be40 con 0x7ff988104140 2024-06-02T22:23:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff97800f460 con 0x7ff988104140 2024-06-02T22:23:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff988199fe0 con 0x7ff988104140 2024-06-02T22:23:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.768+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98819ccd0 con 0x7ff988104140 2024-06-02T22:23:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.770+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff97802a070 con 0x7ff988104140 2024-06-02T22:23:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.770+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98810a950 con 0x7ff988104140 2024-06-02T22:23:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.770+0000 7ff97f400700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 0x7ff96c03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.770+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff97801e030 con 0x7ff988104140 2024-06-02T22:23:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.770+0000 7ff986000700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 0x7ff96c03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.771+0000 7ff986000700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 0x7ff96c03b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff974006fd0 tx=0x7ff974006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:13.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:13.776+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff978013070 con 0x7ff988104140 2024-06-02T22:23:14.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.014+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7ff98802ddb0 con 0x7ff96c0390f0 2024-06-02T22:23:14.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.020+0000 7ff97f400700 1 -- 172.21.15.31:0/3522642462 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff98802ddb0 con 0x7ff96c0390f0 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.023+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 msgr2=0x7ff96c03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.023+0000 7ff98d800700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 0x7ff96c03b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff974006fd0 tx=0x7ff974006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.023+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 msgr2=0x7ff988199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.023+0000 7ff98d800700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff978006010 tx=0x7ff978005050 comp rx=0 tx=0).stop 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 shutdown_connections 2024-06-02T22:23:14.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff96c0390f0 0x7ff96c03b5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:14.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 --2- 172.21.15.31:0/3522642462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff988104140 0x7ff988199810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:14.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 >> 172.21.15.31:0/3522642462 conn(0x7ff9880ff6c0 msgr2=0x7ff9881000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:14.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 shutdown_connections 2024-06-02T22:23:14.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:14.024+0000 7ff98d800700 1 -- 172.21.15.31:0/3522642462 wait complete. 2024-06-02T22:23:14.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi031", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:14.807 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-06-02T22:23:14.807 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:23:14.807 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-06-02T22:23:14.825 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:23:14.825 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:14.881 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-06-02T22:23:14.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch host add smithi098 2024-06-02T22:23:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:15.488 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:15 smithi031 ceph-mon[31767]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:15.488 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:15 smithi031 ceph-mon[31767]: Updating smithi031:/etc/ceph/ceph.conf 2024-06-02T22:23:15.488 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:15 smithi031 ceph-mon[31767]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:15.488 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:15 smithi031 ceph-mon[31767]: Updating smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:16.494 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:16 smithi031 ceph-mon[31767]: Updating smithi031:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 -- 172.21.15.31:0/621542946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 msgr2=0x7feea4104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 --2- 172.21.15.31:0/621542946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea4104700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee94009910 tx=0x7fee94009c20 comp rx=0 tx=0).stop 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 -- 172.21.15.31:0/621542946 shutdown_connections 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 --2- 172.21.15.31:0/621542946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea4104700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 -- 172.21.15.31:0/621542946 >> 172.21.15.31:0/621542946 conn(0x7feea40ffbb0 msgr2=0x7feea4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 -- 172.21.15.31:0/621542946 shutdown_connections 2024-06-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.391+0000 7feeaa200700 1 -- 172.21.15.31:0/621542946 wait complete. 2024-06-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.392+0000 7feeaa200700 1 Processor -- start 2024-06-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.392+0000 7feeaa200700 1 -- start start 2024-06-02T22:23:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feeaa200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feeaa200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feea410e6f0 con 0x7feea4104320 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feea3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feea3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54724/0 (socket says 172.21.15.31:54724) 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feea3400700 1 -- 172.21.15.31:0/316777363 learned_addr learned my addr 172.21.15.31:0/316777363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.393+0000 7feea3400700 1 -- 172.21.15.31:0/316777363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea419fd60 con 0x7feea4104320 2024-06-02T22:23:17.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7feea3400700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee94006010 tx=0x7fee94005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee94026070 con 0x7feea4104320 2024-06-02T22:23:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a0050 con 0x7feea4104320 2024-06-02T22:23:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41999e0 con 0x7feea4104320 2024-06-02T22:23:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee9400bbd0 con 0x7feea4104320 2024-06-02T22:23:17.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.394+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee94003910 con 0x7feea4104320 2024-06-02T22:23:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.395+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fee94029070 con 0x7feea4104320 2024-06-02T22:23:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.395+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee84005330 con 0x7feea4104320 2024-06-02T22:23:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.396+0000 7fee9be00700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 0x7fee8803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:17.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.396+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fee9401e070 con 0x7feea4104320 2024-06-02T22:23:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.396+0000 7feea2a00700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 0x7fee8803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:17.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.397+0000 7feea2a00700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 0x7fee8803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee90006fd0 tx=0x7fee90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:17.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.402+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fee94013070 con 0x7feea4104320 2024-06-02T22:23:17.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:17.635+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}) -- 0x7fee84000bc0 con 0x7fee88039150 2024-06-02T22:23:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:17 smithi031 ceph-mon[31767]: Updating smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:17 smithi031 ceph-mon[31767]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:17 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:18.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:17 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:18.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:17 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:19.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:18 smithi031 ceph-mon[31767]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:19 smithi031 ceph-mon[31767]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:19 smithi031 ceph-mon[31767]: Deploying cephadm binary to smithi098 2024-06-02T22:23:22.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:21 smithi031 ceph-mon[31767]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:22.761 INFO:teuthology.orchestra.run.smithi031.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-06-02T22:23:22.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.761+0000 7fee9be00700 1 -- 172.21.15.31:0/316777363 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fee84000bc0 con 0x7fee88039150 2024-06-02T22:23:22.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.764+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 msgr2=0x7fee8803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:22.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.764+0000 7feeaa200700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 0x7fee8803b610 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fee90006fd0 tx=0x7fee90006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:22.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.764+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 msgr2=0x7feea419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:22.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.764+0000 7feeaa200700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee94006010 tx=0x7fee94005030 comp rx=0 tx=0).stop 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 shutdown_connections 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee88039150 0x7fee8803b610 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 --2- 172.21.15.31:0/316777363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea4104320 0x7feea419f820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 >> 172.21.15.31:0/316777363 conn(0x7feea40ffbb0 msgr2=0x7feea4105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 shutdown_connections 2024-06-02T22:23:22.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:22.765+0000 7feeaa200700 1 -- 172.21.15.31:0/316777363 wait complete. 2024-06-02T22:23:23.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T22:23:24.020 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:23 smithi031 ceph-mon[31767]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:23 smithi031 ceph-mon[31767]: Added host smithi098 2024-06-02T22:23:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:25.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:24 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:25.911 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:25 smithi031 ceph-mon[31767]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:25.911 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.193+0000 7fafafc00700 1 -- 172.21.15.31:0/96975685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 msgr2=0x7fafa81024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.193+0000 7fafafc00700 1 --2- 172.21.15.31:0/96975685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa81024e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009910 tx=0x7faf9c009c20 comp rx=0 tx=0).stop 2024-06-02T22:23:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.193+0000 7fafafc00700 1 -- 172.21.15.31:0/96975685 shutdown_connections 2024-06-02T22:23:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.193+0000 7fafafc00700 1 --2- 172.21.15.31:0/96975685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa81024e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:26.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.193+0000 7fafafc00700 1 -- 172.21.15.31:0/96975685 >> 172.21.15.31:0/96975685 conn(0x7fafa80fd9d0 msgr2=0x7fafa80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.194+0000 7fafafc00700 1 -- 172.21.15.31:0/96975685 shutdown_connections 2024-06-02T22:23:26.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.194+0000 7fafafc00700 1 -- 172.21.15.31:0/96975685 wait complete. 2024-06-02T22:23:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.195+0000 7fafafc00700 1 Processor -- start 2024-06-02T22:23:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.195+0000 7fafafc00700 1 -- start start 2024-06-02T22:23:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.195+0000 7fafafc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:26.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.195+0000 7fafafc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fafa810c4d0 con 0x7fafa8102100 2024-06-02T22:23:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.196+0000 7fafad200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.196+0000 7fafad200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44008/0 (socket says 172.21.15.31:44008) 2024-06-02T22:23:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.196+0000 7fafad200700 1 -- 172.21.15.31:0/425842598 learned_addr learned my addr 172.21.15.31:0/425842598 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:26.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.196+0000 7fafad200700 1 -- 172.21.15.31:0/425842598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa8076680 con 0x7fafa8102100 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.196+0000 7fafad200700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf9c006010 tx=0x7faf9c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.197+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c026070 con 0x7fafa8102100 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.197+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf9c00bc30 con 0x7fafa8102100 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.197+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9c0039d0 con 0x7fafa8102100 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.197+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa8074d30 con 0x7fafa8102100 2024-06-02T22:23:26.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.197+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa80751f0 con 0x7fafa8102100 2024-06-02T22:23:26.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.198+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7faf9c029070 con 0x7fafa8102100 2024-06-02T22:23:26.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.198+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa81035e0 con 0x7fafa8102100 2024-06-02T22:23:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.199+0000 7fafa5600700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 0x7faf9003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.199+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faf9c01e070 con 0x7fafa8102100 2024-06-02T22:23:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.199+0000 7fafa7e00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 0x7faf9003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:26.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.200+0000 7fafa7e00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 0x7faf9003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf94006fd0 tx=0x7faf94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:26.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.204+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faf9c013070 con 0x7fafa8102100 2024-06-02T22:23:26.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.443+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafa8075480 con 0x7faf900390f0 2024-06-02T22:23:26.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.446+0000 7fafa5600700 1 -- 172.21.15.31:0/425842598 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fafa8075480 con 0x7faf900390f0 2024-06-02T22:23:26.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:26.446 INFO:teuthology.orchestra.run.smithi031.stdout:[{"addr": "172.21.15.31", "hostname": "smithi031", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-06-02T22:23:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 msgr2=0x7faf9003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 0x7faf9003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faf94006fd0 tx=0x7faf94006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 msgr2=0x7fafa8074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf9c006010 tx=0x7faf9c005030 comp rx=0 tx=0).stop 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 shutdown_connections 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faf900390f0 0x7faf9003b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 --2- 172.21.15.31:0/425842598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafa8102100 0x7fafa8074790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 >> 172.21.15.31:0/425842598 conn(0x7fafa80fd9d0 msgr2=0x7fafa8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 shutdown_connections 2024-06-02T22:23:26.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:26.450+0000 7fafafc00700 1 -- 172.21.15.31:0/425842598 wait complete. 2024-06-02T22:23:27.195 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2024-06-02T22:23:27.195 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:23:27.195 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2024-06-02T22:23:27.214 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:23:27.215 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:27.272 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2024-06-02T22:23:27.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch host add smithi178 2024-06-02T22:23:27.730 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:28.116 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:27 smithi031 ceph-mon[31767]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:28.116 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:27 smithi031 ceph-mon[31767]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:29.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.806+0000 7f6cbc400700 1 -- 172.21.15.31:0/725865070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 msgr2=0x7f6cb41033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.806+0000 7f6cbc400700 1 --2- 172.21.15.31:0/725865070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb41033f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800b0a0 tx=0x7f6ca800b3b0 comp rx=0 tx=0).stop 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.807+0000 7f6cbc400700 1 -- 172.21.15.31:0/725865070 shutdown_connections 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.807+0000 7f6cbc400700 1 --2- 172.21.15.31:0/725865070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb41033f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.807+0000 7f6cbc400700 1 -- 172.21.15.31:0/725865070 >> 172.21.15.31:0/725865070 conn(0x7f6cb40fc860 msgr2=0x7f6cb40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.807+0000 7f6cbc400700 1 -- 172.21.15.31:0/725865070 shutdown_connections 2024-06-02T22:23:29.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.807+0000 7f6cbc400700 1 -- 172.21.15.31:0/725865070 wait complete. 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.808+0000 7f6cbc400700 1 Processor -- start 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.808+0000 7f6cbc400700 1 -- start start 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.808+0000 7f6cbc400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cbc400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb410c500 con 0x7f6cb4103010 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cb9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cb9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44024/0 (socket says 172.21.15.31:44024) 2024-06-02T22:23:29.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cb9a00700 1 -- 172.21.15.31:0/616376022 learned_addr learned my addr 172.21.15.31:0/616376022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cb9a00700 1 -- 172.21.15.31:0/616376022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb419fd10 con 0x7f6cb4103010 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.809+0000 7f6cb9a00700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000f80 tx=0x7f6ca800bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.810+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8020020 con 0x7f6cb4103010 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.810+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca8018040 con 0x7f6cb4103010 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.810+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb419ffa0 con 0x7f6cb4103010 2024-06-02T22:23:29.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.810+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8017070 con 0x7f6cb4103010 2024-06-02T22:23:29.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.810+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb4199990 con 0x7f6cb4103010 2024-06-02T22:23:29.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.811+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6ca8023020 con 0x7f6cb4103010 2024-06-02T22:23:29.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.811+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb406ab80 con 0x7f6cb4103010 2024-06-02T22:23:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.812+0000 7f6cb2000700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 0x7f6c9c03b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.812+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6ca800f050 con 0x7f6cb4103010 2024-06-02T22:23:29.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.812+0000 7f6cb9000700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 0x7f6c9c03b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:29.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.813+0000 7f6cb9000700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 0x7f6c9c03b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006fd0 tx=0x7f6ca0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:29.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:29.817+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ca802a020 con 0x7f6cb4103010 2024-06-02T22:23:30.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:30.055+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}) -- 0x7f6cb419aec0 con 0x7f6c9c039190 2024-06-02T22:23:30.054 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:30.054 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:30.055 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:29 smithi031 ceph-mon[31767]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:31.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:31 smithi031 ceph-mon[31767]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:31 smithi031 ceph-mon[31767]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:31 smithi031 ceph-mon[31767]: Deploying cephadm binary to smithi178 2024-06-02T22:23:34.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:33 smithi031 ceph-mon[31767]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.972+0000 7f6cb2000700 1 -- 172.21.15.31:0/616376022 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6cb419aec0 con 0x7f6c9c039190 2024-06-02T22:23:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Added host 'smithi178' with addr '172.21.15.178' 2024-06-02T22:23:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 msgr2=0x7f6c9c03b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 0x7f6c9c03b650 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0006fd0 tx=0x7f6ca0006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 msgr2=0x7f6cb419f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:34.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8000f80 tx=0x7f6ca800bd20 comp rx=0 tx=0).stop 2024-06-02T22:23:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 shutdown_connections 2024-06-02T22:23:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6c9c039190 0x7f6c9c03b650 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 --2- 172.21.15.31:0/616376022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cb4103010 0x7f6cb419f7d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 >> 172.21.15.31:0/616376022 conn(0x7f6cb40fc860 msgr2=0x7f6cb41081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.976+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 shutdown_connections 2024-06-02T22:23:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:34.977+0000 7f6cbc400700 1 -- 172.21.15.31:0/616376022 wait complete. 2024-06-02T22:23:35.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T22:23:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:35 smithi031 ceph-mon[31767]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:36.130 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:36.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:36 smithi031 ceph-mon[31767]: Added host smithi178 2024-06-02T22:23:36.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:36 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:37.989 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:37 smithi031 ceph-mon[31767]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:37.990 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 -- 172.21.15.31:0/1223468557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 msgr2=0x7f556810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 --2- 172.21.15.31:0/1223468557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556810d8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f555c009910 tx=0x7f555c009c20 comp rx=0 tx=0).stop 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 -- 172.21.15.31:0/1223468557 shutdown_connections 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 --2- 172.21.15.31:0/1223468557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556810d8b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 -- 172.21.15.31:0/1223468557 >> 172.21.15.31:0/1223468557 conn(0x7f5568077c30 msgr2=0x7f556807a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.163+0000 7f5570000700 1 -- 172.21.15.31:0/1223468557 shutdown_connections 2024-06-02T22:23:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.164+0000 7f5570000700 1 -- 172.21.15.31:0/1223468557 wait complete. 2024-06-02T22:23:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.166+0000 7f5570000700 1 Processor -- start 2024-06-02T22:23:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.166+0000 7f5570000700 1 -- start start 2024-06-02T22:23:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.166+0000 7f5570000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.167+0000 7f5570000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5568112b40 con 0x7f556810d4d0 2024-06-02T22:23:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.167+0000 7f556d600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.167+0000 7f556d600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59184/0 (socket says 172.21.15.31:59184) 2024-06-02T22:23:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.167+0000 7f556d600700 1 -- 172.21.15.31:0/4071239944 learned_addr learned my addr 172.21.15.31:0/4071239944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.167+0000 7f556d600700 1 -- 172.21.15.31:0/4071239944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556819e4b0 con 0x7f556810d4d0 2024-06-02T22:23:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f556d600700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f555c0092e0 tx=0x7f555c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555c026070 con 0x7f556810d4d0 2024-06-02T22:23:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f555c00b750 con 0x7f556810d4d0 2024-06-02T22:23:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556819e740 con 0x7f556810d4d0 2024-06-02T22:23:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f555c003970 con 0x7f556810d4d0 2024-06-02T22:23:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.168+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55681a2840 con 0x7f556810d4d0 2024-06-02T22:23:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.169+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5568109bd0 con 0x7f556810d4d0 2024-06-02T22:23:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.169+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f555c029070 con 0x7f556810d4d0 2024-06-02T22:23:38.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.170+0000 7f5566000700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 0x7f555003b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.170+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f555c01e070 con 0x7f556810d4d0 2024-06-02T22:23:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.170+0000 7f556cc00700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 0x7f555003b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.171+0000 7f556cc00700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 0x7f555003b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5554006fd0 tx=0x7f5554006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.176+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f555c013070 con 0x7f556810d4d0 2024-06-02T22:23:38.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.415+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f556819f2d0 con 0x7f5550039150 2024-06-02T22:23:38.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.418+0000 7f5566000700 1 -- 172.21.15.31:0/4071239944 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f556819f2d0 con 0x7f5550039150 2024-06-02T22:23:38.417 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:23:38.418 INFO:teuthology.orchestra.run.smithi031.stdout:[{"addr": "172.21.15.31", "hostname": "smithi031", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2024-06-02T22:23:38.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 msgr2=0x7f555003b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:38.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 0x7f555003b610 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5554006fd0 tx=0x7f5554006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:38.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 msgr2=0x7f556819df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:38.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f555c0092e0 tx=0x7f555c005030 comp rx=0 tx=0).stop 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 shutdown_connections 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5550039150 0x7f555003b610 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 --2- 172.21.15.31:0/4071239944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f556810d4d0 0x7f556819df70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 >> 172.21.15.31:0/4071239944 conn(0x7f5568077c30 msgr2=0x7f556810ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 shutdown_connections 2024-06-02T22:23:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:38.421+0000 7f5570000700 1 -- 172.21.15.31:0/4071239944 wait complete. 2024-06-02T22:23:39.181 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-02T22:23:39.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-02T22:23:39.631 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:23:40.054 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:39 smithi031 ceph-mon[31767]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:40.054 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:39 smithi031 ceph-mon[31767]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:41.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.526+0000 7f6bf2a00700 1 -- 172.21.15.31:0/2812017733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 msgr2=0x7f6bec104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.526+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/2812017733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec104700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00b0a0 tx=0x7f6bdc00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.527+0000 7f6bf2a00700 1 -- 172.21.15.31:0/2812017733 shutdown_connections 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.527+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/2812017733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec104700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.527+0000 7f6bf2a00700 1 -- 172.21.15.31:0/2812017733 >> 172.21.15.31:0/2812017733 conn(0x7f6bec0ffbb0 msgr2=0x7f6bec101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.527+0000 7f6bf2a00700 1 -- 172.21.15.31:0/2812017733 shutdown_connections 2024-06-02T22:23:41.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.527+0000 7f6bf2a00700 1 -- 172.21.15.31:0/2812017733 wait complete. 2024-06-02T22:23:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.528+0000 7f6bf2a00700 1 Processor -- start 2024-06-02T22:23:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.528+0000 7f6bf2a00700 1 -- start start 2024-06-02T22:23:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.528+0000 7f6bf2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.528+0000 7f6bf2a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec10e6f0 con 0x7f6bec104320 2024-06-02T22:23:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.529+0000 7f6bebe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.529+0000 7f6bebe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41764/0 (socket says 172.21.15.31:41764) 2024-06-02T22:23:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.529+0000 7f6bebe00700 1 -- 172.21.15.31:0/1777111637 learned_addr learned my addr 172.21.15.31:0/1777111637 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:23:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.529+0000 7f6bebe00700 1 -- 172.21.15.31:0/1777111637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec19fd00 con 0x7f6bec104320 2024-06-02T22:23:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6bebe00700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc015040 tx=0x7f6bdc003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc017040 con 0x7f6bec104320 2024-06-02T22:23:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec19ff90 con 0x7f6bec104320 2024-06-02T22:23:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bdc022070 con 0x7f6bec104320 2024-06-02T22:23:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bdc01d5d0 con 0x7f6bec104320 2024-06-02T22:23:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.530+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec199980 con 0x7f6bec104320 2024-06-02T22:23:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.532+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6bdc004000 con 0x7f6bec104320 2024-06-02T22:23:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.532+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec105800 con 0x7f6bec104320 2024-06-02T22:23:41.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.532+0000 7f6be9600700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 0x7f6bd003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.533+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6bdc00f050 con 0x7f6bec104320 2024-06-02T22:23:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.533+0000 7f6be3400700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 0x7f6bd003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.534+0000 7f6be3400700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 0x7f6bd003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4006fd0 tx=0x7f6bd4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:41.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.538+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6bdc007e20 con 0x7f6bec104320 2024-06-02T22:23:41.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.777+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6bec19aeb0 con 0x7f6bec104320 2024-06-02T22:23:41.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.969+0000 7f6be9600700 1 -- 172.21.15.31:0/1777111637 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f6bdc00bcc0 con 0x7f6bec104320 2024-06-02T22:23:41.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 msgr2=0x7f6bd003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:41.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 0x7f6bd003b5b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4006fd0 tx=0x7f6bd4006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 msgr2=0x7f6bec19f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc015040 tx=0x7f6bdc003d50 comp rx=0 tx=0).stop 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 shutdown_connections 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bd00390f0 0x7f6bd003b5b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 --2- 172.21.15.31:0/1777111637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bec104320 0x7f6bec19f7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 >> 172.21.15.31:0/1777111637 conn(0x7f6bec0ffbb0 msgr2=0x7f6bec107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 shutdown_connections 2024-06-02T22:23:41.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:23:41.974+0000 7f6bf2a00700 1 -- 172.21.15.31:0/1777111637 wait complete. 2024-06-02T22:23:41.975 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:42.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:42.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:42.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T22:23:42.734 INFO:tasks.cephadm:Adding mon.a on smithi031 2024-06-02T22:23:42.734 INFO:tasks.cephadm:Adding mon.b on smithi098 2024-06-02T22:23:42.734 INFO:tasks.cephadm:Adding mon.c on smithi178 2024-06-02T22:23:42.734 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c' 2024-06-02T22:23:42.959 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:43.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:43.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:43 smithi031 ceph-mon[31767]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:44.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.308+0000 7fa0beb4f700 1 -- 172.21.15.178:0/4062808256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 msgr2=0x7fa0b81024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:44.308 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.308+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/4062808256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b81024e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800b0a0 tx=0x7fa0a800b3b0 comp rx=0 tx=0).stop 2024-06-02T22:23:44.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.308+0000 7fa0beb4f700 1 -- 172.21.15.178:0/4062808256 shutdown_connections 2024-06-02T22:23:44.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.308+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/4062808256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b81024e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:44.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.308+0000 7fa0beb4f700 1 -- 172.21.15.178:0/4062808256 >> 172.21.15.178:0/4062808256 conn(0x7fa0b80fd9d0 msgr2=0x7fa0b80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:44.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 -- 172.21.15.178:0/4062808256 shutdown_connections 2024-06-02T22:23:44.309 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 -- 172.21.15.178:0/4062808256 wait complete. 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 Processor -- start 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 -- start start 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.309+0000 7fa0beb4f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b810c4d0 con 0x7fa0b8102100 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.310+0000 7fa0bc8eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.310+0000 7fa0bc8eb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.178:54326/0 (socket says 172.21.15.178:54326) 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.310+0000 7fa0bc8eb700 1 -- 172.21.15.178:0/481588621 learned_addr learned my addr 172.21.15.178:0/481588621 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:23:44.310 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.310+0000 7fa0bc8eb700 1 -- 172.21.15.178:0/481588621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b819dba0 con 0x7fa0b8102100 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.311+0000 7fa0bc8eb700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8015040 tx=0x7fa0a8003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.311+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a8017040 con 0x7fa0b8102100 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.311+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b819de30 con 0x7fa0b8102100 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.311+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b8197730 con 0x7fa0b8102100 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.312+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a8022070 con 0x7fa0b8102100 2024-06-02T22:23:44.311 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.312+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a8004190 con 0x7fa0b8102100 2024-06-02T22:23:44.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.312+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b81035e0 con 0x7fa0b8102100 2024-06-02T22:23:44.312 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.313+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa0a800bc10 con 0x7fa0b8102100 2024-06-02T22:23:44.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.313+0000 7fa0b5ffb700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 0x7fa0a403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:44.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.313+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa0a800f050 con 0x7fa0b8102100 2024-06-02T22:23:44.313 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.314+0000 7fa0b7fff700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 0x7fa0a403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:44.314 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.315+0000 7fa0b7fff700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 0x7fa0a403b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0006fd0 tx=0x7fa0a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:44.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.328+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa0a8007e20 con 0x7fa0b8102100 2024-06-02T22:23:44.533 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.533+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}) -- 0x7fa0b8198c60 con 0x7fa0a4039150 2024-06-02T22:23:44.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.549+0000 7fa0b5ffb700 1 -- 172.21.15.178:0/481588621 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa0b8198c60 con 0x7fa0a4039150 2024-06-02T22:23:44.548 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mon update... 2024-06-02T22:23:44.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 msgr2=0x7fa0a403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 0x7fa0a403b610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0006fd0 tx=0x7fa0a0006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 msgr2=0x7fa0b819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8015040 tx=0x7fa0a8003d50 comp rx=0 tx=0).stop 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 shutdown_connections 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa0a4039150 0x7fa0a403b610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 --2- 172.21.15.178:0/481588621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b8102100 0x7fa0b819d660 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 >> 172.21.15.178:0/481588621 conn(0x7fa0b80fd9d0 msgr2=0x7fa0b8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 shutdown_connections 2024-06-02T22:23:44.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:44.551+0000 7fa0beb4f700 1 -- 172.21.15.178:0/481588621 wait complete. 2024-06-02T22:23:45.120 DEBUG:teuthology.orchestra.run.smithi098:mon.b> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.b.service 2024-06-02T22:23:45.123 DEBUG:teuthology.orchestra.run.smithi178:mon.c> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.c.service 2024-06-02T22:23:45.126 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T22:23:45.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T22:23:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: Saving service mon spec with placement smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c;count:3 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:45 smithi031 ceph-mon[31767]: Deploying daemon mon.c on smithi178 2024-06-02T22:23:46.203 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:47.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:47 smithi031 ceph-mon[31767]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:49.136 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 -- 172.21.15.178:0/323469686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 msgr2=0x7f45a4105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 --2- 172.21.15.178:0/323469686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a4105910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f459c00b0a0 tx=0x7f459c00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 -- 172.21.15.178:0/323469686 shutdown_connections 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 --2- 172.21.15.178:0/323469686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a4105910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 -- 172.21.15.178:0/323469686 >> 172.21.15.178:0/323469686 conn(0x7f45a40783c0 msgr2=0x7f45a40787d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 -- 172.21.15.178:0/323469686 shutdown_connections 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.135+0000 7f45abe25700 1 -- 172.21.15.178:0/323469686 wait complete. 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.136+0000 7f45abe25700 1 Processor -- start 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.136+0000 7f45abe25700 1 -- start start 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.136+0000 7f45abe25700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:49.137 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.136+0000 7f45abe25700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f45a410a310 con 0x7f45a4105530 2024-06-02T22:23:49.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.137+0000 7f45a9bc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:49.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.137+0000 7f45a9bc1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.178:54346/0 (socket says 172.21.15.178:54346) 2024-06-02T22:23:49.138 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.137+0000 7f45a9bc1700 1 -- 172.21.15.178:0/3436973494 learned_addr learned my addr 172.21.15.178:0/3436973494 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:23:49.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f45a9bc1700 1 -- 172.21.15.178:0/3436973494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a419dbf0 con 0x7f45a4105530 2024-06-02T22:23:49.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f45a9bc1700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f459c009600 tx=0x7f459c007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:49.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c01e070 con 0x7f45a4105530 2024-06-02T22:23:49.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a419de80 con 0x7f45a4105530 2024-06-02T22:23:49.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a4197830 con 0x7f45a4105530 2024-06-02T22:23:49.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f459c023a70 con 0x7f45a4105530 2024-06-02T22:23:49.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.138+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459c01aae0 con 0x7f45a4105530 2024-06-02T22:23:49.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.139+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4101c70 con 0x7f45a4105530 2024-06-02T22:23:49.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.140+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f459c023c20 con 0x7f45a4105530 2024-06-02T22:23:49.140 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.140+0000 7f459affd700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 0x7f459003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:49.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.140+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f459c00e040 con 0x7f45a4105530 2024-06-02T22:23:49.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.141+0000 7f45a93c0700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 0x7f459003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:49.141 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.142+0000 7f45a93c0700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 0x7f459003b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4594006fd0 tx=0x7f4594006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:49.155 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.156+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f459c01a430 con 0x7f45a4105530 2024-06-02T22:23:49.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.453+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f45a4198d60 con 0x7f45a4105530 2024-06-02T22:23:49.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.454+0000 7f459affd700 1 -- 172.21.15.178:0/3436973494 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f459c032090 con 0x7f45a4105530 2024-06-02T22:23:49.454 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:23:49.454 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":1,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","modified":"2024-06-02T22:21:30.635685Z","created":"2024-06-02T22:21:30.635685Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 msgr2=0x7f459003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 0x7f459003b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4594006fd0 tx=0x7f4594006e40 comp rx=0 tx=0).stop 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 msgr2=0x7f45a419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f459c009600 tx=0x7f459c007a60 comp rx=0 tx=0).stop 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 shutdown_connections 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f45900390f0 0x7f459003b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 --2- 172.21.15.178:0/3436973494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45a4105530 0x7f45a419d6b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 >> 172.21.15.178:0/3436973494 conn(0x7f45a40783c0 msgr2=0x7f45a40fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:49.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 shutdown_connections 2024-06-02T22:23:49.457 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:49.456+0000 7f45abe25700 1 -- 172.21.15.178:0/3436973494 wait complete. 2024-06-02T22:23:49.457 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 1 2024-06-02T22:23:49.586 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 podman[36581]: 2024-06-02 22:23:49.563818174 +0000 UTC m=+0.346828728 container start 0db558e3df7ca2a50d258b0a65bc64807c1bc99b15416ef736d25f909844215f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:23:49.587 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T22:23:49.587 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T22:23:49.587 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pidfile_write: ignore empty --pid-file 2024-06-02T22:23:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:49 smithi031 ceph-mon[31767]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/3436973494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: load: jerasure load: lrc 2024-06-02T22:23:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: RocksDB version: 7.9.2 2024-06-02T22:23:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Git sha 0 2024-06-02T22:23:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T22:23:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: DB SUMMARY 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: DB Session ID: JD2JKZKOVUMG8XC1V25A 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: CURRENT file: CURRENT 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.error_if_exists: 0 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.create_if_missing: 0 2024-06-02T22:23:50.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.paranoid_checks: 1 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.env: 0x55607476fc60 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.info_log: 0x5560764d5b20 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.statistics: (nil) 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.use_fsync: 0 2024-06-02T22:23:50.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_log_file_size: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_fallocate: 1 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.use_direct_reads: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T22:23:50.065 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.db_log_dir: 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.wal_dir: 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T22:23:50.066 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T22:23:50.068 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T22:23:50.068 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.write_buffer_manager: 0x5560764a61e0 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T22:23:50.069 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.unordered_write: 0 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T22:23:50.070 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.row_cache: None 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.wal_filter: None 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.two_write_queues: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.wal_compression: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.atomic_flush: 0 2024-06-02T22:23:50.071 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.log_readahead_size: 0 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T22:23:50.072 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_background_jobs: 2 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_background_compactions: -1 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_subcompactions: 1 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T22:23:50.073 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_open_files: -1 2024-06-02T22:23:50.074 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_background_flushes: -1 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Compression algorithms supported: 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kZSTD supported: 0 2024-06-02T22:23:50.075 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kXpressCompression supported: 0 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kZlibCompression supported: 1 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kSnappyCompression supported: 1 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kLZ4Compression supported: 1 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: kBZip2Compression supported: 0 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T22:23:50.076 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.merge_operator: 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_filter: None 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T22:23:50.077 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5560764d5c40) 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks: 1 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: pin_top_level_index_and_filter: 1 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_type: 0 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_index_type: 0 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_shortening: 1 2024-06-02T22:23:50.078 INFO:journalctl@ceph.mon.c.smithi178.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: checksum: 4 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: no_block_cache: 0 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache: 0x5560764d7090 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_name: BinnedLRUCache 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_options: 2024-06-02T22:23:50.079 INFO:journalctl@ceph.mon.c.smithi178.stdout: capacity : 536870912 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_shard_bits : 4 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: strict_capacity_limit : 0 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: high_pri_pool_ratio: 0.000 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_cache_compressed: (nil) 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: persistent_cache: (nil) 2024-06-02T22:23:50.080 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size: 4096 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_size_deviation: 10 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_restart_interval: 16 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: index_block_restart_interval: 1 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: metadata_block_size: 4096 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: partition_filters: 0 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: use_delta_encoding: 1 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: filter_policy: bloomfilter 2024-06-02T22:23:50.081 INFO:journalctl@ceph.mon.c.smithi178.stdout: whole_key_filtering: 1 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: verify_compression: 0 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: read_amp_bytes_per_bit: 0 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: format_version: 5 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_index_compression: 1 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: block_align: 0 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: max_auto_readahead_size: 262144 2024-06-02T22:23:50.082 INFO:journalctl@ceph.mon.c.smithi178.stdout: prepopulate_block_cache: 0 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout: initial_auto_readahead_size: 8192 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression: NoCompression 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T22:23:50.083 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.num_levels: 7 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T22:23:50.084 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T22:23:50.085 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T22:23:50.086 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T22:23:50.087 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T22:23:50.090 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T22:23:50.090 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T22:23:50.090 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T22:23:50.090 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T22:23:50.091 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T22:23:50.091 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T22:23:50.091 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T22:23:50.091 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T22:23:50.091 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T22:23:50.092 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.table_properties_collectors: 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.inplace_update_support: 0 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T22:23:50.093 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.bloom_locality: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.max_successive_merges: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T22:23:50.094 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.ttl: 2592000 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enable_blob_files: false 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.min_blob_size: 0 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T22:23:50.095 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-02T22:23:50.096 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b4948d19-b6d8-45b8-97d9-a63fda680adc 2024-06-02T22:23:50.097 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367029604955, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T22:23:50.097 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-02T22:23:50.097 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367029605360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717367029, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b4948d19-b6d8-45b8-97d9-a63fda680adc", "db_session_id": "JD2JKZKOVUMG8XC1V25A", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-02T22:23:50.097 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367029605440, "job": 1, "event": "recovery_finished"} 2024-06-02T22:23:50.097 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5560765c6000 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: DB pointer 0x5560765b0000 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T22:23:50.098 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** DB Stats ** 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T22:23:50.099 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T22:23:50.100 INFO:journalctl@ceph.mon.c.smithi178.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** Compaction Stats [default] ** 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:23:50.101 INFO:journalctl@ceph.mon.c.smithi178.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:23:50.102 INFO:journalctl@ceph.mon.c.smithi178.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: Cumulative compaction: 0.00 GB write, 0.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:23:50.103 INFO:journalctl@ceph.mon.c.smithi178.stdout: Interval compaction: 0.00 GB write, 0.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache BinnedLRUCache@0x5560764d7090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T22:23:50.104 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: using public_addr v2:172.21.15.178:0/0 -> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: starting mon.c rank -1 at public addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] at bind addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(???) e0 preinit fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).mds e1 new map 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-02T22:23:50.105 INFO:journalctl@ceph.mon.c.smithi178.stdout: e1 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout: legacy client fscid: -1 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout: 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout: No filesystems configured 2024-06-02T22:23:50.106 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T22:23:50.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Deploying cephadm binary to smithi098 2024-06-02T22:23:50.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Added host smithi098 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.109 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.110 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.110 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.110 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.110 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:50.110 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:50.111 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:50.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:50.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:23:50.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:50.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:50.112 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Deploying cephadm binary to smithi178 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Added host smithi178 2024-06-02T22:23:50.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.115 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.116 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:50.117 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.118 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Saving service mon spec with placement smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c;count:3 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.119 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:50.120 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: Deploying daemon mon.c on smithi178 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/3436973494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 ceph-mon[36614]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 bash[36581]: 0db558e3df7ca2a50d258b0a65bc64807c1bc99b15416ef736d25f909844215f 2024-06-02T22:23:50.121 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:49 smithi178 systemd[1]: Started Ceph mon.c for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:23:51.283 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T22:23:51.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T22:23:51.526 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: mon.a calling monitor election 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: mon.c calling monitor election 2024-06-02T22:23:55.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: monmap epoch 2 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: last_changed 2024-06-02T22:23:49.637865+0000 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: min_mon_release 19 (squid) 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: election_strategy: 1 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:23:55.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: fsmap 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: mgrmap e13: x(active, since 60s) 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:55.064 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:55.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:23:55.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: mon.a calling monitor election 2024-06-02T22:23:55.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: mon.c calling monitor election 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: monmap epoch 2 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: last_changed 2024-06-02T22:23:49.637865+0000 2024-06-02T22:23:55.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: min_mon_release 19 (squid) 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: election_strategy: 1 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: fsmap 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: mgrmap e13: x(active, since 60s) 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:55.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:55.844 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:55 smithi031 ceph-mon[31767]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:55.844 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:55 smithi031 ceph-mon[31767]: Deploying daemon mon.b on smithi098 2024-06-02T22:23:55.844 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 -- 172.21.15.178:0/2958865341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9600035c0 msgr2=0x7ff960005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/2958865341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9600035c0 0x7ff960005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff974101cc0 tx=0x7ff97000feb0 comp rx=0 tx=0).stop 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 -- 172.21.15.178:0/2958865341 shutdown_connections 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/2958865341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9600035c0 0x7ff960005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 -- 172.21.15.178:0/2958865341 >> 172.21.15.178:0/2958865341 conn(0x7ff9740fd8a0 msgr2=0x7ff9740ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 -- 172.21.15.178:0/2958865341 shutdown_connections 2024-06-02T22:23:55.887 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.887+0000 7ff97ad9e700 1 -- 172.21.15.178:0/2958865341 wait complete. 2024-06-02T22:23:55.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.888+0000 7ff97ad9e700 1 Processor -- start 2024-06-02T22:23:55.888 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97ad9e700 1 -- start start 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97ad9e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97ad9e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 0x7ff974075150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97ad9e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff974109e20 con 0x7ff974074cd0 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97ad9e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff974109ca0 con 0x7ff9600035c0 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:54312/0 (socket says 172.21.15.178:54312) 2024-06-02T22:23:55.889 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 -- 172.21.15.178:0/247866698 learned_addr learned my addr 172.21.15.178:0/247866698 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:23:55.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 -- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 msgr2=0x7ff974074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-02T22:23:55.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 -- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 msgr2=0x7ff974074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T22:23:55.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T22:23:55.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff979d9c700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:23:55.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.889+0000 7ff97959b700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 0x7ff974075150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.890+0000 7ff97959b700 1 -- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 msgr2=0x7ff974074790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.890+0000 7ff97959b700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.890+0000 7ff97959b700 1 -- 172.21.15.178:0/247866698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff974076660 con 0x7ff974074cd0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.890+0000 7ff97959b700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 0x7ff974075150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b4d0 tx=0x7ff96400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.891+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff964011630 con 0x7ff974074cd0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.891+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9741a3c30 con 0x7ff974074cd0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.891+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9741a4190 con 0x7ff974074cd0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.891+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff964011cb0 con 0x7ff974074cd0 2024-06-02T22:23:55.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.891+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff9640193b0 con 0x7ff974074cd0 2024-06-02T22:23:55.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.892+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9741034d0 con 0x7ff974074cd0 2024-06-02T22:23:55.892 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.893+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff964018020 con 0x7ff974074cd0 2024-06-02T22:23:55.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.893+0000 7ff96affd700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 0x7ff95803b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:23:55.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.893+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff96404bac0 con 0x7ff974074cd0 2024-06-02T22:23:55.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.893+0000 7ff979d9c700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 0x7ff95803b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:23:55.894 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.894+0000 7ff979d9c700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 0x7ff95803b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff97000fa60 tx=0x7ff970005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:23:55.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:55.910+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff96401f020 con 0x7ff974074cd0 2024-06-02T22:23:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:55 smithi178 ceph-mon[36614]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:55 smithi178 ceph-mon[36614]: Deploying daemon mon.b on smithi098 2024-06-02T22:23:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:56.186 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.186+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff97402dca0 con 0x7ff974074cd0 2024-06-02T22:23:56.187 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.187+0000 7ff96affd700 1 -- 172.21.15.178:0/247866698 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ff964018550 con 0x7ff974074cd0 2024-06-02T22:23:56.187 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:23:56.187 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":2,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","modified":"2024-06-02T22:23:49.637865Z","created":"2024-06-02T22:21:30.635685Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T22:23:56.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 msgr2=0x7ff95803b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:56.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 0x7ff95803b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff97000fa60 tx=0x7ff970005c20 comp rx=0 tx=0).stop 2024-06-02T22:23:56.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 msgr2=0x7ff974075150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:23:56.189 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 0x7ff974075150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b4d0 tx=0x7ff96400b890 comp rx=0 tx=0).stop 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 shutdown_connections 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff958038e90 0x7ff95803b350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9600035c0 0x7ff974074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 --2- 172.21.15.178:0/247866698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff974074cd0 0x7ff974075150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 >> 172.21.15.178:0/247866698 conn(0x7ff9740fd8a0 msgr2=0x7ff9740fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 shutdown_connections 2024-06-02T22:23:56.190 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:23:56.189+0000 7ff97ad9e700 1 -- 172.21.15.178:0/247866698 wait complete. 2024-06-02T22:23:56.191 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 2 2024-06-02T22:23:57.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:56 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/247866698' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:57.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:56 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/247866698' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:57.121 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:23:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:23:56.638+0000 7fa846e00700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-02T22:23:57.787 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T22:23:57.787 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T22:23:58.028 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:23:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:23:57 smithi178 ceph-mon[36614]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.063 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 systemd[1]: Starting Ceph mon.b for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:23:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:23:57 smithi031 ceph-mon[31767]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.369 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 podman[36731]: 2024-06-02 22:23:58.153198216 +0000 UTC m=+0.017283774 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:23:58.369 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 podman[36731]: 2024-06-02 22:23:58.261219464 +0000 UTC m=+0.125305014 container create 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-02T22:23:58.630 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 podman[36731]: 2024-06-02 22:23:58.463510164 +0000 UTC m=+0.327595713 container init 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-02T22:23:58.630 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 podman[36731]: 2024-06-02 22:23:58.466713138 +0000 UTC m=+0.330798699 container start 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-02T22:23:58.630 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T22:23:58.630 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-02T22:23:58.630 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pidfile_write: ignore empty --pid-file 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: load: jerasure load: lrc 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: RocksDB version: 7.9.2 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Git sha 0 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: DB SUMMARY 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: DB Session ID: QEQRD35TI2KJ71MNW0JL 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: CURRENT file: CURRENT 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-06-02T22:23:58.631 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.error_if_exists: 0 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.create_if_missing: 0 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.paranoid_checks: 1 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.env: 0x562e12cffc60 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.info_log: 0x562e15105b20 2024-06-02T22:23:58.632 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.statistics: (nil) 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.use_fsync: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_log_file_size: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_fallocate: 1 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T22:23:58.633 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.use_direct_reads: 0 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.db_log_dir: 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.wal_dir: 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T22:23:58.634 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.write_buffer_manager: 0x562e150d61e0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.unordered_write: 0 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T22:23:58.635 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T22:23:58.636 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.row_cache: None 2024-06-02T22:23:58.636 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.wal_filter: None 2024-06-02T22:23:58.637 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T22:23:58.637 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T22:23:58.637 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.two_write_queues: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.wal_compression: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.atomic_flush: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.log_readahead_size: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T22:23:58.638 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_background_jobs: 2 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_background_compactions: -1 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_subcompactions: 1 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T22:23:58.639 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_open_files: -1 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_background_flushes: -1 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Compression algorithms supported: 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kZSTD supported: 0 2024-06-02T22:23:58.640 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kXpressCompression supported: 0 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kZlibCompression supported: 1 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kSnappyCompression supported: 1 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kLZ4Compression supported: 1 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: kBZip2Compression supported: 0 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.merge_operator: 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_filter: None 2024-06-02T22:23:58.641 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e15105c40) 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: index_type: 0 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: data_block_index_type: 0 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: index_shortening: 1 2024-06-02T22:23:58.642 INFO:journalctl@ceph.mon.b.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: checksum: 4 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: no_block_cache: 0 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_cache: 0x562e15107090 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_cache_options: 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: capacity : 536870912 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: num_shard_bits : 4 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: strict_capacity_limit : 0 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_cache_compressed: (nil) 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: persistent_cache: (nil) 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_size: 4096 2024-06-02T22:23:58.643 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_size_deviation: 10 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_restart_interval: 16 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: index_block_restart_interval: 1 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: metadata_block_size: 4096 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: partition_filters: 0 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: use_delta_encoding: 1 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: filter_policy: bloomfilter 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: whole_key_filtering: 1 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: verify_compression: 0 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: format_version: 5 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: enable_index_compression: 1 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: block_align: 0 2024-06-02T22:23:58.644 INFO:journalctl@ceph.mon.b.smithi098.stdout: max_auto_readahead_size: 262144 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout: prepopulate_block_cache: 0 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout: initial_auto_readahead_size: 8192 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression: NoCompression 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.num_levels: 7 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T22:23:58.645 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:23:58.646 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T22:23:58.647 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T22:23:58.648 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T22:23:58.649 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.table_properties_collectors: 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.inplace_update_support: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.bloom_locality: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.max_successive_merges: 0 2024-06-02T22:23:58.650 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.ttl: 2592000 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enable_blob_files: false 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.min_blob_size: 0 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T22:23:58.651 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 440993d4-4fd5-461d-be61-bce660ca6670 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367038497428, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367038497943, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717367038, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "440993d4-4fd5-461d-be61-bce660ca6670", "db_session_id": "QEQRD35TI2KJ71MNW0JL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717367038498043, "job": 1, "event": "recovery_finished"} 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-02T22:23:58.652 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e151f6000 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: DB pointer 0x562e151e0000 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: ** DB Stats ** 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.653 INFO:journalctl@ceph.mon.b.smithi098.stdout: ** Compaction Stats [default] ** 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: ** Compaction Stats [default] ** 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.654 INFO:journalctl@ceph.mon.b.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Block cache BinnedLRUCache@0x562e15107090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.655 INFO:journalctl@ceph.mon.b.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: using public_addr v2:172.21.15.98:0/0 -> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: starting mon.b rank -1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(???) e0 preinit fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).mds e1 new map 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).mds e1 print_map 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: e1 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: legacy client fscid: -1 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout: No filesystems configured 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T22:23:58.656 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Deploying cephadm binary to smithi098 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.657 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Added host smithi098 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.659 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Deploying cephadm binary to smithi178 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Added host smithi178 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.660 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:23:58.661 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1777111637' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Saving service mon spec with placement smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c;count:3 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:23:58.662 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Deploying daemon mon.c on smithi178 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/3436973494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.a calling monitor election 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.663 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.c calling monitor election 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: monmap epoch 2 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: last_changed 2024-06-02T22:23:49.637865+0000 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: min_mon_release 19 (squid) 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: election_strategy: 1 2024-06-02T22:23:58.664 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: fsmap 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mgrmap e13: x(active, since 60s) 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: Deploying daemon mon.b on smithi098 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:23:58.665 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/247866698' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:23:58.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:23:58.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 ceph-mon[36750]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T22:23:58.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 bash[36731]: 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d 2024-06-02T22:23:58.666 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:23:58 smithi098 systemd[1]: Started Ceph mon.b for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:24:03.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 -- 172.21.15.178:0/2263730033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 msgr2=0x7f6690005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:03.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/2263730033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f6690005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f66a8101ed0 tx=0x7f669800fe60 comp rx=0 tx=0).stop 2024-06-02T22:24:03.828 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 -- 172.21.15.178:0/2263730033 shutdown_connections 2024-06-02T22:24:03.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/2263730033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f6690005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:03.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 -- 172.21.15.178:0/2263730033 >> 172.21.15.178:0/2263730033 conn(0x7f66a80fda90 msgr2=0x7f66a80ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:03.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 -- 172.21.15.178:0/2263730033 shutdown_connections 2024-06-02T22:24:03.829 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.828+0000 7f66ae7ea700 1 -- 172.21.15.178:0/2263730033 wait complete. 2024-06-02T22:24:03.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.829+0000 7f66ae7ea700 1 Processor -- start 2024-06-02T22:24:03.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.829+0000 7f66ae7ea700 1 -- start start 2024-06-02T22:24:03.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f66a819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:03.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:03.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8109fe0 con 0x7f66900035c0 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66a8109e60 con 0x7f66a8197fe0 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66ae7ea700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f66a810a160 con 0x7f66a819ddd0 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46118/0 (socket says 172.21.15.178:46118) 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 -- 172.21.15.178:0/3084489948 learned_addr learned my addr 172.21.15.178:0/3084489948 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66acd87700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 msgr2=0x7f66a8197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 msgr2=0x7f66a8197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a77fe700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:24:03.831 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66acd87700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 msgr2=0x7f66a8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-02T22:24:03.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66acd87700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 msgr2=0x7f66a8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T22:24:03.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66acd87700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T22:24:03.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66acd87700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T22:24:03.832 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.830+0000 7f66a7fff700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f66a819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.831+0000 7f66a7fff700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 msgr2=0x7f66a8197aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.831+0000 7f66a7fff700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.831+0000 7f66a7fff700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 msgr2=0x7f66a8198490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.831+0000 7f66a7fff700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.831+0000 7f66a7fff700 1 -- 172.21.15.178:0/3084489948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a81a4760 con 0x7f66900035c0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66a7fff700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f66a819d890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66a8101ed0 tx=0x7f6698014fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669802b020 con 0x7f66900035c0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a81a4930 con 0x7f66900035c0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66980041c0 con 0x7f66900035c0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698022040 con 0x7f66900035c0 2024-06-02T22:24:03.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.832+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81a4ec0 con 0x7f66900035c0 2024-06-02T22:24:03.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.833+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a8063af0 con 0x7f66900035c0 2024-06-02T22:24:03.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.834+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f669802e020 con 0x7f66900035c0 2024-06-02T22:24:03.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.834+0000 7f66a57fa700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 0x7f669403ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:03.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.834+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f669804ebf0 con 0x7f66900035c0 2024-06-02T22:24:03.834 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.834+0000 7f66a77fe700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 0x7f669403ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:03.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.836+0000 7f66a77fe700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 0x7f669403ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f669c009180 tx=0x7f669c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:03.852 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:03.853+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6698035020 con 0x7f66900035c0 2024-06-02T22:24:03.853 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.853 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: mon.c calling monitor election 2024-06-02T22:24:03.853 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:24:03.853 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: mon.a calling monitor election 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: monmap epoch 3 2024-06-02T22:24:03.854 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: min_mon_release 19 (squid) 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: election_strategy: 1 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: fsmap 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: mgrmap e13: x(active, since 69s) 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:03.855 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: mon.c calling monitor election 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: mon.a calling monitor election 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:03.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: monmap epoch 3 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: min_mon_release 19 (squid) 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: election_strategy: 1 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: fsmap 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:03.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: mgrmap e13: x(active, since 69s) 2024-06-02T22:24:03.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:24:03.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:03.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.149+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f66a802dca0 con 0x7f66900035c0 2024-06-02T22:24:04.149 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.149+0000 7f66a57fa700 1 -- 172.21.15.178:0/3084489948 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f669800d340 con 0x7f66900035c0 2024-06-02T22:24:04.149 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-06-02T22:24:04.150 INFO:teuthology.orchestra.run.smithi178.stdout:{"epoch":3,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","modified":"2024-06-02T22:23:58.523484Z","created":"2024-06-02T22:21:30.635685Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 msgr2=0x7f669403ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 0x7f669403ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f669c009180 tx=0x7f669c008040 comp rx=0 tx=0).stop 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 msgr2=0x7f66a819d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f66a819d890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66a8101ed0 tx=0x7f6698014fc0 comp rx=0 tx=0).stop 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 shutdown_connections 2024-06-02T22:24:04.153 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6694039580 0x7f669403ba40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66a8197fe0 0x7f66a8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66900035c0 0x7f66a819d890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 --2- 172.21.15.178:0/3084489948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66a819ddd0 0x7f66a8197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 >> 172.21.15.178:0/3084489948 conn(0x7f66a80fda90 msgr2=0x7f66a80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 shutdown_connections 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:04.153+0000 7f66ae7ea700 1 -- 172.21.15.178:0/3084489948 wait complete. 2024-06-02T22:24:04.154 INFO:teuthology.orchestra.run.smithi178.stderr:dumped monmap epoch 3 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/3084489948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:04.809 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-02T22:24:04.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-02T22:24:04.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/3084489948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:24:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.265 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: mon.c calling monitor election 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: mon.a calling monitor election 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: monmap epoch 3 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: min_mon_release 19 (squid) 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: election_strategy: 1 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:05.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: fsmap 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: mgrmap e13: x(active, since 69s) 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/3084489948' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:05.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mon.b calling monitor election 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mon.b calling monitor election 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mon.c calling monitor election 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mon.a calling monitor election 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: monmap epoch 3 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: min_mon_release 19 (squid) 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: election_strategy: 1 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: fsmap 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: mgrmap e13: x(active, since 71s) 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: Updating smithi031:/etc/ceph/ceph.conf 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:06 smithi178 ceph-mon[36614]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mon.b calling monitor election 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mon.b calling monitor election 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mon.c calling monitor election 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mon.a calling monitor election 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T22:24:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: monmap epoch 3 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: min_mon_release 19 (squid) 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: election_strategy: 1 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: fsmap 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: mgrmap e13: x(active, since 71s) 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: Updating smithi031:/etc/ceph/ceph.conf 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:06 smithi031 ceph-mon[31767]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mon.b calling monitor election 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mon.b calling monitor election 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mon.c calling monitor election 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mon.a calling monitor election 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: monmap epoch 3 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: last_changed 2024-06-02T22:23:58.523484+0000 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: created 2024-06-02T22:21:30.635685+0000 2024-06-02T22:24:06.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: min_mon_release 19 (squid) 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: election_strategy: 1 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: 0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: 1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.c 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: 2: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: fsmap 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: mgrmap e13: x(active, since 71s) 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: Updating smithi031:/etc/ceph/ceph.conf 2024-06-02T22:24:06.467 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: Updating smithi098:/etc/ceph/ceph.conf 2024-06-02T22:24:06.468 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: Updating smithi178:/etc/ceph/ceph.conf 2024-06-02T22:24:06.468 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: Updating smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:06.468 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:06 smithi098 ceph-mon[36750]: Updating smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 -- 172.21.15.31:0/3584816526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c90100fe0 msgr2=0x7f3c901013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 --2- 172.21.15.31:0/3584816526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c90100fe0 0x7f3c901013c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009910 tx=0x7f3c80009c20 comp rx=0 tx=0).stop 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 -- 172.21.15.31:0/3584816526 shutdown_connections 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 --2- 172.21.15.31:0/3584816526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c90100fe0 0x7f3c901013c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 -- 172.21.15.31:0/3584816526 >> 172.21.15.31:0/3584816526 conn(0x7f3c900fc890 msgr2=0x7f3c900fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 -- 172.21.15.31:0/3584816526 shutdown_connections 2024-06-02T22:24:07.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.359+0000 7f3c97200700 1 -- 172.21.15.31:0/3584816526 wait complete. 2024-06-02T22:24:07.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.361+0000 7f3c97200700 1 Processor -- start 2024-06-02T22:24:07.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.361+0000 7f3c97200700 1 -- start start 2024-06-02T22:24:07.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:07.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 0x7f3c90197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:07.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c90197f60 0x7f3c90198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:07.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010b370 con 0x7f3c9019dda0 2024-06-02T22:24:07.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010b1f0 con 0x7f3c90197f60 2024-06-02T22:24:07.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c97200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9010b4f0 con 0x7f3c90100fe0 2024-06-02T22:24:07.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c8fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:07.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.362+0000 7f3c8f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 0x7f3c90197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54384/0 (socket says 172.21.15.31:54384) 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 -- 172.21.15.31:0/2348202783 learned_addr learned my addr 172.21.15.31:0/2348202783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c95200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c90197f60 0x7f3c90198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 -- 172.21.15.31:0/2348202783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c90197f60 msgr2=0x7f3c90198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c90197f60 0x7f3c90198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 -- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 msgr2=0x7f3c90197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 0x7f3c90197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 -- 172.21.15.31:0/2348202783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c901a4730 con 0x7f3c90100fe0 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8f400700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 0x7f3c90197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:24:07.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.363+0000 7f3c8fe00700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000bdc0 tx=0x7f3c8000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.364+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80027070 con 0x7f3c90100fe0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.364+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c800050d0 con 0x7f3c90100fe0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.364+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80022dc0 con 0x7f3c90100fe0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.364+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c901a4960 con 0x7f3c90100fe0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.364+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c901a4ef0 con 0x7f3c90100fe0 2024-06-02T22:24:07.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.365+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c90063af0 con 0x7f3c90100fe0 2024-06-02T22:24:07.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.365+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3c8002a070 con 0x7f3c90100fe0 2024-06-02T22:24:07.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.366+0000 7f3c8cc00700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 0x7f3c7403ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:07.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.366+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3c8004d390 con 0x7f3c90100fe0 2024-06-02T22:24:07.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.366+0000 7f3c8f400700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 0x7f3c7403ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:07.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.367+0000 7f3c8f400700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 0x7f3c7403ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009910 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:07.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.372+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3c80013070 con 0x7f3c90100fe0 2024-06-02T22:24:07.440 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: Updating smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.441 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: Updating smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: Updating smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:07.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.609+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3c901a5120 con 0x7f3c90100fe0 2024-06-02T22:24:07.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.610+0000 7f3c8cc00700 1 -- 172.21.15.31:0/2348202783 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f3c80031070 con 0x7f3c90100fe0 2024-06-02T22:24:07.610 INFO:teuthology.orchestra.run.smithi031.stdout:# minimal ceph.conf for 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:07.610 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-06-02T22:24:07.610 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:24:07.610 INFO:teuthology.orchestra.run.smithi031.stdout: mon_host = [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-06-02T22:24:07.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 msgr2=0x7f3c7403ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:07.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 0x7f3c7403ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009910 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2024-06-02T22:24:07.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 msgr2=0x7f3c9019d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:07.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000bdc0 tx=0x7f3c8000bdf0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 shutdown_connections 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c74039580 0x7f3c7403ba40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c90197f60 0x7f3c90198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90100fe0 0x7f3c9019d860 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 --2- 172.21.15.31:0/2348202783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c9019dda0 0x7f3c90197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 >> 172.21.15.31:0/2348202783 conn(0x7f3c900fc890 msgr2=0x7f3c9006a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 shutdown_connections 2024-06-02T22:24:07.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:07.613+0000 7f3c97200700 1 -- 172.21.15.31:0/2348202783 wait complete. 2024-06-02T22:24:07.703 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:24:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:24:07.523+0000 7fa846e00700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: Reconfiguring daemon mon.a on smithi031 2024-06-02T22:24:08.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:08 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2348202783' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.459 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-02T22:24:08.459 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:24:08.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:08.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: Reconfiguring daemon mon.a on smithi031 2024-06-02T22:24:08.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:08 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2348202783' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.528 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:24:08.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: Reconfiguring mon.a (unknown last config time)... 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: Reconfiguring daemon mon.a on smithi031 2024-06-02T22:24:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:08 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2348202783' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:08.648 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:24:08.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T22:24:08.679 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:24:08.680 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:24:08.745 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:24:08.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T22:24:08.777 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:24:08.778 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T22:24:08.845 INFO:tasks.cephadm:Adding mgr.x on smithi031 2024-06-02T22:24:08.845 INFO:tasks.cephadm:Adding mgr.y on smithi098 2024-06-02T22:24:08.845 INFO:tasks.cephadm:Adding mgr.z on smithi178 2024-06-02T22:24:08.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi031=x;smithi098=y;smithi178=z' 2024-06-02T22:24:09.116 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:24:09.521 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:09 smithi178 ceph-mon[36614]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:09.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:09 smithi031 ceph-mon[31767]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:09 smithi098 ceph-mon[36750]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:10.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.622+0000 7f1cdc27c700 1 -- 172.21.15.178:0/1912925645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4102ae0 msgr2=0x7f1cd4104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:10.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/1912925645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4102ae0 0x7f1cd4104ed0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009910 tx=0x7f1cd0009c20 comp rx=0 tx=0).stop 2024-06-02T22:24:10.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- 172.21.15.178:0/1912925645 shutdown_connections 2024-06-02T22:24:10.624 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/1912925645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4102ae0 0x7f1cd4104ed0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- 172.21.15.178:0/1912925645 >> 172.21.15.178:0/1912925645 conn(0x7f1cd40fc470 msgr2=0x7f1cd40fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- 172.21.15.178:0/1912925645 shutdown_connections 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- 172.21.15.178:0/1912925645 wait complete. 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 Processor -- start 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- start start 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cd4102ae0 0x7f1cd41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4197d30 0x7f1cd419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4108090 con 0x7f1cd4197d30 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4107f10 con 0x7f1cd4102ae0 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.623+0000 7f1cdc27c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4108210 con 0x7f1cd41981b0 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:10.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46122/0 (socket says 172.21.15.178:46122) 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 -- 172.21.15.178:0/2273220507 learned_addr learned my addr 172.21.15.178:0/2273220507 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda018700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cd4102ae0 0x7f1cd41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 -- 172.21.15.178:0/2273220507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cd4102ae0 msgr2=0x7f1cd41977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cd4102ae0 0x7f1cd41977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 -- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4197d30 msgr2=0x7f1cd419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4197d30 0x7f1cd419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 -- 172.21.15.178:0/2273220507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd419fc00 con 0x7f1cd41981b0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cda819700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ba50 tx=0x7f1ccc00be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc019070 con 0x7f1cd41981b0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ccc014440 con 0x7f1cd41981b0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc007590 con 0x7f1cd41981b0 2024-06-02T22:24:10.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd419fef0 con 0x7f1cd41981b0 2024-06-02T22:24:10.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.624+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd41a0430 con 0x7f1cd41981b0 2024-06-02T22:24:10.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.625+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1ccc01c070 con 0x7f1cd41981b0 2024-06-02T22:24:10.627 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.625+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd4063af0 con 0x7f1cd41981b0 2024-06-02T22:24:10.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.625+0000 7f1ccb7fe700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 0x7f1cc003ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:10.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.625+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1ccc04b8a0 con 0x7f1cd41981b0 2024-06-02T22:24:10.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.626+0000 7f1cda018700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 0x7f1cc003ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:10.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.627+0000 7f1cda018700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 0x7f1cc003ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0005e00 tx=0x7f1cd00052d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:10.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.631+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1ccc014910 con 0x7f1cd41981b0 2024-06-02T22:24:10.836 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.836+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi031=x;smithi098=y;smithi178=z", "target": ["mon-mgr", ""]}) -- 0x7f1cd4062960 con 0x7f1cc0039580 2024-06-02T22:24:10.858 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.858+0000 7f1ccb7fe700 1 -- 172.21.15.178:0/2273220507 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1cd4062960 con 0x7f1cc0039580 2024-06-02T22:24:10.858 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mgr update... 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 msgr2=0x7f1cc003ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 0x7f1cc003ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0005e00 tx=0x7f1cd00052d0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 msgr2=0x7f1cd419f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00ba50 tx=0x7f1ccc00be10 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 shutdown_connections 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1cc0039580 0x7f1cc003ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cd41981b0 0x7f1cd419f330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1cd4102ae0 0x7f1cd41977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 --2- 172.21.15.178:0/2273220507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd4197d30 0x7f1cd419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 >> 172.21.15.178:0/2273220507 conn(0x7f1cd40fc470 msgr2=0x7f1cd40fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 shutdown_connections 2024-06-02T22:24:10.861 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:24:10.861+0000 7f1cdc27c700 1 -- 172.21.15.178:0/2273220507 wait complete. 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: Reconfiguring mon.b (monmap changed)... 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:10 smithi031 ceph-mon[31767]: Reconfiguring daemon mon.b on smithi098 2024-06-02T22:24:11.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: Reconfiguring mon.b (monmap changed)... 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:11.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:10 smithi098 ceph-mon[36750]: Reconfiguring daemon mon.b on smithi098 2024-06-02T22:24:11.238 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.238 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:11.239 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: Reconfiguring mon.b (monmap changed)... 2024-06-02T22:24:11.239 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:11.239 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:11.239 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:11.239 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:10 smithi178 ceph-mon[36614]: Reconfiguring daemon mon.b on smithi098 2024-06-02T22:24:11.462 DEBUG:teuthology.orchestra.run.smithi098:mgr.y> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-02T22:24:11.464 DEBUG:teuthology.orchestra.run.smithi178:mgr.z> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-02T22:24:11.467 INFO:tasks.cephadm:Deploying OSDs... 2024-06-02T22:24:11.467 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:24:11.467 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T22:24:11.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T22:24:11.528 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-06-02T22:24:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T22:24:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:11.583 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-06-02T22:24:11.583 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:11.583 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:11.584 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-06-02 22:23:11.281550165 +0000 2024-06-02T22:24:11.584 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-06-02 22:17:02.882519610 +0000 2024-06-02T22:24:11.584 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-06-02 22:17:02.882519610 +0000 2024-06-02T22:24:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-06-02 22:17:02.882519610 +0000 2024-06-02T22:24:11.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T22:24:11.672 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-06-02T22:24:11.672 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-06-02T22:24:11.672 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000388687 s, 1.3 MB/s 2024-06-02T22:24:11.676 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T22:24:11.738 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:11.792 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-06-02 22:23:11.336549283 +0000 2024-06-02T22:24:11.793 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-06-02 22:17:03.496509787 +0000 2024-06-02T22:24:11.793 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-06-02 22:17:03.496509787 +0000 2024-06-02T22:24:11.793 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-06-02 22:17:03.496509787 +0000 2024-06-02T22:24:11.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T22:24:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-06-02T22:24:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-06-02T22:24:11.880 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000353822 s, 1.4 MB/s 2024-06-02T22:24:11.884 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T22:24:11.942 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-06-02T22:24:11.994 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T22:24:11.994 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-06-02 22:23:11.386548482 +0000 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-06-02 22:17:04.088500315 +0000 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-06-02 22:17:04.088500315 +0000 2024-06-02T22:24:11.995 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-06-02 22:17:04.088500315 +0000 2024-06-02T22:24:11.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi031=x;smithi098=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: Saving service mgr spec with placement smithi031=x;smithi098=y;smithi178=z;count:3 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:12.059 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:12.060 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:12.067 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-06-02T22:24:12.067 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-06-02T22:24:12.067 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000361972 s, 1.4 MB/s 2024-06-02T22:24:12.070 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T22:24:12.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:12.107 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi031=x;smithi098=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: Saving service mgr spec with placement smithi031=x;smithi098=y;smithi178=z;count:3 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:12.108 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:12.126 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:12.179 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-06-02 22:23:11.438547648 +0000 2024-06-02T22:24:12.180 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-06-02 22:17:04.693490636 +0000 2024-06-02T22:24:12.180 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-06-02 22:17:04.693490636 +0000 2024-06-02T22:24:12.180 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-06-02 22:17:04.693490636 +0000 2024-06-02T22:24:12.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T22:24:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi031=x;smithi098=y;smithi178=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: Saving service mgr spec with placement smithi031=x;smithi098=y;smithi178=z;count:3 2024-06-02T22:24:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:12.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T22:24:12.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T22:24:12.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:12.267 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-06-02T22:24:12.268 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-06-02T22:24:12.268 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000393527 s, 1.3 MB/s 2024-06-02T22:24:12.272 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T22:24:12.332 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-06-02T22:24:12.333 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T22:24:12.350 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T22:24:12.350 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-06-02T22:24:12.407 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-06-02 22:23:57.927862987 +0000 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-06-02 22:15:31.841028572 +0000 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-06-02 22:15:31.841028572 +0000 2024-06-02T22:24:12.408 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-06-02 22:15:31.841028572 +0000 2024-06-02T22:24:12.409 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T22:24:12.472 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-06-02T22:24:12.472 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-06-02T22:24:12.472 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000228242 s, 2.2 MB/s 2024-06-02T22:24:12.474 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T22:24:12.531 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-06-02 22:23:57.927862987 +0000 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-06-02 22:15:32.172024336 +0000 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-06-02 22:15:32.172024336 +0000 2024-06-02T22:24:12.587 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-06-02 22:15:32.172024336 +0000 2024-06-02T22:24:12.587 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T22:24:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-06-02T22:24:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-06-02T22:24:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000213795 s, 2.4 MB/s 2024-06-02T22:24:12.653 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T22:24:12.709 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-06-02T22:24:12.764 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T22:24:12.764 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-06-02 22:23:57.928862974 +0000 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-06-02 22:15:32.500020139 +0000 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-06-02 22:15:32.500020139 +0000 2024-06-02T22:24:12.765 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-06-02 22:15:32.500020139 +0000 2024-06-02T22:24:12.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T22:24:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-06-02T22:24:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-06-02T22:24:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000186605 s, 2.7 MB/s 2024-06-02T22:24:12.829 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T22:24:12.885 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-06-02T22:24:12.940 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-06-02 22:23:57.928862974 +0000 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-06-02 22:15:32.830015916 +0000 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-06-02 22:15:32.830015916 +0000 2024-06-02T22:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-06-02 22:15:32.830015916 +0000 2024-06-02T22:24:12.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T22:24:13.003 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-06-02T22:24:13.003 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-06-02T22:24:13.003 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000172642 s, 3.0 MB/s 2024-06-02T22:24:13.004 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T22:24:13.061 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-06-02T22:24:13.061 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T22:24:13.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:12 smithi178 ceph-mon[36614]: Reconfiguring mon.c (monmap changed)... 2024-06-02T22:24:13.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:12 smithi178 ceph-mon[36614]: Reconfiguring daemon mon.c on smithi178 2024-06-02T22:24:13.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T22:24:13.077 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-06-02T22:24:13.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:12 smithi031 ceph-mon[31767]: Reconfiguring mon.c (monmap changed)... 2024-06-02T22:24:13.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:12 smithi031 ceph-mon[31767]: Reconfiguring daemon mon.c on smithi178 2024-06-02T22:24:13.132 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-02 22:23:48.849515507 +0000 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-02 22:15:44.898574378 +0000 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-02 22:15:44.898574378 +0000 2024-06-02T22:24:13.133 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-02 22:15:44.898574378 +0000 2024-06-02T22:24:13.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T22:24:13.195 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-02T22:24:13.195 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-02T22:24:13.195 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.2835e-05 s, 5.5 MB/s 2024-06-02T22:24:13.196 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T22:24:13.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:12 smithi098 ceph-mon[36750]: Reconfiguring mon.c (monmap changed)... 2024-06-02T22:24:13.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:12 smithi098 ceph-mon[36750]: Reconfiguring daemon mon.c on smithi178 2024-06-02T22:24:13.252 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-06-02T22:24:13.307 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T22:24:13.307 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:13.307 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-06-02T22:24:13.307 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:13.308 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:13.308 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-02 22:23:48.849515507 +0000 2024-06-02T22:24:13.308 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-02 22:15:45.256567762 +0000 2024-06-02T22:24:13.308 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-02 22:15:45.256567762 +0000 2024-06-02T22:24:13.308 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-02 22:15:45.256567762 +0000 2024-06-02T22:24:13.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T22:24:13.369 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-02T22:24:13.370 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-02T22:24:13.370 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000112146 s, 4.6 MB/s 2024-06-02T22:24:13.371 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T22:24:13.427 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-02 22:23:48.850515489 +0000 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-02 22:15:45.561562126 +0000 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-02 22:15:45.561562126 +0000 2024-06-02T22:24:13.483 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-02 22:15:45.561562126 +0000 2024-06-02T22:24:13.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T22:24:13.546 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-02T22:24:13.546 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-02T22:24:13.546 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000105166 s, 4.9 MB/s 2024-06-02T22:24:13.547 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T22:24:13.603 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-06-02 22:23:48.850515489 +0000 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-06-02 22:15:45.887556101 +0000 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-06-02 22:15:45.887556101 +0000 2024-06-02T22:24:13.657 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-06-02 22:15:45.887556101 +0000 2024-06-02T22:24:13.658 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T22:24:13.719 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-06-02T22:24:13.719 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-06-02T22:24:13.719 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.4188e-05 s, 6.1 MB/s 2024-06-02T22:24:13.720 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T22:24:13.776 INFO:tasks.cephadm:Deploying osd.0 on smithi031 with /dev/vg_nvme/lv_4... 2024-06-02T22:24:13.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:14.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:14.227 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:14 smithi178 ceph-mon[36614]: Deploying daemon mgr.z on smithi178 2024-06-02T22:24:15.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:14 smithi031 ceph-mon[31767]: Deploying daemon mgr.z on smithi178 2024-06-02T22:24:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:14 smithi098 ceph-mon[36750]: Deploying daemon mgr.z on smithi178 2024-06-02T22:24:15.400 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mgr[38465]: -- 172.21.15.178:0/2678557694 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a722985a0 con 0x561a7226cc00 2024-06-02T22:24:15.400 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 bash[38444]: 3bdf1f1f5e3e1c7af703e851bc6d8092641286a2e084647f1c93456539572621 2024-06-02T22:24:15.659 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 systemd[1]: Started Ceph mgr.z for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:24:15.740 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:15.473+0000 7fe72e672200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:24:15.740 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:15.659+0000 7fe72e672200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:24:16.061 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:15.759+0000 7fe72e672200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:16.163 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:16.164 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:16.180 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:16.483 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:16.065+0000 7fe72e672200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:24:16.484 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:16.149+0000 7fe72e672200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:24:17.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:16 smithi178 ceph-mon[36614]: Deploying daemon mgr.y on smithi098 2024-06-02T22:24:17.154 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:16 smithi098 ceph-mon[36750]: Deploying daemon mgr.y on smithi098 2024-06-02T22:24:17.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:16 smithi031 ceph-mon[31767]: Deploying daemon mgr.y on smithi098 2024-06-02T22:24:17.219 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T22:24:17.220 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T22:24:17.220 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2024-06-02T22:24:17.220 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2024-06-02T22:24:17.220 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0390187 s, 269 MB/s 2024-06-02T22:24:17.220 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2024-06-02T22:24:17.719 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:17.377+0000 7fe72e672200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:24:17.719 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:17.550+0000 7fe72e672200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:24:18.018 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:17 smithi178 ceph-mon[36614]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:18.018 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:17.728+0000 7fe72e672200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:24:18.018 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:18.017+0000 7fe72e672200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:24:18.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_4 2024-06-02T22:24:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:17 smithi098 ceph-mon[36750]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:18.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:18.043+0000 7f990a52d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T22:24:18.311 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:18.111+0000 7fe72e672200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:24:18.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:17 smithi031 ceph-mon[31767]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:18.526 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:24:18.659 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:18.230+0000 7f990a52d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:24:18.659 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:18.332+0000 7f990a52d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T22:24:18.659 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:18.658+0000 7f990a52d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T22:24:18.811 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:18.316+0000 7fe72e672200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:24:18.812 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:18.520+0000 7fe72e672200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:24:18.962 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:18.746+0000 7f990a52d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:19.303 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:19.304 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:19.160+0000 7fe72e672200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:19.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:19.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:19.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:19.920 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:19.617+0000 7fe72e672200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:24:19.921 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:19.716+0000 7fe72e672200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:24:19.921 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:19.920+0000 7fe72e672200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:24:20.295 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.295 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.295 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.295 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.295 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:20.296 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:20.297 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.297 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:20 smithi031 ceph-mon[31767]: Reconfiguring daemon mgr.x on smithi031 2024-06-02T22:24:20.325 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:19.991+0000 7f990a52d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T22:24:20.325 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:20.157+0000 7f990a52d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T22:24:20.325 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:20.325+0000 7f990a52d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T22:24:20.326 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:20.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:20.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.327 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-mon[36750]: Reconfiguring daemon mgr.x on smithi031 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:20.465 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:20.466 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T22:24:20.466 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T22:24:20.466 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T22:24:20.466 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:20.466 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-mon[36614]: Reconfiguring daemon mgr.x on smithi031 2024-06-02T22:24:20.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.469+0000 7f1764400700 1 -- 172.21.15.31:0/2693364899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c105910 msgr2=0x7f175c107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.469+0000 7f1764400700 1 --2- 172.21.15.31:0/2693364899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c105910 0x7f175c107d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1748009990 tx=0x7f1748009ca0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 -- 172.21.15.31:0/2693364899 shutdown_connections 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 --2- 172.21.15.31:0/2693364899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c108240 0x7f175c10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 --2- 172.21.15.31:0/2693364899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c102fe0 0x7f175c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 --2- 172.21.15.31:0/2693364899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c105910 0x7f175c107d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 -- 172.21.15.31:0/2693364899 >> 172.21.15.31:0/2693364899 conn(0x7f175c0fc990 msgr2=0x7f175c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 -- 172.21.15.31:0/2693364899 shutdown_connections 2024-06-02T22:24:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.470+0000 7f1764400700 1 -- 172.21.15.31:0/2693364899 wait complete. 2024-06-02T22:24:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 Processor -- start 2024-06-02T22:24:20.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 -- start start 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 0x7f175c102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c108240 0x7f175c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f175c10e0c0 con 0x7f175c102fe0 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f175c10df40 con 0x7f175c108240 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.471+0000 7f1764400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f175c10e240 con 0x7f175c105910 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 0x7f175c102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:36794/0 (socket says 172.21.15.31:36794) 2024-06-02T22:24:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 -- 172.21.15.31:0/2069333055 learned_addr learned my addr 172.21.15.31:0/2069333055 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1762400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c108240 0x7f175c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 -- 172.21.15.31:0/2069333055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c108240 msgr2=0x7f175c1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c108240 0x7f175c1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 -- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 msgr2=0x7f175c102940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 0x7f175c102940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761000700 1 -- 172.21.15.31:0/2069333055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c101d80 con 0x7f175c105910 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.472+0000 7f1761a00700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 0x7f175c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f1761000700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17480098e0 tx=0x7f174800bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748027070 con 0x7f175c105910 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1748003d70 con 0x7f175c105910 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174800f460 con 0x7f175c105910 2024-06-02T22:24:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c1a2890 con 0x7f175c105910 2024-06-02T22:24:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.473+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c1a2ce0 con 0x7f175c105910 2024-06-02T22:24:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.474+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c069180 con 0x7f175c105910 2024-06-02T22:24:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.475+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1748009d10 con 0x7f175c105910 2024-06-02T22:24:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.476+0000 7f175a000700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 0x7f174403b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.476+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f174804dbf0 con 0x7f175c105910 2024-06-02T22:24:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.476+0000 7f1761a00700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 0x7f174403b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.477+0000 7f1761a00700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 0x7f174403b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1750009480 tx=0x7f175000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.480+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1748031070 con 0x7f175c105910 2024-06-02T22:24:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:20.731+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f175c0628d0 con 0x7f1744039330 2024-06-02T22:24:20.803 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:20.464+0000 7fe72e672200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:24:20.803 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:20.558+0000 7fe72e672200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:24:20.902 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:20.611+0000 7f990a52d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T22:24:20.903 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:20.703+0000 7f990a52d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T22:24:20.903 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:20.902+0000 7f990a52d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T22:24:21.061 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:20.802+0000 7fe72e672200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:24:21.061 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:20.938+0000 7fe72e672200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:24:21.062 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:21.033+0000 7fe72e672200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:24:21.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:21.090+0000 7f990a52d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T22:24:21.452 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:21.151+0000 7fe72e672200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:24:21.452 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:21.451+0000 7fe72e672200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:24:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-mon[36614]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-mon[36614]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:21.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:21.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:21.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:21.952 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:21 smithi031 ceph-mon[31767]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:21.952 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:21 smithi031 ceph-mon[31767]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:21.952 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:21.952 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:21.952 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:21.962 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:21.683+0000 7f990a52d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T22:24:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-mon[36750]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-mon[36750]: from='client.24121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:21.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:22.311 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:22.058+0000 7fe72e672200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:24:22.311 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:24:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z[38460]: 2024-06-02T22:24:22.279+0000 7fe72e672200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:24:22.392 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:22.098+0000 7f990a52d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T22:24:22.393 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:22.194+0000 7f990a52d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T22:24:22.393 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:22.392+0000 7f990a52d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T22:24:23.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:22.908+0000 7f990a52d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T22:24:23.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:22.998+0000 7f990a52d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T22:24:23.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:23.292+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f174804c500 con 0x7f175c105910 2024-06-02T22:24:23.513 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:23.513 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.513 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: Standby manager daemon z started 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:23.514 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: Standby manager daemon z started 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:23.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:23.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:23.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.574 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:23.236+0000 7f990a52d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:23.368+0000 7f990a52d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:23.460+0000 7f990a52d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:23.574+0000 7f990a52d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: Standby manager daemon z started 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T22:24:23.575 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.178:0/2418150892' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:23.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:23.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:23.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:23.576 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:24.212 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:23.869+0000 7f990a52d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T22:24:24.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:24 smithi178 ceph-mon[36614]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-02T22:24:24.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:24 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T22:24:24.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:24 smithi031 ceph-mon[31767]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-02T22:24:24.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:24 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T22:24:24.675 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:24.462+0000 7f990a52d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T22:24:24.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:24 smithi098 ceph-mon[36750]: mgrmap e14: x(active, since 89s), standbys: z 2024-06-02T22:24:24.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:24 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T22:24:24.962 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:24:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y[38134]: 2024-06-02T22:24:24.675+0000 7f990a52d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T22:24:25.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:25.328+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mon.1 v2:172.21.15.178:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f174802b3e0 con 0x7f175c105910 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: Standby manager daemon y started 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T22:24:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:25 smithi031 ceph-mon[31767]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:25.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: Standby manager daemon y started 2024-06-02T22:24:25.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T22:24:25.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:25.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T22:24:25.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:25 smithi098 ceph-mon[36750]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: Standby manager daemon y started 2024-06-02T22:24:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T22:24:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T22:24:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T22:24:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:25 smithi178 ceph-mon[36614]: from='mgr.? 172.21.15.98:0/4270627050' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T22:24:26.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2973604639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]': finished 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T22:24:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:26 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:26.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-06-02T22:24:26.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T22:24:26.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2973604639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]': finished 2024-06-02T22:24:26.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T22:24:26.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:26 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2973604639' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]: dispatch 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2e6dbbc-b92f-48c1-a685-7b8927abae1f"}]': finished 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T22:24:26.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:26 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:27.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:27 smithi178 ceph-mon[36614]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:27.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:27 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2677490382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:27.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:27 smithi031 ceph-mon[31767]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:27.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:27 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2677490382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:27.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:27 smithi098 ceph-mon[36750]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:27.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:27 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2677490382' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:29.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:29 smithi031 ceph-mon[31767]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:29.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:29 smithi098 ceph-mon[36750]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:29 smithi178 ceph-mon[36614]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:31.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:31 smithi031 ceph-mon[31767]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:31.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:31 smithi098 ceph-mon[36750]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:31.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:31 smithi178 ceph-mon[36614]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:33.613 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:33 smithi178 ceph-mon[36614]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:33 smithi031 ceph-mon[31767]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:33 smithi098 ceph-mon[36750]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:35 smithi031 ceph-mon[31767]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T22:24:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:35 smithi031 ceph-mon[31767]: Deploying daemon osd.0 on smithi031 2024-06-02T22:24:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:35 smithi098 ceph-mon[36750]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T22:24:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:35.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:35 smithi098 ceph-mon[36750]: Deploying daemon osd.0 on smithi031 2024-06-02T22:24:35.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:35 smithi178 ceph-mon[36614]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:35.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T22:24:35.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:35.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:35 smithi178 ceph-mon[36614]: Deploying daemon osd.0 on smithi031 2024-06-02T22:24:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:37 smithi031 ceph-mon[31767]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:37 smithi098 ceph-mon[36750]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:37.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:37 smithi178 ceph-mon[36614]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:39.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:39 smithi031 ceph-mon[31767]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:39 smithi098 ceph-mon[36750]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:39.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:39 smithi178 ceph-mon[36614]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:41 smithi031 ceph-mon[31767]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:41 smithi098 ceph-mon[36750]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:41 smithi178 ceph-mon[36614]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:43 smithi031 ceph-mon[31767]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:43 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:43 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:43 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:43 smithi098 ceph-mon[36750]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:43 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:43 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:43 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:43.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:43 smithi178 ceph-mon[36614]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:43.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:43 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:43 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:43.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:43 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:45 smithi098 ceph-mon[36750]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:45.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:45 smithi178 ceph-mon[36614]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:45.812 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:45 smithi031 ceph-mon[31767]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:47.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:47.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:47.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:47.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:47.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:47.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:47.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:48.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.078+0000 7f175a000700 1 -- 172.21.15.31:0/2069333055 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f175c0628d0 con 0x7f1744039330 2024-06-02T22:24:48.079 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 0 on host 'smithi031' 2024-06-02T22:24:48.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 msgr2=0x7f174403b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:48.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 0x7f174403b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1750009480 tx=0x7f175000b040 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 msgr2=0x7f175c100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f17480098e0 tx=0x7f174800bbb0 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 shutdown_connections 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1744039330 0x7f174403b7f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f175c108240 0x7f175c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c102fe0 0x7f175c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 --2- 172.21.15.31:0/2069333055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f175c105910 0x7f175c100f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 >> 172.21.15.31:0/2069333055 conn(0x7f175c0fc990 msgr2=0x7f175c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 shutdown_connections 2024-06-02T22:24:48.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:24:48.082+0000 7f1764400700 1 -- 172.21.15.31:0/2069333055 wait complete. 2024-06-02T22:24:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:47 smithi098 ceph-mon[36750]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:47 smithi098 ceph-mon[36750]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:47 smithi098 ceph-mon[36750]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:47 smithi178 ceph-mon[36614]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:47 smithi178 ceph-mon[36614]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:47 smithi178 ceph-mon[36614]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:47 smithi031 ceph-mon[31767]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:47 smithi031 ceph-mon[31767]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:47 smithi031 ceph-mon[31767]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T22:24:48.956 DEBUG:teuthology.orchestra.run.smithi031:osd.0> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.0.service 2024-06-02T22:24:48.961 INFO:tasks.cephadm:Deploying osd.1 on smithi098 with /dev/vg_nvme/lv_4... 2024-06-02T22:24:48.961 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T22:24:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T22:24:49.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:49.215 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T22:24:49.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T22:24:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:50.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:49 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:49 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.133 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T22:24:51.133 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T22:24:51.134 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-06-02T22:24:51.134 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-06-02T22:24:51.134 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116203 s, 902 MB/s 2024-06-02T22:24:51.134 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-06-02T22:24:51.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:24:51.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:24:51.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] boot 2024-06-02T22:24:51.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T22:24:51.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:50 smithi178 ceph-mon[36614]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] boot 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:50 smithi031 ceph-mon[31767]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:51.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: osd.0 [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] boot 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T22:24:51.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:50 smithi098 ceph-mon[36750]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T22:24:51.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-06-02T22:24:51.986 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:24:52.101 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:51 smithi098 ceph-mon[36750]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T22:24:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:51 smithi178 ceph-mon[36614]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T22:24:52.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:51 smithi031 ceph-mon[31767]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T22:24:53.025 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:52 smithi098 ceph-mon[36750]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:53.239 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:52 smithi031 ceph-mon[31767]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:52 smithi178 ceph-mon[36614]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- 172.21.15.98:0/1455288256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598102fb0 msgr2=0x7f8598109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 --2- 172.21.15.98:0/1455288256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598102fb0 0x7f8598109860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f859000b0d0 tx=0x7f859000b3e0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- 172.21.15.98:0/1455288256 shutdown_connections 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 --2- 172.21.15.98:0/1455288256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598102fb0 0x7f8598109860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 --2- 172.21.15.98:0/1455288256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8598101410 0x7f8598101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 --2- 172.21.15.98:0/1455288256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f8598102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- 172.21.15.98:0/1455288256 >> 172.21.15.98:0/1455288256 conn(0x7f85980fc9f0 msgr2=0x7f85980fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- 172.21.15.98:0/1455288256 shutdown_connections 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- 172.21.15.98:0/1455288256 wait complete. 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 Processor -- start 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 -- start start 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.489+0000 7f859d500700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f859819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8598102fb0 0x7f859819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f859810d090 con 0x7f8598102fb0 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f859810cf10 con 0x7f8598101410 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f859810d210 con 0x7f8598102610 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:53.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58758/0 (socket says 172.21.15.98:58758) 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 -- 172.21.15.98:0/2780372920 learned_addr learned my addr 172.21.15.98:0/2780372920 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f85967fc700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f859819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 -- 172.21.15.98:0/2780372920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 msgr2=0x7f859819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f859819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 -- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8598102fb0 msgr2=0x7f859819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8598102fb0 0x7f859819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 -- 172.21.15.98:0/2780372920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85981a0380 con 0x7f8598101410 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f85967fc700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f859819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f8596ffd700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f858800b500 tx=0x7f858800b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588015020 con 0x7f8598101410 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85981a0670 con 0x7f8598101410 2024-06-02T22:24:53.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8588011d10 con 0x7f8598101410 2024-06-02T22:24:53.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858800f2e0 con 0x7f8598101410 2024-06-02T22:24:53.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.490+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85981a0bb0 con 0x7f8598101410 2024-06-02T22:24:53.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.491+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8598069180 con 0x7f8598101410 2024-06-02T22:24:53.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.492+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f8588018020 con 0x7f8598101410 2024-06-02T22:24:53.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.493+0000 7f857ffff700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 0x7f85800a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:24:53.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.493+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f85880ccdb0 con 0x7f8598101410 2024-06-02T22:24:53.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.493+0000 7f85967fc700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 0x7f85800a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:24:53.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.495+0000 7f85967fc700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 0x7f85800a5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f859806bce0 tx=0x7f858c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:24:53.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.498+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f858801f020 con 0x7f8598101410 2024-06-02T22:24:53.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:24:53.700+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f85980628d0 con 0x7f85800a2b90 2024-06-02T22:24:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:53 smithi178 ceph-mon[36614]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:54.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:54.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:54.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:53 smithi098 ceph-mon[36750]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:54.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:54.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:54.328 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:53 smithi031 ceph-mon[31767]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:24:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:24:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:24:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:55.388 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:55.388 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi031 2024-06-02T22:24:55.388 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 17094M 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:55.389 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi031 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 17094M 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:55.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:55.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi031 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 17094M 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:24:55.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:24:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/1392853362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]': finished 2024-06-02T22:24:57.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T22:24:57.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:24:57.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:57 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/2033490079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:57.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:57.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/1392853362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]': finished 2024-06-02T22:24:57.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T22:24:57.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:24:57.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:57 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/2033490079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:57.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:57.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/1392853362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]: dispatch 2024-06-02T22:24:57.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16a77b57-663a-4221-97c9-5548c8b17528"}]': finished 2024-06-02T22:24:57.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T22:24:57.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:24:57.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:57 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/2033490079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:24:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:24:59 smithi098 ceph-mon[36750]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:59.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:24:59 smithi178 ceph-mon[36614]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:24:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:24:59 smithi031 ceph-mon[31767]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:01.461 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:01 smithi098 ceph-mon[36750]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:01.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:01 smithi178 ceph-mon[36614]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:01.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:01 smithi031 ceph-mon[31767]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:03.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:03 smithi098 ceph-mon[36750]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:03.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:03 smithi178 ceph-mon[36614]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:03.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:03 smithi031 ceph-mon[31767]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:04.341 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T22:25:04.341 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:04.341 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:04 smithi098 ceph-mon[36750]: Deploying daemon osd.1 on smithi098 2024-06-02T22:25:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T22:25:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:04 smithi178 ceph-mon[36614]: Deploying daemon osd.1 on smithi098 2024-06-02T22:25:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T22:25:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:04 smithi031 ceph-mon[31767]: Deploying daemon osd.1 on smithi098 2024-06-02T22:25:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:05 smithi098 ceph-mon[36750]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:05.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:05 smithi178 ceph-mon[36614]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:05.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:05 smithi031 ceph-mon[31767]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:07.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:07 smithi031 ceph-mon[31767]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:07.448 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:07 smithi098 ceph-mon[36750]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:07.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:07 smithi178 ceph-mon[36614]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:09 smithi098 ceph-mon[36750]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:09.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:09 smithi178 ceph-mon[36614]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:09.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:09.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:09.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:09.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:09 smithi031 ceph-mon[31767]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:09.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:09.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:09.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.700 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:11.701 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.701 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.701 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:11.701 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:11.701 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:11.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:11.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:11.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:11.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:11.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:11.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:11.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:12.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.343+0000 7f857ffff700 1 -- 172.21.15.98:0/2780372920 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f85980628d0 con 0x7f85800a2b90 2024-06-02T22:25:12.344 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 1 on host 'smithi098' 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 msgr2=0x7f85800a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 0x7f85800a5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f859806bce0 tx=0x7f858c009260 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 msgr2=0x7f859806b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f858800b500 tx=0x7f858800b8c0 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 shutdown_connections 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f85800a2b90 0x7f85800a5050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8598102fb0 0x7f859819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8598101410 0x7f859806b780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 --2- 172.21.15.98:0/2780372920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8598102610 0x7f859819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 >> 172.21.15.98:0/2780372920 conn(0x7f85980fc9f0 msgr2=0x7f8598105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:25:12.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.345+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 shutdown_connections 2024-06-02T22:25:12.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:25:12.346+0000 7f859d500700 1 -- 172.21.15.98:0/2780372920 wait complete. 2024-06-02T22:25:13.035 DEBUG:teuthology.orchestra.run.smithi098:osd.1> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.1.service 2024-06-02T22:25:13.037 INFO:tasks.cephadm:Deploying osd.2 on smithi178 with /dev/vg_nvme/lv_4... 2024-06-02T22:25:13.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T22:25:13.279 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:13.567 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:13 smithi178 ceph-mon[36614]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:13 smithi031 ceph-mon[31767]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:13.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:13 smithi098 ceph-mon[36750]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T22:25:14.678 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:14 smithi178 ceph-mon[36614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T22:25:14.678 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:14 smithi178 ceph-mon[36614]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:14.678 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:14 smithi178 ceph-mon[36614]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T22:25:14.678 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:14.678 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:14 smithi178 ceph-mon[36614]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-mon[36750]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T22:25:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-mon[36750]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-mon[36750]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T22:25:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-mon[36750]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:14.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:14 smithi031 ceph-mon[31767]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T22:25:14.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:14 smithi031 ceph-mon[31767]: from='osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:14.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:14 smithi031 ceph-mon[31767]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T22:25:14.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:14.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:14 smithi031 ceph-mon[31767]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:25:15.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1[41300]: 2024-06-02T22:25:14.904+0000 7f7314f7e700 -1 osd.1 0 waiting for initial osdmap 2024-06-02T22:25:15.213 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1[41300]: 2024-06-02T22:25:14.907+0000 7f730cd69700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00861288 s, 1.2 GB/s 2024-06-02T22:25:15.232 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-02T22:25:15.459 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:15 smithi178 ceph-mon[36614]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:15.477 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:15 smithi098 ceph-mon[36750]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:15.478 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:15 smithi098 ceph-mon[36750]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:25:15.478 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:15 smithi098 ceph-mon[36750]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T22:25:15.478 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:15.478 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:15 smithi098 ceph-mon[36750]: from='osd.1 ' entity='osd.1' 2024-06-02T22:25:15.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:15 smithi178 ceph-mon[36614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:25:15.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:15 smithi178 ceph-mon[36614]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T22:25:15.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:15.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:15 smithi178 ceph-mon[36614]: from='osd.1 ' entity='osd.1' 2024-06-02T22:25:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:15 smithi031 ceph-mon[31767]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:15 smithi031 ceph-mon[31767]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:25:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:15 smithi031 ceph-mon[31767]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T22:25:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:15 smithi031 ceph-mon[31767]: from='osd.1 ' entity='osd.1' 2024-06-02T22:25:15.890 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2024-06-02T22:25:16.136 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] boot 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.511 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.512 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:16.512 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.512 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:16.512 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:16.512 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] boot 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:25:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:25:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: osd.1 [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] boot 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:16.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:17.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- 172.21.15.178:0/1374300119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 msgr2=0x7f41ac102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:17.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 --2- 172.21.15.178:0/1374300119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac102910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f419c009990 tx=0x7f419c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- 172.21.15.178:0/1374300119 shutdown_connections 2024-06-02T22:25:17.569 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 --2- 172.21.15.178:0/1374300119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac104090 0x7f41ac10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 --2- 172.21.15.178:0/1374300119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac102910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 --2- 172.21.15.178:0/1374300119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac1036f0 0x7f41ac103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- 172.21.15.178:0/1374300119 >> 172.21.15.178:0/1374300119 conn(0x7f41ac0fda90 msgr2=0x7f41ac0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- 172.21.15.178:0/1374300119 shutdown_connections 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- 172.21.15.178:0/1374300119 wait complete. 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 Processor -- start 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.567+0000 7f41b23fc700 1 -- start start 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac1036f0 0x7f41ac074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac104090 0x7f41ac074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:17.570 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac10e140 con 0x7f41ac1036f0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac10dfc0 con 0x7f41ac104090 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac10e2c0 con 0x7f41ac1024f0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:56394/0 (socket says 172.21.15.178:56394) 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 -- 172.21.15.178:0/4027793870 learned_addr learned my addr 172.21.15.178:0/4027793870 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 -- 172.21.15.178:0/4027793870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac104090 msgr2=0x7f41ac074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac104090 0x7f41ac074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 -- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac1036f0 msgr2=0x7f41ac074880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac1036f0 0x7f41ac074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 -- 172.21.15.178:0/4027793870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac075670 con 0x7f41ac1024f0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41abfff700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098e0 tx=0x7f419c009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c027070 con 0x7f41ac1024f0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f419c004150 con 0x7f41ac1024f0 2024-06-02T22:25:17.571 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c00f6c0 con 0x7f41ac1024f0 2024-06-02T22:25:17.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.568+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41ac1a2850 con 0x7f41ac1024f0 2024-06-02T22:25:17.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.569+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ac1a2cd0 con 0x7f41ac1024f0 2024-06-02T22:25:17.572 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.570+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41ac02dca0 con 0x7f41ac1024f0 2024-06-02T22:25:17.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.571+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f419c02a070 con 0x7f41ac1024f0 2024-06-02T22:25:17.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.571+0000 7f41a97fa700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 0x7f41940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:17.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.572+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f419c0ce900 con 0x7f41ac1024f0 2024-06-02T22:25:17.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.572+0000 7f41ab7fe700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 0x7f41940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:17.573 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.573+0000 7f41ab7fe700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 0x7f41940a50d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41a00097b0 tx=0x7f41a0006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:25:17.577 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.576+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f419c05e850 con 0x7f41ac1024f0 2024-06-02T22:25:17.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:17.779+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f41ac0628d0 con 0x7f41940a2c10 2024-06-02T22:25:17.780 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:17 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi098 2024-06-02T22:25:17.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:17 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 17088M 2024-06-02T22:25:17.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:17 smithi178 ceph-mon[36614]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:17.781 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:17 smithi178 ceph-mon[36614]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T22:25:17.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:17 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi098 2024-06-02T22:25:17.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:17 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 17088M 2024-06-02T22:25:17.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:17 smithi031 ceph-mon[31767]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:17.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:17 smithi031 ceph-mon[31767]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T22:25:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:17 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi098 2024-06-02T22:25:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:17 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 17088M 2024-06-02T22:25:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:17 smithi098 ceph-mon[36750]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T22:25:17.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:17 smithi098 ceph-mon[36750]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T22:25:18.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:18 smithi178 ceph-mon[36614]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:18.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:18.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:18.709 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:18.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:18 smithi031 ceph-mon[31767]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:18.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:18.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:18.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:18 smithi098 ceph-mon[36750]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:18.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:18.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:19.623 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:19 smithi178 ceph-mon[36614]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:19.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:19 smithi031 ceph-mon[31767]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:19 smithi098 ceph-mon[36750]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:20.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:20 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/2500689981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:20 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:20 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]': finished 2024-06-02T22:25:20.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:20 smithi178 ceph-mon[36614]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T22:25:20.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:20.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:20 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/2500689981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:20 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:20 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]': finished 2024-06-02T22:25:20.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:20 smithi031 ceph-mon[31767]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T22:25:20.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:20 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/2500689981' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:20 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]: dispatch 2024-06-02T22:25:20.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:20 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce3e9128-3ac7-4e85-a8d0-5d39b8808e03"}]': finished 2024-06-02T22:25:20.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:20 smithi098 ceph-mon[36750]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T22:25:20.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:21 smithi178 ceph-mon[36614]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:21 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/2862106397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:21 smithi031 ceph-mon[31767]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:21 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/2862106397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:21 smithi098 ceph-mon[36750]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:21 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/2862106397' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:23 smithi178 ceph-mon[36614]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:23.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:23 smithi031 ceph-mon[31767]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:23 smithi098 ceph-mon[36750]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:25.717 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:25 smithi178 ceph-mon[36614]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:25 smithi031 ceph-mon[31767]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:25.902 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:25 smithi098 ceph-mon[36750]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:27.753 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:27 smithi178 ceph-mon[36614]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:27.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:27 smithi031 ceph-mon[31767]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:27 smithi098 ceph-mon[36750]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:28.747 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:28 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T22:25:28.747 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:28 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:28.748 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:28 smithi178 ceph-mon[36614]: Deploying daemon osd.2 on smithi178 2024-06-02T22:25:28.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:28 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T22:25:28.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:28 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:28.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:28 smithi031 ceph-mon[31767]: Deploying daemon osd.2 on smithi178 2024-06-02T22:25:28.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:28 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T22:25:28.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:28 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:28.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:28 smithi098 ceph-mon[36750]: Deploying daemon osd.2 on smithi178 2024-06-02T22:25:29.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:29 smithi178 ceph-mon[36614]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:29.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:29 smithi031 ceph-mon[31767]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:29 smithi098 ceph-mon[36750]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:31.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:31 smithi178 ceph-mon[36614]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:31.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:31 smithi031 ceph-mon[31767]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:31 smithi098 ceph-mon[36750]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:33 smithi178 ceph-mon[36614]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:33.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:33.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:33.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:33 smithi031 ceph-mon[31767]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:33 smithi098 ceph-mon[36750]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:35.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:35 smithi178 ceph-mon[36614]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:35 smithi031 ceph-mon[31767]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:35 smithi098 ceph-mon[36750]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:37.071 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.071+0000 7f41a97fa700 1 -- 172.21.15.178:0/4027793870 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f41ac0628d0 con 0x7f41940a2c10 2024-06-02T22:25:37.072 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 2 on host 'smithi178' 2024-06-02T22:25:37.073 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 msgr2=0x7f41940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 0x7f41940a50d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41a00097b0 tx=0x7f41a0006d20 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 msgr2=0x7f41ac076230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f419c0098e0 tx=0x7f419c009ee0 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 shutdown_connections 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f41940a2c10 0x7f41940a50d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41ac104090 0x7f41ac074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ac1024f0 0x7f41ac076230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 --2- 172.21.15.178:0/4027793870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41ac1036f0 0x7f41ac074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 >> 172.21.15.178:0/4027793870 conn(0x7f41ac0fda90 msgr2=0x7f41ac1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 shutdown_connections 2024-06-02T22:25:37.074 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:25:37.074+0000 7f41b23fc700 1 -- 172.21.15.178:0/4027793870 wait complete. 2024-06-02T22:25:37.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:37 smithi178 ceph-mon[36614]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:37.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:37 smithi098 ceph-mon[36750]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:37 smithi031 ceph-mon[31767]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T22:25:37.760 DEBUG:teuthology.orchestra.run.smithi178:osd.2> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.2.service 2024-06-02T22:25:37.763 INFO:tasks.cephadm:Deploying osd.3 on smithi031 with /dev/vg_nvme/lv_3... 2024-06-02T22:25:37.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T22:25:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.248 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-mon[36614]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:39.248 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2[41728]: 2024-06-02T22:25:39.055+0000 7ff76badc700 -1 osd.2 0 waiting for initial osdmap 2024-06-02T22:25:39.249 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2[41728]: 2024-06-02T22:25:39.058+0000 7ff7678cf700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:25:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T22:25:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T22:25:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:39 smithi031 ceph-mon[31767]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T22:25:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: from='osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T22:25:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:25:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:39 smithi098 ceph-mon[36750]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T22:25:40.166 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:40 smithi031 ceph-mon[31767]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:25:40.166 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:40 smithi031 ceph-mon[31767]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T22:25:40.167 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:40 smithi178 ceph-mon[36614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:25:40.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:40 smithi178 ceph-mon[36614]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T22:25:40.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:40 smithi098 ceph-mon[36750]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:25:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:40 smithi098 ceph-mon[36750]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T22:25:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] boot 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi178 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.161 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T22:25:41.162 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T22:25:41.162 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2024-06-02T22:25:41.162 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2024-06-02T22:25:41.162 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0334646 s, 313 MB/s 2024-06-02T22:25:41.162 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2024-06-02T22:25:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] boot 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi178 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-02T22:25:41.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:41.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:41.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: osd.2 [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] boot 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi178 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 17088M 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:41.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:41.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:25:41.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:42.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_3 2024-06-02T22:25:42.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:42 smithi031 ceph-mon[31767]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T22:25:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:42 smithi098 ceph-mon[36750]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T22:25:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:42.467 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:25:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:42 smithi178 ceph-mon[36614]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T22:25:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:25:43.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:43 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:43.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:43 smithi031 ceph-mon[31767]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T22:25:43.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:43 smithi031 ceph-mon[31767]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:43 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:43 smithi098 ceph-mon[36750]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T22:25:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:43 smithi098 ceph-mon[36750]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:43.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:43 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:25:43.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:43 smithi178 ceph-mon[36614]: osdmap e20: 3 total, 3 up, 3 in 2024-06-02T22:25:43.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:43 smithi178 ceph-mon[36614]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:43.779 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:43 smithi031 sudo[50754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:43.779 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:43 smithi031 sudo[50754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:43.779 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:43 smithi031 sudo[50754]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:43.779 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:43 smithi031 sudo[50754]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:44.343 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:44 smithi031 ceph-mon[31767]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T22:25:44.343 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:44 smithi031 sudo[50779]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:44.344 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:44 smithi031 sudo[50779]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:44.344 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:44 smithi031 sudo[50779]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:44.344 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:25:44 smithi031 sudo[50779]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:44 smithi098 ceph-mon[36750]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T22:25:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:44 smithi178 ceph-mon[36614]: osdmap e21: 3 total, 3 up, 3 in 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 -- 172.21.15.31:0/867821412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c074ef0 msgr2=0x7f6e7c075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 --2- 172.21.15.31:0/867821412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c075370 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009990 tx=0x7f6e64009ca0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 -- 172.21.15.31:0/867821412 shutdown_connections 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 --2- 172.21.15.31:0/867821412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c110ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 --2- 172.21.15.31:0/867821412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 --2- 172.21.15.31:0/867821412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c075370 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 -- 172.21.15.31:0/867821412 >> 172.21.15.31:0/867821412 conn(0x7f6e7c0fda90 msgr2=0x7f6e7c0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:25:44.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.691+0000 7f6e82c00700 1 -- 172.21.15.31:0/867821412 shutdown_connections 2024-06-02T22:25:44.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.692+0000 7f6e82c00700 1 -- 172.21.15.31:0/867821412 wait complete. 2024-06-02T22:25:44.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 Processor -- start 2024-06-02T22:25:44.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 -- start start 2024-06-02T22:25:44.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:44.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:44.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c1a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c114740 con 0x7f6e7c10ead0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1145c0 con 0x7f6e7c0764c0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.693+0000 7f6e82c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1148c0 con 0x7f6e7c074ef0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55334/0 (socket says 172.21.15.31:55334) 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 -- 172.21.15.31:0/237936963 learned_addr learned my addr 172.21.15.31:0/237936963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e7be00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e80c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c1a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 -- 172.21.15.31:0/237936963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 msgr2=0x7f6e7c19ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c19ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 -- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 msgr2=0x7f6e7c1a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:25:44.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c1a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:25:44.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 -- 172.21.15.31:0/237936963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c1a6a20 con 0x7f6e7c0764c0 2024-06-02T22:25:44.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e7be00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:25:44.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e80c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c1a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:25:44.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.694+0000 7f6e73e00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400b8e0 tx=0x7f6e6400bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.695+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64026070 con 0x7f6e7c0764c0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.695+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e6400f460 con 0x7f6e7c0764c0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.695+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64021630 con 0x7f6e7c0764c0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.695+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c1a6cb0 con 0x7f6e7c0764c0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.695+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c1a70b0 con 0x7f6e7c0764c0 2024-06-02T22:25:44.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.696+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7c0691c0 con 0x7f6e7c0764c0 2024-06-02T22:25:44.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.698+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f6e64029070 con 0x7f6e7c0764c0 2024-06-02T22:25:44.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.699+0000 7f6e79600700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 0x7f6e600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:25:44.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.699+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f6e640ceab0 con 0x7f6e7c0764c0 2024-06-02T22:25:44.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.699+0000 7f6e7be00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 0x7f6e600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:25:44.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.700+0000 7f6e7be00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 0x7f6e600a50d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0768a0 tx=0x7f6e6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:25:44.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.703+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e6405d850 con 0x7f6e7c0764c0 2024-06-02T22:25:44.745 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44992]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:44.745 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44992]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:44.745 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44992]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:44.745 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44992]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:44.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:44.947+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6e7c0628d0 con 0x7f6e600a2c10 2024-06-02T22:25:45.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:25:45.109+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6e64009d10 con 0x7f6e7c0764c0 2024-06-02T22:25:45.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44995]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:45.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44995]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:45.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44995]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:45.212 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:25:44 smithi098 sudo[44995]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:45.296 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45763]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:45.296 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45763]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:45.296 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45763]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:45.296 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45763]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:45.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:45.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:45.296 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:45.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:45.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:45.297 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:45 smithi178 ceph-mon[36614]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:45.475 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:45 smithi098 ceph-mon[36750]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T22:25:45.561 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45766]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:45.561 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45766]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:45.561 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45766]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:45.561 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:25:45 smithi178 sudo[45766]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:45.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 ceph-mon[31767]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-06-02T22:25:46.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 sudo[50925]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:46.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 sudo[50925]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:46.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 sudo[50925]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:46.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:45 smithi031 sudo[50925]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:46.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:46 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:46.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:46 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:46.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 sudo[50945]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:46.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 sudo[50945]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:46.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 sudo[50945]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:46.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 sudo[50945]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:46.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:46.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:46 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:46.768 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:25:46.768 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 sudo[45770]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:47.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 sudo[45770]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:47.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 sudo[45770]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:47.020 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:46 smithi178 sudo[45770]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:47.020 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 sudo[45773]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:47.020 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 sudo[45773]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:47.020 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 sudo[45773]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:47.020 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 sudo[45773]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:47.509 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T22:25:47.509 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:47.509 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45010]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:47.509 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45010]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.763 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:47 smithi031 ceph-mon[31767]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.813 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.813 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:47 smithi178 ceph-mon[36614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45013]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45013]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45013]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 sudo[45013]: pam_unix(sudo:session): session closed for user root 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T22:25:47.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:47 smithi098 ceph-mon[36750]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T22:25:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:49 smithi178 ceph-mon[36614]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]: dispatch 2024-06-02T22:25:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]': finished 2024-06-02T22:25:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:49 smithi178 ceph-mon[36614]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T22:25:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:49 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:25:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:49 smithi031 ceph-mon[31767]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:49.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]: dispatch 2024-06-02T22:25:49.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]': finished 2024-06-02T22:25:49.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:49 smithi031 ceph-mon[31767]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T22:25:49.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:49 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:25:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:49 smithi098 ceph-mon[36750]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]: dispatch 2024-06-02T22:25:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2980500412' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d77d2d54-6910-4ed7-83b0-35edc54a34d1"}]': finished 2024-06-02T22:25:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:49 smithi098 ceph-mon[36750]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T22:25:49.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:49 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:25:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:50 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/273685139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:50 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/273685139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:50 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/273685139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:25:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:51 smithi031 ceph-mon[31767]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:51.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:51 smithi178 ceph-mon[36614]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:51 smithi098 ceph-mon[36750]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:25:53.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:53 smithi178 ceph-mon[36614]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-06-02T22:25:53.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:53 smithi031 ceph-mon[31767]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-06-02T22:25:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:53 smithi098 ceph-mon[36750]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-06-02T22:25:55.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:55 smithi178 ceph-mon[36614]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T22:25:55.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:55 smithi031 ceph-mon[31767]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T22:25:55.896 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:55 smithi098 ceph-mon[36750]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-06-02T22:25:57.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:57 smithi178 ceph-mon[36614]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T22:25:57.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:57 smithi031 ceph-mon[31767]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T22:25:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:57 smithi098 ceph-mon[36750]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-06-02T22:25:58.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T22:25:58.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T22:25:58.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:59.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T22:25:59.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:25:59.741 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:59 smithi031 ceph-mon[31767]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T22:25:59.741 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:25:59 smithi031 ceph-mon[31767]: Deploying daemon osd.3 on smithi031 2024-06-02T22:25:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:59 smithi098 ceph-mon[36750]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T22:25:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:25:59 smithi098 ceph-mon[36750]: Deploying daemon osd.3 on smithi031 2024-06-02T22:26:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:59 smithi178 ceph-mon[36614]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-02T22:26:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:25:59 smithi178 ceph-mon[36614]: Deploying daemon osd.3 on smithi031 2024-06-02T22:26:01.666 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:01 smithi031 ceph-mon[31767]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 826 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-02T22:26:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:01 smithi098 ceph-mon[36750]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 826 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-02T22:26:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:01 smithi178 ceph-mon[36614]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 826 B/s rd, 24 KiB/s wr, 2 op/s 2024-06-02T22:26:03.744 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:03 smithi031 ceph-mon[31767]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T22:26:03.863 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:03 smithi178 ceph-mon[36614]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T22:26:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:03 smithi098 ceph-mon[36750]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-06-02T22:26:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:05 smithi031 ceph-mon[31767]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:05 smithi098 ceph-mon[36750]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:06.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:05 smithi178 ceph-mon[36614]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:07 smithi098 ceph-mon[36750]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:08.220 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:07 smithi031 ceph-mon[31767]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:08.220 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.220 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.220 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:07 smithi178 ceph-mon[36614]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:08.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:09 smithi098 ceph-mon[36750]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:10.233 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:09 smithi031 ceph-mon[31767]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:09 smithi178 ceph-mon[36614]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:11.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.554+0000 7f6e79600700 1 -- 172.21.15.31:0/237936963 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6e7c0628d0 con 0x7f6e600a2c10 2024-06-02T22:26:11.556 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 3 on host 'smithi031' 2024-06-02T22:26:11.556 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:11 smithi031 ceph-mon[31767]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:11.556 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.556 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.556 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:11 smithi031 ceph-mon[31767]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:11.556 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:11 smithi031 ceph-mon[31767]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:11.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 msgr2=0x7f6e600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:11.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 0x7f6e600a50d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0768a0 tx=0x7f6e6c009260 comp rx=0 tx=0).stop 2024-06-02T22:26:11.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 msgr2=0x7f6e7c19f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:11.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400b8e0 tx=0x7f6e6400bc40 comp rx=0 tx=0).stop 2024-06-02T22:26:11.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 shutdown_connections 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e600a2c10 0x7f6e600a50d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e7c10ead0 0x7f6e7c1a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.558+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7c074ef0 0x7f6e7c19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.559+0000 7f6e82c00700 1 --2- 172.21.15.31:0/237936963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e7c0764c0 0x7f6e7c19f350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.559+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 >> 172.21.15.31:0/237936963 conn(0x7f6e7c0fda90 msgr2=0x7f6e7c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.559+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 shutdown_connections 2024-06-02T22:26:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:26:11.559+0000 7f6e82c00700 1 -- 172.21.15.31:0/237936963 wait complete. 2024-06-02T22:26:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:11 smithi178 ceph-mon[36614]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:11 smithi178 ceph-mon[36614]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:11 smithi178 ceph-mon[36614]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:11 smithi098 ceph-mon[36750]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:11 smithi098 ceph-mon[36750]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:11 smithi098 ceph-mon[36750]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T22:26:12.312 DEBUG:teuthology.orchestra.run.smithi031:osd.3> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.3.service 2024-06-02T22:26:12.317 INFO:tasks.cephadm:Deploying osd.4 on smithi098 with /dev/vg_nvme/lv_3... 2024-06-02T22:26:12.317 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T22:26:12.559 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:26:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:12 smithi178 ceph-mon[36614]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:12.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:12 smithi031 ceph-mon[31767]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:12.672 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:12.672 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:12.672 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:12.673 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:12 smithi098 ceph-mon[36750]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:26:13.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:13 smithi178 ceph-mon[36614]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:13 smithi178 ceph-mon[36614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:26:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:13 smithi178 ceph-mon[36614]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T22:26:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-mon[31767]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-mon[31767]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:26:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-mon[31767]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T22:26:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:13 smithi098 ceph-mon[36750]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-06-02T22:26:13.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:13 smithi098 ceph-mon[36750]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:26:13.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:13 smithi098 ceph-mon[36750]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T22:26:13.675 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.676 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:13.982 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:26:13.620+0000 7f23d7000700 -1 osd.3 0 waiting for initial osdmap 2024-06-02T22:26:13.982 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:26:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:26:13.649+0000 7f23cce00700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:26:14.645 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T22:26:14.645 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T22:26:14.646 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-06-02T22:26:14.646 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-06-02T22:26:14.646 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0152918 s, 686 MB/s 2024-06-02T22:26:14.646 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-06-02T22:26:14.745 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:26:14.745 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:26:14.745 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: from='osd.3 ' entity='osd.3' 2024-06-02T22:26:14.746 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] boot 2024-06-02T22:26:14.746 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T22:26:14.746 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:14.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:26:14.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:26:14.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: from='osd.3 ' entity='osd.3' 2024-06-02T22:26:14.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] boot 2024-06-02T22:26:14.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T22:26:14.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:15.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:26:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:26:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: from='osd.3 ' entity='osd.3' 2024-06-02T22:26:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: osd.3 [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] boot 2024-06-02T22:26:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T22:26:15.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T22:26:15.305 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-06-02T22:26:15.548 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:26:15.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:15 smithi098 ceph-mon[36750]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:15.923 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:15 smithi098 ceph-mon[36750]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T22:26:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:15 smithi178 ceph-mon[36614]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:15 smithi178 ceph-mon[36614]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T22:26:16.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:15 smithi031 ceph-mon[31767]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:16.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:15 smithi031 ceph-mon[31767]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 -- 172.21.15.98:0/4014858002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3048102f80 msgr2=0x7f3048109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 --2- 172.21.15.98:0/4014858002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3048102f80 0x7f3048109830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f304000b0d0 tx=0x7f304000b3e0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 -- 172.21.15.98:0/4014858002 shutdown_connections 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 --2- 172.21.15.98:0/4014858002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3048102f80 0x7f3048109830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 --2- 172.21.15.98:0/4014858002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 0x7f3048101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 --2- 172.21.15.98:0/4014858002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30481025e0 0x7f3048102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 -- 172.21.15.98:0/4014858002 >> 172.21.15.98:0/4014858002 conn(0x7f30480fc980 msgr2=0x7f30480fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:26:17.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 -- 172.21.15.98:0/4014858002 shutdown_connections 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.192+0000 7f304fbab700 1 -- 172.21.15.98:0/4014858002 wait complete. 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 Processor -- start 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 -- start start 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 0x7f3048198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3048102f80 0x7f304819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f304810d0c0 con 0x7f3048102f80 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f304810cf40 con 0x7f30481025e0 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304fbab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f304810d240 con 0x7f30481013e0 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47954/0 (socket says 172.21.15.98:47954) 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 -- 172.21.15.98:0/1840090302 learned_addr learned my addr 172.21.15.98:0/1840090302 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-06-02T22:26:17.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d947700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 0x7f3048198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 -- 172.21.15.98:0/1840090302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 msgr2=0x7f3048198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 0x7f3048198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 -- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3048102f80 msgr2=0x7f304819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3048102f80 0x7f304819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.193+0000 7f304d146700 1 -- 172.21.15.98:0/1840090302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30481a0480 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f304d146700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f304400b530 tx=0x7f304400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044015020 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30481a0770 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3044011d10 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304400f2e0 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.194+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30481a0d80 con 0x7f30481025e0 2024-06-02T22:26:17.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.195+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3048069180 con 0x7f30481025e0 2024-06-02T22:26:17.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.196+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3044018020 con 0x7f30481025e0 2024-06-02T22:26:17.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.196+0000 7f303effd700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 0x7f30340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:17.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.196+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f30440cdba0 con 0x7f30481025e0 2024-06-02T22:26:17.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.197+0000 7f304d947700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 0x7f30340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:17.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.198+0000 7f304d947700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 0x7f30340a50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3038006fd0 tx=0x7f3038008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:26:17.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.200+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f304401f020 con 0x7f30481025e0 2024-06-02T22:26:17.200 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:16 smithi098 ceph-mon[36750]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T22:26:17.200 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:16 smithi098 ceph-mon[36750]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:17.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:16 smithi178 ceph-mon[36614]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T22:26:17.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:16 smithi178 ceph-mon[36614]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:17.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:16 smithi031 ceph-mon[31767]: osdmap e27: 4 total, 4 up, 4 in 2024-06-02T22:26:17.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:16 smithi031 ceph-mon[31767]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:17.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:17.403+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f30480feb50 con 0x7f30340a2c20 2024-06-02T22:26:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi031 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 8547M 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:18 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.317 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi031 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 8547M 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:18.318 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:18 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: osdmap e28: 4 total, 4 up, 4 in 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi031 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 8547M 2024-06-02T22:26:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:18.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:18.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:18.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:18 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:19.240 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:19 smithi098 ceph-mon[36750]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T22:26:19.240 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:19 smithi098 ceph-mon[36750]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:26:19.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:19 smithi178 ceph-mon[36614]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T22:26:19.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:19 smithi178 ceph-mon[36614]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:26:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:19 smithi031 ceph-mon[31767]: osdmap e29: 4 total, 4 up, 4 in 2024-06-02T22:26:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:19 smithi031 ceph-mon[31767]: pgmap v121: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:26:20.433 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:20 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/4063952426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.434 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:20 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.434 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:20 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]': finished 2024-06-02T22:26:20.434 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:20 smithi098 ceph-mon[36750]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T22:26:20.434 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:20 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:20 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/4063952426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:20 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:20 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]': finished 2024-06-02T22:26:20.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:20 smithi178 ceph-mon[36614]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T22:26:20.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:20 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:20 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/4063952426' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:20 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]: dispatch 2024-06-02T22:26:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:20 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "947b323e-fd09-4b93-a09f-e5096507d984"}]': finished 2024-06-02T22:26:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:20 smithi031 ceph-mon[31767]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T22:26:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:20 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:21.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:21 smithi098 ceph-mon[36750]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-06-02T22:26:21.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:21 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/2916260486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:21.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:21 smithi178 ceph-mon[36614]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-06-02T22:26:21.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:21 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/2916260486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:21 smithi031 ceph-mon[31767]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-06-02T22:26:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:21 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/2916260486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:23.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:23 smithi098 ceph-mon[36750]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:26:23.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:23 smithi178 ceph-mon[36614]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:26:23.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:23 smithi031 ceph-mon[31767]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:26:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:25 smithi098 ceph-mon[36750]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:25.424 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:25 smithi031 ceph-mon[31767]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:25.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:25 smithi178 ceph-mon[36614]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:27 smithi031 ceph-mon[31767]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:27.412 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:27 smithi098 ceph-mon[36750]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:27.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:27 smithi178 ceph-mon[36614]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:28.424 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:28 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T22:26:28.424 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:28 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:28.424 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:28 smithi098 ceph-mon[36750]: Deploying daemon osd.4 on smithi098 2024-06-02T22:26:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:28 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T22:26:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:28 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:28.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:28 smithi178 ceph-mon[36614]: Deploying daemon osd.4 on smithi098 2024-06-02T22:26:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:28 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T22:26:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:28 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:28 smithi031 ceph-mon[31767]: Deploying daemon osd.4 on smithi098 2024-06-02T22:26:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:29 smithi098 ceph-mon[36750]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:29.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:29 smithi178 ceph-mon[36614]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:29.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:29 smithi031 ceph-mon[31767]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:31.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:31 smithi098 ceph-mon[36750]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:31.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:31 smithi178 ceph-mon[36614]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:31.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:31 smithi031 ceph-mon[31767]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:33 smithi098 ceph-mon[36750]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:34.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:34.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:34.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:33 smithi178 ceph-mon[36614]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:34.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:34.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:34.265 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:33 smithi031 ceph-mon[31767]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:36.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.740+0000 7f303effd700 1 -- 172.21.15.98:0/1840090302 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f30480feb50 con 0x7f30340a2c20 2024-06-02T22:26:36.741 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 4 on host 'smithi098' 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 msgr2=0x7f30340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 0x7f30340a50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3038006fd0 tx=0x7f3038008040 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 msgr2=0x7f3048198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f304400b530 tx=0x7f304400b8f0 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 shutdown_connections 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30340a2c20 0x7f30340a50e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.742+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3048102f80 0x7f304819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.743+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30481013e0 0x7f3048198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.743+0000 7f304fbab700 1 --2- 172.21.15.98:0/1840090302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30481025e0 0x7f3048198d60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.743+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 >> 172.21.15.98:0/1840090302 conn(0x7f30480fc980 msgr2=0x7f30480fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.743+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 shutdown_connections 2024-06-02T22:26:36.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:26:36.743+0000 7f304fbab700 1 -- 172.21.15.98:0/1840090302 wait complete. 2024-06-02T22:26:37.406 DEBUG:teuthology.orchestra.run.smithi098:osd.4> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.4.service 2024-06-02T22:26:37.408 INFO:tasks.cephadm:Deploying osd.5 on smithi178 with /dev/vg_nvme/lv_3... 2024-06-02T22:26:37.408 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T22:26:37.651 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:26:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:37.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:37.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:37 smithi098 ceph-mon[36750]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:38.019 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:37 smithi178 ceph-mon[36614]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:37 smithi031 ceph-mon[31767]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T22:26:38.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:38 smithi098 ceph-mon[36750]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T22:26:38.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:38 smithi098 ceph-mon[36750]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:38.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:38 smithi098 ceph-mon[36750]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T22:26:38.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:38.806 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:38 smithi098 ceph-mon[36750]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:38 smithi178 ceph-mon[36614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T22:26:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:38 smithi178 ceph-mon[36614]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:38 smithi178 ceph-mon[36614]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T22:26:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:38 smithi178 ceph-mon[36614]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:39.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:38 smithi031 ceph-mon[31767]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T22:26:39.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:38 smithi031 ceph-mon[31767]: from='osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:39.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:38 smithi031 ceph-mon[31767]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T22:26:39.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:39.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:38 smithi031 ceph-mon[31767]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:26:39.462 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:26:39.126+0000 7ffabb5f6700 -1 osd.4 0 waiting for initial osdmap 2024-06-02T22:26:39.463 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:26:39.132+0000 7ffab2be0700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00834206 s, 1.3 GB/s 2024-06-02T22:26:39.835 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-02T22:26:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:26:39.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T22:26:39.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:39.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:39.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:39 smithi098 ceph-mon[36750]: from='osd.4 ' entity='osd.4' 2024-06-02T22:26:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:26:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T22:26:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:39 smithi178 ceph-mon[36614]: from='osd.4 ' entity='osd.4' 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: osdmap e32: 5 total, 4 up, 5 in 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:39 smithi031 ceph-mon[31767]: from='osd.4 ' entity='osd.4' 2024-06-02T22:26:40.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2024-06-02T22:26:40.723 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:26:40.974 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] boot 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:40.975 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:26:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:26:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] boot 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:41.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:26:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:26:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:41.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: osd.4 [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] boot 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:41.214 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:41.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:26:41.215 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:42.013 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:41 smithi178 ceph-mon[36614]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:42.013 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:41 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi098 2024-06-02T22:26:42.013 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:41 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 8544M 2024-06-02T22:26:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:41 smithi031 ceph-mon[31767]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:41 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi098 2024-06-02T22:26:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:41 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 8544M 2024-06-02T22:26:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:41 smithi098 ceph-mon[36750]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T22:26:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:41 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi098 2024-06-02T22:26:42.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:41 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 8544M 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 -- 172.21.15.178:0/2363204599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48101410 msgr2=0x7f6a48101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 --2- 172.21.15.178:0/2363204599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48101410 0x7f6a48101830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009990 tx=0x7f6a38009ca0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 -- 172.21.15.178:0/2363204599 shutdown_connections 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 --2- 172.21.15.178:0/2363204599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 0x7f6a48109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 --2- 172.21.15.178:0/2363204599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48101410 0x7f6a48101830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 --2- 172.21.15.178:0/2363204599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a48102610 0x7f6a48102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.250+0000 7f6a4e217700 1 -- 172.21.15.178:0/2363204599 >> 172.21.15.178:0/2363204599 conn(0x7f6a480fc9f0 msgr2=0x7f6a480fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- 172.21.15.178:0/2363204599 shutdown_connections 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- 172.21.15.178:0/2363204599 wait complete. 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 Processor -- start 2024-06-02T22:26:42.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- start start 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a48101410 0x7f6a4806b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 0x7f6a4819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810d070 con 0x7f6a48101410 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810cef0 con 0x7f6a48102fb0 2024-06-02T22:26:42.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.251+0000 7f6a4e217700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810d1f0 con 0x7f6a48102610 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51594/0 (socket says 172.21.15.178:51594) 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 -- 172.21.15.178:0/1850496948 learned_addr learned my addr 172.21.15.178:0/1850496948 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 -- 172.21.15.178:0/1850496948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 msgr2=0x7f6a4819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a47fff700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 0x7f6a4819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 0x7f6a4819fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 -- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a48101410 msgr2=0x7f6a4806b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a48101410 0x7f6a4806b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 -- 172.21.15.178:0/1850496948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a481a03e0 con 0x7f6a48102610 2024-06-02T22:26:42.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a46ffd700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b530 tx=0x7f6a3c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c015020 con 0x7f6a48102610 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a3c011d10 con 0x7f6a48102610 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a481a06d0 con 0x7f6a48102610 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c010e50 con 0x7f6a48102610 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.252+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a0c90 con 0x7f6a48102610 2024-06-02T22:26:42.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.253+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a48069180 con 0x7f6a48102610 2024-06-02T22:26:42.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.254+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6a3c018020 con 0x7f6a48102610 2024-06-02T22:26:42.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.255+0000 7f6a44ff9700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 0x7f6a300a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:26:42.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.255+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f6a3c0cdd90 con 0x7f6a48102610 2024-06-02T22:26:42.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.256+0000 7f6a477fe700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 0x7f6a300a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:26:42.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.256+0000 7f6a477fe700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 0x7f6a300a5280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098e0 tx=0x7f6a38005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:26:42.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.259+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a3c01f020 con 0x7f6a48102610 2024-06-02T22:26:42.463 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:26:42.462+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6a480628d0 con 0x7f6a300a2dc0 2024-06-02T22:26:43.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:42 smithi178 ceph-mon[36614]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T22:26:43.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:43.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:43.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:42 smithi031 ceph-mon[31767]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T22:26:43.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:43.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:43.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:42 smithi098 ceph-mon[36750]: osdmap e34: 5 total, 5 up, 5 in 2024-06-02T22:26:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:26:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:26:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:43 smithi178 ceph-mon[36614]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:44.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:43 smithi178 ceph-mon[36614]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:43 smithi031 ceph-mon[31767]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:43 smithi031 ceph-mon[31767]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:43 smithi098 ceph-mon[36750]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:43 smithi098 ceph-mon[36750]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:26:46.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:46.014 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/794259281' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.015 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.015 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]': finished 2024-06-02T22:26:46.015 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T22:26:46.015 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/794259281' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]': finished 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T22:26:46.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/794259281' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]: dispatch 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d33c02c1-01bb-4a7c-ab07-14be9d3bafb0"}]': finished 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T22:26:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:26:47.030 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:46 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/1730751584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:47.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:46 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/1730751584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:47.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:46 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/1730751584' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:26:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:47 smithi178 ceph-mon[36614]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:47 smithi031 ceph-mon[31767]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:48.200 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:47 smithi098 ceph-mon[36750]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:49 smithi178 ceph-mon[36614]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:50.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:49 smithi031 ceph-mon[31767]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:49 smithi098 ceph-mon[36750]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:51 smithi178 ceph-mon[36614]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:52.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:51 smithi031 ceph-mon[31767]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:51 smithi098 ceph-mon[36750]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:53.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T22:26:53.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:53.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T22:26:53.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T22:26:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:26:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:53 smithi178 ceph-mon[36614]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:53 smithi178 ceph-mon[36614]: Deploying daemon osd.5 on smithi178 2024-06-02T22:26:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:53 smithi031 ceph-mon[31767]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:53 smithi031 ceph-mon[31767]: Deploying daemon osd.5 on smithi178 2024-06-02T22:26:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:53 smithi098 ceph-mon[36750]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:53 smithi098 ceph-mon[36750]: Deploying daemon osd.5 on smithi178 2024-06-02T22:26:56.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:55 smithi178 ceph-mon[36614]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:55 smithi031 ceph-mon[31767]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:55 smithi098 ceph-mon[36750]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:57 smithi098 ceph-mon[36750]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:57 smithi178 ceph-mon[36614]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:57 smithi031 ceph-mon[31767]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:26:59.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:59.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:59.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:59.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:59.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:59.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:26:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:26:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:26:59 smithi178 ceph-mon[36614]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:26:59 smithi031 ceph-mon[31767]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:26:59 smithi098 ceph-mon[36750]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:02.044 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:02.453 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.453+0000 7f6a44ff9700 1 -- 172.21.15.178:0/1850496948 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6a480628d0 con 0x7f6a300a2dc0 2024-06-02T22:27:02.453 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 5 on host 'smithi178' 2024-06-02T22:27:02.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 msgr2=0x7f6a300a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:02.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 0x7f6a300a5280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098e0 tx=0x7f6a38005fb0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 msgr2=0x7f6a4819d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:02.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00b530 tx=0x7f6a3c00b8f0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.455 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 shutdown_connections 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a300a2dc0 0x7f6a300a5280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48102fb0 0x7f6a4819fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a48101410 0x7f6a4806b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 --2- 172.21.15.178:0/1850496948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a48102610 0x7f6a4819d480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.455+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 >> 172.21.15.178:0/1850496948 conn(0x7f6a480fc9f0 msgr2=0x7f6a48105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.456+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 shutdown_connections 2024-06-02T22:27:02.456 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:27:02.456+0000 7f6a4e217700 1 -- 172.21.15.178:0/1850496948 wait complete. 2024-06-02T22:27:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:02 smithi178 ceph-mon[36614]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:02 smithi178 ceph-mon[36614]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:03.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.112 DEBUG:teuthology.orchestra.run.smithi178:osd.5> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.5.service 2024-06-02T22:27:03.115 INFO:tasks.cephadm:Deploying osd.6 on smithi031 with /dev/vg_nvme/lv_2... 2024-06-02T22:27:03.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T22:27:03.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:02 smithi031 ceph-mon[31767]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:02 smithi031 ceph-mon[31767]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:03.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:02 smithi098 ceph-mon[36750]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:02 smithi098 ceph-mon[36750]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T22:27:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:03.593 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:04.040 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:03 smithi031 ceph-mon[31767]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T22:27:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T22:27:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:03 smithi098 ceph-mon[36750]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: from='osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:04.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:03 smithi178 ceph-mon[36614]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:27:04.561 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:27:04.275+0000 7f1119b73700 -1 osd.5 0 waiting for initial osdmap 2024-06-02T22:27:04.562 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:27:04.282+0000 7f111115d700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:27:05.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-mon[36614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:27:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-mon[36614]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T22:27:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:04 smithi178 ceph-mon[36614]: from='osd.5 ' entity='osd.5' 2024-06-02T22:27:05.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:04 smithi031 ceph-mon[31767]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:27:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:04 smithi031 ceph-mon[31767]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T22:27:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:04 smithi031 ceph-mon[31767]: from='osd.5 ' entity='osd.5' 2024-06-02T22:27:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:04 smithi098 ceph-mon[36750]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:27:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:04 smithi098 ceph-mon[36750]: osdmap e37: 6 total, 5 up, 6 in 2024-06-02T22:27:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:04 smithi098 ceph-mon[36750]: from='osd.5 ' entity='osd.5' 2024-06-02T22:27:06.038 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] boot 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:06.039 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:05 smithi178 ceph-mon[36614]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] boot 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:05 smithi031 ceph-mon[31767]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: osd.5 [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] boot 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T22:27:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T22:27:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:05 smithi098 ceph-mon[36750]: osdmap e39: 6 total, 6 up, 6 in 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.036479 s, 287 MB/s 2024-06-02T22:27:06.476 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi178 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:07.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:07.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:07.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:07 smithi031 ceph-mon[31767]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T22:27:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi178 2024-06-02T22:27:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:07.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:07 smithi098 ceph-mon[36750]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T22:27:07.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_2 2024-06-02T22:27:07.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi178 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 8544M 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:07.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:07 smithi178 ceph-mon[36614]: osdmap e40: 6 total, 6 up, 6 in 2024-06-02T22:27:07.983 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:27:08.400 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:08 smithi031 ceph-mon[31767]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T22:27:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:08 smithi178 ceph-mon[36614]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T22:27:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:08 smithi098 ceph-mon[36750]: osdmap e41: 6 total, 6 up, 6 in 2024-06-02T22:27:09.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:09 smithi031 ceph-mon[31767]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:27:09.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:09 smithi031 ceph-mon[31767]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T22:27:09.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:09 smithi178 ceph-mon[36614]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:27:09.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:09 smithi178 ceph-mon[36614]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T22:27:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:09 smithi098 ceph-mon[36750]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-02T22:27:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:09 smithi098 ceph-mon[36750]: osdmap e42: 6 total, 6 up, 6 in 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 -- 172.21.15.31:0/1989000980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 msgr2=0x7f6ac8107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 --2- 172.21.15.31:0/1989000980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac8107ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009990 tx=0x7f6ab0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 -- 172.21.15.31:0/1989000980 shutdown_connections 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 --2- 172.21.15.31:0/1989000980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac81081e0 0x7f6ac810a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 --2- 172.21.15.31:0/1989000980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac8102f80 0x7f6ac8105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 --2- 172.21.15.31:0/1989000980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac8107ca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 -- 172.21.15.31:0/1989000980 >> 172.21.15.31:0/1989000980 conn(0x7f6ac80fc990 msgr2=0x7f6ac80fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:27:10.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 -- 172.21.15.31:0/1989000980 shutdown_connections 2024-06-02T22:27:10.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.298+0000 7f6accc00700 1 -- 172.21.15.31:0/1989000980 wait complete. 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.299+0000 7f6accc00700 1 Processor -- start 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 -- start start 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac8102f80 0x7f6ac819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac81081e0 0x7f6ac81a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac810e100 con 0x7f6ac8102f80 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac810df80 con 0x7f6ac81081e0 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6accc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac810e280 con 0x7f6ac81058b0 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6abd400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6ac5e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac8102f80 0x7f6ac819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:10.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6abd400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50110/0 (socket says 172.21.15.31:50110) 2024-06-02T22:27:10.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.300+0000 7f6abd400700 1 -- 172.21.15.31:0/1777957976 learned_addr learned my addr 172.21.15.31:0/1777957976 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:27:10.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6ac6800700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac81081e0 0x7f6ac81a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:10.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 -- 172.21.15.31:0/1777957976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac81081e0 msgr2=0x7f6ac81a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac81081e0 0x7f6ac81a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 -- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac8102f80 msgr2=0x7f6ac819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac8102f80 0x7f6ac819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 -- 172.21.15.31:0/1777957976 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac81a2580 con 0x7f6ac81058b0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.301+0000 7f6abd400700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.302+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0027070 con 0x7f6ac81058b0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.302+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ab0003d70 con 0x7f6ac81058b0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.302+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac81a2810 con 0x7f6ac81058b0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.302+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000f460 con 0x7f6ac81058b0 2024-06-02T22:27:10.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.302+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac81a2c60 con 0x7f6ac81058b0 2024-06-02T22:27:10.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.303+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8069180 con 0x7f6ac81058b0 2024-06-02T22:27:10.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.305+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6ab002a070 con 0x7f6ac81058b0 2024-06-02T22:27:10.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.306+0000 7f6abf400700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 0x7f6aac0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:10.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.306+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4533+0+0 (secure 0 0 0) 0x7f6ab00cf480 con 0x7f6ac81058b0 2024-06-02T22:27:10.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.307+0000 7f6ac5e00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 0x7f6aac0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:10.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.307+0000 7f6ac5e00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 0x7f6aac0a50e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800f540 tx=0x7f6ab800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:27:10.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.309+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6ab0013070 con 0x7f6ac81058b0 2024-06-02T22:27:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:10.549+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6ac80628d0 con 0x7f6aac0a2c20 2024-06-02T22:27:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:11 smithi098 ceph-mon[36750]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T22:27:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:11 smithi098 ceph-mon[36750]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:11.553 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:11 smithi031 ceph-mon[31767]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T22:27:11.553 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:11 smithi031 ceph-mon[31767]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:11.553 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:11.553 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:11.554 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:11 smithi178 ceph-mon[36614]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-06-02T22:27:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:11 smithi178 ceph-mon[36614]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:11.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:11.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:11.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:13.504 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:13 smithi031 ceph-mon[31767]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:27:13.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:13 smithi178 ceph-mon[36614]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:27:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:13 smithi098 ceph-mon[36750]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:27:15.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:15 smithi178 ceph-mon[36614]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T22:27:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:15 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]: dispatch 2024-06-02T22:27:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:15 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]': finished 2024-06-02T22:27:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:15 smithi178 ceph-mon[36614]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T22:27:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:15 smithi031 ceph-mon[31767]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T22:27:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:15 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]: dispatch 2024-06-02T22:27:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:15 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]': finished 2024-06-02T22:27:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:15 smithi031 ceph-mon[31767]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T22:27:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:15.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:15 smithi098 ceph-mon[36750]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T22:27:15.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:15 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]: dispatch 2024-06-02T22:27:15.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:15 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1789790229' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "453bcd2d-d571-44c6-8bb1-dc611d2a5e0b"}]': finished 2024-06-02T22:27:15.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:15 smithi098 ceph-mon[36750]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T22:27:15.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:16 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/4177583190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:16.613 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:16 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/4177583190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:16.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:16 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/4177583190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:17.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:17 smithi178 ceph-mon[36614]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:17.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:17 smithi031 ceph-mon[31767]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:17.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:17 smithi098 ceph-mon[36750]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:19.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:19 smithi178 ceph-mon[36614]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:19.588 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:19 smithi031 ceph-mon[31767]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:19 smithi098 ceph-mon[36750]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:21.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:21 smithi031 ceph-mon[31767]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:21.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:21 smithi178 ceph-mon[36614]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:21.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:21 smithi098 ceph-mon[36750]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:23.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:23 smithi031 ceph-mon[31767]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:23.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:23 smithi178 ceph-mon[36614]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:23.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:23 smithi098 ceph-mon[36750]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:25.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:25 smithi178 ceph-mon[36614]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:25.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T22:27:25.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:25.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:25 smithi178 ceph-mon[36614]: Deploying daemon osd.6 on smithi031 2024-06-02T22:27:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:25 smithi031 ceph-mon[31767]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T22:27:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:25 smithi031 ceph-mon[31767]: Deploying daemon osd.6 on smithi031 2024-06-02T22:27:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:25 smithi098 ceph-mon[36750]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T22:27:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:25 smithi098 ceph-mon[36750]: Deploying daemon osd.6 on smithi031 2024-06-02T22:27:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:27 smithi031 ceph-mon[31767]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:27.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:27 smithi178 ceph-mon[36614]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:27.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:27 smithi098 ceph-mon[36750]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:29.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:29 smithi178 ceph-mon[36614]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:29.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:29 smithi031 ceph-mon[31767]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:29.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:29 smithi098 ceph-mon[36750]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:31.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:31 smithi178 ceph-mon[36614]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:31.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:31 smithi031 ceph-mon[31767]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:31.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:31 smithi098 ceph-mon[36750]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:33.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:33 smithi178 ceph-mon[36614]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:33 smithi031 ceph-mon[31767]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:33 smithi098 ceph-mon[36750]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:34.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:34.724 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.724 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:34.725 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:35.617 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:35 smithi031 ceph-mon[31767]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:35.661 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:35 smithi178 ceph-mon[36614]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:35 smithi098 ceph-mon[36750]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:37.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:37 smithi031 ceph-mon[31767]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:37 smithi098 ceph-mon[36750]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:37.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:37 smithi178 ceph-mon[36614]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:38 smithi031 ceph-mon[31767]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:38 smithi031 ceph-mon[31767]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:38 smithi098 ceph-mon[36750]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:38 smithi098 ceph-mon[36750]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:38 smithi178 ceph-mon[36614]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:38 smithi178 ceph-mon[36614]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T22:27:38.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.861+0000 7f6abf400700 1 -- 172.21.15.31:0/1777957976 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6ac80628d0 con 0x7f6aac0a2c20 2024-06-02T22:27:38.861 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 6 on host 'smithi031' 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 msgr2=0x7f6aac0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 0x7f6aac0a50e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800f540 tx=0x7f6ab800b040 comp rx=0 tx=0).stop 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 msgr2=0x7f6ac819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab000bbb0 comp rx=0 tx=0).stop 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 shutdown_connections 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6aac0a2c20 0x7f6aac0a50e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ac81081e0 0x7f6ac81a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac8102f80 0x7f6ac819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:38.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 --2- 172.21.15.31:0/1777957976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac81058b0 0x7f6ac819ae60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:38.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 >> 172.21.15.31:0/1777957976 conn(0x7f6ac80fc990 msgr2=0x7f6ac8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:27:38.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.865+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 shutdown_connections 2024-06-02T22:27:38.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:27:38.866+0000 7f6accc00700 1 -- 172.21.15.31:0/1777957976 wait complete. 2024-06-02T22:27:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T22:27:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T22:27:39.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:39.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.719 DEBUG:teuthology.orchestra.run.smithi031:osd.6> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.6.service 2024-06-02T22:27:39.725 INFO:tasks.cephadm:Deploying osd.7 on smithi098 with /dev/vg_nvme/lv_2... 2024-06-02T22:27:39.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T22:27:39.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: osdmap e44: 7 total, 6 up, 7 in 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:39.970 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:27:40.474 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:27:40.535 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:27:40.535 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:27:40.536 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T22:27:40.536 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:40.536 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:27:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:27:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:27:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T22:27:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:40.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:40.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:27:40.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:27:40.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:27:40.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: osdmap e45: 7 total, 6 up, 7 in 2024-06-02T22:27:40.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:40.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:41 smithi031 ceph-mon[31767]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:41 smithi031 ceph-mon[31767]: osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] boot 2024-06-02T22:27:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:41 smithi031 ceph-mon[31767]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T22:27:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:41 smithi098 ceph-mon[36750]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:41.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:41 smithi098 ceph-mon[36750]: osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] boot 2024-06-02T22:27:41.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:41 smithi098 ceph-mon[36750]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T22:27:41.658 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:41 smithi178 ceph-mon[36614]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-06-02T22:27:41.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:41 smithi178 ceph-mon[36614]: osd.6 [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] boot 2024-06-02T22:27:41.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:41 smithi178 ceph-mon[36614]: osdmap e46: 7 total, 7 up, 7 in 2024-06-02T22:27:41.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T22:27:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T22:27:41.987 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T22:27:41.987 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-06-02T22:27:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-06-02T22:27:41.988 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.01188 s, 883 MB/s 2024-06-02T22:27:41.988 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-06-02T22:27:42.679 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:42 smithi098 ceph-mon[36750]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T22:27:42.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-06-02T22:27:42.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:42 smithi178 ceph-mon[36614]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T22:27:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:42 smithi031 ceph-mon[31767]: osdmap e47: 7 total, 7 up, 7 in 2024-06-02T22:27:42.945 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:27:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:43 smithi098 ceph-mon[36750]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:43.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:43 smithi178 ceph-mon[36614]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:43 smithi031 ceph-mon[31767]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1981966608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8102610 msgr2=0x7f9cb8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1981966608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8102610 0x7f9cb8102a70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0099c0 tx=0x7f9cac009cd0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1981966608 shutdown_connections 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1981966608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb8109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1981966608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8101410 0x7f9cb8101830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1981966608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8102610 0x7f9cb8102a70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1981966608 >> 172.21.15.98:0/1981966608 conn(0x7f9cb80fc9f0 msgr2=0x7f9cb80fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1981966608 shutdown_connections 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.628+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1981966608 wait complete. 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 Processor -- start 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 -- start start 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 0x7f9cb819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb810d070 con 0x7f9cb8102fb0 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb810cef0 con 0x7f9cb8101410 2024-06-02T22:27:44.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.629+0000 7f9cbe22b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb810d1f0 con 0x7f9cb8102610 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 0x7f9cb819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 0x7f9cb819d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.98:58966/0 (socket says 172.21.15.98:58966) 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb6ffd700 1 -- 172.21.15.98:0/1850237346 learned_addr learned my addr 172.21.15.98:0/1850237346 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33954/0 (socket says 172.21.15.98:33954) 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb7fff700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 -- 172.21.15.98:0/1850237346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 msgr2=0x7f9cb819d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 0x7f9cb819d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 -- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 msgr2=0x7f9cb819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:27:44.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 -- 172.21.15.98:0/1850237346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb81a03b0 con 0x7f9cb8101410 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb7fff700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb77fe700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800c940 tx=0x7f9ca800cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8004220 con 0x7f9cb8101410 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ca800ce30 con 0x7f9cb8101410 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb81972c0 con 0x7f9cb8101410 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8005020 con 0x7f9cb8101410 2024-06-02T22:27:44.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.630+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb8197830 con 0x7f9cb8101410 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.631+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb8069180 con 0x7f9cb8101410 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.632+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ca8007900 con 0x7f9cb8101410 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.633+0000 7f9cb4ff9700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 0x7f9ca00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.633+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f9ca80cde40 con 0x7f9cb8101410 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.633+0000 7f9cb6ffd700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 0x7f9ca00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:27:44.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.634+0000 7f9cb6ffd700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 0x7f9ca00a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9cb806bce0 tx=0x7f9cac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:27:44.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.638+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9ca8014030 con 0x7f9cb8101410 2024-06-02T22:27:44.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:27:44.842+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9cb80628d0 con 0x7f9ca00a2c20 2024-06-02T22:27:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:45.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.732 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.733 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:45.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:27:45.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:27:46.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:46 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi031 2024-06-02T22:27:46.466 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:46 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 5698M 2024-06-02T22:27:46.692 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:46 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi031 2024-06-02T22:27:46.692 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:46 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 5698M 2024-06-02T22:27:46.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:46 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi031 2024-06-02T22:27:46.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:46 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 5698M 2024-06-02T22:27:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:47 smithi098 ceph-mon[36750]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:47.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:47 smithi178 ceph-mon[36614]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:47.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:47 smithi031 ceph-mon[31767]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/2632563867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]': finished 2024-06-02T22:27:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T22:27:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:27:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:48 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/3986757293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:48.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/2632563867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]': finished 2024-06-02T22:27:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T22:27:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:27:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:48 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/3986757293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/2632563867' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]: dispatch 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6dd6941e-24c9-4b1d-8825-c33834a434da"}]': finished 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:27:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:48 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/3986757293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:27:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:49 smithi031 ceph-mon[31767]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:49 smithi098 ceph-mon[36750]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:49 smithi178 ceph-mon[36614]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:51.868 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:51 smithi098 ceph-mon[36750]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:51.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:51 smithi031 ceph-mon[31767]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:51 smithi178 ceph-mon[36614]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:53.805 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:53 smithi098 ceph-mon[36750]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:53.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:53 smithi031 ceph-mon[31767]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:53 smithi178 ceph-mon[36614]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:55.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:55 smithi031 ceph-mon[31767]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:55.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T22:27:55.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:55.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:55 smithi031 ceph-mon[31767]: Deploying daemon osd.7 on smithi098 2024-06-02T22:27:55.937 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:55 smithi098 ceph-mon[36750]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:55.937 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T22:27:55.937 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:55.937 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:55 smithi098 ceph-mon[36750]: Deploying daemon osd.7 on smithi098 2024-06-02T22:27:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:55 smithi178 ceph-mon[36614]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T22:27:56.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:27:56.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:55 smithi178 ceph-mon[36614]: Deploying daemon osd.7 on smithi098 2024-06-02T22:27:57.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:57 smithi031 ceph-mon[31767]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:57 smithi098 ceph-mon[36750]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:57 smithi178 ceph-mon[36614]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:59.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:27:59 smithi098 ceph-mon[36750]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:27:59.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:27:59 smithi031 ceph-mon[31767]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:27:59 smithi178 ceph-mon[36614]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:01 smithi098 ceph-mon[36750]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:01.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:01.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:01.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:01 smithi178 ceph-mon[36614]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:01 smithi031 ceph-mon[31767]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:03 smithi178 ceph-mon[36614]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:04.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:03 smithi031 ceph-mon[31767]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:03 smithi098 ceph-mon[36750]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.678 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 7 on host 'smithi098' 2024-06-02T22:28:04.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.677+0000 7f9cb4ff9700 1 -- 172.21.15.98:0/1850237346 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9cb80628d0 con 0x7f9ca00a2c20 2024-06-02T22:28:04.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.679+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 msgr2=0x7f9ca00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:04.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 0x7f9ca00a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9cb806bce0 tx=0x7f9cac005fb0 comp rx=0 tx=0).stop 2024-06-02T22:28:04.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 msgr2=0x7f9cb806b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:04.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800c940 tx=0x7f9ca800cc50 comp rx=0 tx=0).stop 2024-06-02T22:28:04.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 shutdown_connections 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9ca00a2c20 0x7f9ca00a50e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cb8102fb0 0x7f9cb819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cb8101410 0x7f9cb806b780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 --2- 172.21.15.98:0/1850237346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8102610 0x7f9cb819d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 >> 172.21.15.98:0/1850237346 conn(0x7f9cb80fc9f0 msgr2=0x7f9cb8105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 shutdown_connections 2024-06-02T22:28:04.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:28:04.680+0000 7f9cbe22b700 1 -- 172.21.15.98:0/1850237346 wait complete. 2024-06-02T22:28:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:04.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:05.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:05.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T22:28:05.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:05.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:05.357 DEBUG:teuthology.orchestra.run.smithi098:osd.7> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.7.service 2024-06-02T22:28:05.359 INFO:tasks.cephadm:Deploying osd.8 on smithi178 with /dev/vg_nvme/lv_2... 2024-06-02T22:28:05.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T22:28:05.607 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:28:05.868 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:05.868 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T22:28:05.868 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:05.868 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T22:28:05.869 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:05.869 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-mon[36750]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:05.869 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:28:05.754+0000 7f4c49c59700 -1 osd.7 0 waiting for initial osdmap 2024-06-02T22:28:05.869 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:28:05 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:28:05.763+0000 7f4c45a4c700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:28:06.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:06.032 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T22:28:06.032 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:06.032 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T22:28:06.032 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:06.032 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:05 smithi178 ceph-mon[36614]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: from='osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: osdmap e49: 8 total, 7 up, 8 in 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:05 smithi031 ceph-mon[31767]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:28:06.876 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:06 smithi098 ceph-mon[36750]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:28:06.876 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:06 smithi098 ceph-mon[36750]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T22:28:06.876 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:06 smithi178 ceph-mon[36614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:28:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:06 smithi178 ceph-mon[36614]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T22:28:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:07.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:06 smithi031 ceph-mon[31767]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:28:07.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:06 smithi031 ceph-mon[31767]: osdmap e50: 8 total, 7 up, 8 in 2024-06-02T22:28:07.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00849477 s, 1.2 GB/s 2024-06-02T22:28:07.658 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-02T22:28:07.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:28:07.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:28:07.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:07.954 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] boot 2024-06-02T22:28:07.955 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T22:28:07.955 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:07.955 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:07 smithi098 ceph-mon[36750]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T22:28:07.976 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] boot 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:07.977 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:07 smithi178 ceph-mon[36614]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T22:28:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:28:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:28:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-06-02T22:28:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: osd.7 [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] boot 2024-06-02T22:28:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: osdmap e51: 8 total, 8 up, 8 in 2024-06-02T22:28:08.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T22:28:08.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:07 smithi031 ceph-mon[31767]: osdmap e52: 8 total, 8 up, 8 in 2024-06-02T22:28:08.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2024-06-02T22:28:08.579 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:28:09.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:09.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi098 2024-06-02T22:28:09.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 5696M 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:09 smithi031 ceph-mon[31767]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T22:28:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi098 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 5696M 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:09 smithi098 ceph-mon[36750]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi098 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 5696M 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:09.736 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:09 smithi178 ceph-mon[36614]: osdmap e53: 8 total, 8 up, 8 in 2024-06-02T22:28:10.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 -- 172.21.15.178:0/3233477426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc788102f80 msgr2=0x7fc788109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:10.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 --2- 172.21.15.178:0/3233477426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc788102f80 0x7fc788109830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc78000b0a0 tx=0x7fc78000b3b0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 -- 172.21.15.178:0/3233477426 shutdown_connections 2024-06-02T22:28:10.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 --2- 172.21.15.178:0/3233477426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc788102f80 0x7fc788109830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.272 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 --2- 172.21.15.178:0/3233477426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc788101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 --2- 172.21.15.178:0/3233477426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7881025e0 0x7fc788102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 -- 172.21.15.178:0/3233477426 >> 172.21.15.178:0/3233477426 conn(0x7fc7880fc980 msgr2=0x7fc7880fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 -- 172.21.15.178:0/3233477426 shutdown_connections 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.270+0000 7fc78e099700 1 -- 172.21.15.178:0/3233477426 wait complete. 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 Processor -- start 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 -- start start 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc7881976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc788102f80 0x7fc78819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810d0c0 con 0x7fc788102f80 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810cf40 con 0x7fc7881013e0 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc78e099700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810d240 con 0x7fc7881025e0 2024-06-02T22:28:10.273 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:38962/0 (socket says 172.21.15.178:38962) 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 -- 172.21.15.178:0/2182446286 learned_addr learned my addr 172.21.15.178:0/2182446286 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc7877fe700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc7881976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 -- 172.21.15.178:0/2182446286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 msgr2=0x7fc7881976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc7881976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 -- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc788102f80 msgr2=0x7fc78819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc788102f80 0x7fc78819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc786ffd700 1 -- 172.21.15.178:0/2182446286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78819f330 con 0x7fc7881025e0 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.271+0000 7fc7877fe700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc7881976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc786ffd700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00b560 tx=0x7fc77c00b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c015020 con 0x7fc7881025e0 2024-06-02T22:28:10.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78819f620 con 0x7fc7881025e0 2024-06-02T22:28:10.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc77c011d10 con 0x7fc7881025e0 2024-06-02T22:28:10.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00f2e0 con 0x7fc7881025e0 2024-06-02T22:28:10.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.272+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78819fc30 con 0x7fc7881025e0 2024-06-02T22:28:10.275 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.273+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc774005360 con 0x7fc7881025e0 2024-06-02T22:28:10.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.274+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc77c018020 con 0x7fc7881025e0 2024-06-02T22:28:10.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.275+0000 7fc784ff9700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 0x7fc7700a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:10.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.275+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7fc77c0ce1b0 con 0x7fc7881025e0 2024-06-02T22:28:10.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.275+0000 7fc7877fe700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 0x7fc7700a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:10.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.276+0000 7fc7877fe700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 0x7fc7700a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc788102440 tx=0x7fc778008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:28:10.278 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.278+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc77c01f020 con 0x7fc7881025e0 2024-06-02T22:28:10.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:10.483+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc774000bf0 con 0x7fc7700a2c20 2024-06-02T22:28:11.383 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T22:28:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:11.384 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:11.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:11.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: osdmap e54: 8 total, 8 up, 8 in 2024-06-02T22:28:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:11.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:12.506 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:12 smithi178 ceph-mon[36614]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T22:28:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:12 smithi031 ceph-mon[31767]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T22:28:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:12 smithi098 ceph-mon[36750]: osdmap e55: 8 total, 8 up, 8 in 2024-06-02T22:28:13.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:13 smithi178 ceph-mon[36614]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:13.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:13 smithi031 ceph-mon[31767]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:13 smithi098 ceph-mon[36750]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/94746604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]': finished 2024-06-02T22:28:14.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T22:28:14.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:14.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:14 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/1272230327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/94746604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]': finished 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:14 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/1272230327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/94746604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]: dispatch 2024-06-02T22:28:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc697acf-ed41-4b2d-ae99-bfe3992cd0c7"}]': finished 2024-06-02T22:28:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T22:28:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:14.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:14 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/1272230327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:15 smithi031 ceph-mon[31767]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:15.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:15 smithi098 ceph-mon[36750]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:15.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:15 smithi178 ceph-mon[36614]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:17.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:17 smithi031 ceph-mon[31767]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:17.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:17 smithi098 ceph-mon[36750]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:17.722 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:17 smithi178 ceph-mon[36614]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:19.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:19 smithi031 ceph-mon[31767]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:19.621 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:19 smithi178 ceph-mon[36614]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:19.706 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:19 smithi098 ceph-mon[36750]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:21.632 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:21 smithi178 ceph-mon[36614]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:21.632 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T22:28:21.632 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:21.632 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:21 smithi178 ceph-mon[36614]: Deploying daemon osd.8 on smithi178 2024-06-02T22:28:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:21 smithi098 ceph-mon[36750]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T22:28:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:21 smithi098 ceph-mon[36750]: Deploying daemon osd.8 on smithi178 2024-06-02T22:28:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:21 smithi031 ceph-mon[31767]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T22:28:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:21 smithi031 ceph-mon[31767]: Deploying daemon osd.8 on smithi178 2024-06-02T22:28:23.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:23 smithi178 ceph-mon[36614]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:23.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:23 smithi098 ceph-mon[36750]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:23.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:23 smithi031 ceph-mon[31767]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:25.674 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:25 smithi031 ceph-mon[31767]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:25.676 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:25 smithi178 ceph-mon[36614]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:25 smithi098 ceph-mon[36750]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:27 smithi098 ceph-mon[36750]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:27 smithi178 ceph-mon[36614]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:28.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:28.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:27 smithi031 ceph-mon[31767]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:29 smithi178 ceph-mon[36614]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:29 smithi098 ceph-mon[36750]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:29 smithi031 ceph-mon[31767]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:30.675 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 8 on host 'smithi178' 2024-06-02T22:28:30.675 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.675+0000 7fc784ff9700 1 -- 172.21.15.178:0/2182446286 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc774000bf0 con 0x7fc7700a2c20 2024-06-02T22:28:30.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 msgr2=0x7fc7700a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 0x7fc7700a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc788102440 tx=0x7fc778008040 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 msgr2=0x7fc788197c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00b560 tx=0x7fc77c00b920 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 shutdown_connections 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7700a2c20 0x7fc7700a50e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc788102f80 0x7fc78819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7881013e0 0x7fc7881976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 --2- 172.21.15.178:0/2182446286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7881025e0 0x7fc788197c10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 >> 172.21.15.178:0/2182446286 conn(0x7fc7880fc980 msgr2=0x7fc7881058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 shutdown_connections 2024-06-02T22:28:30.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:28:30.677+0000 7fc78e099700 1 -- 172.21.15.178:0/2182446286 wait complete. 2024-06-02T22:28:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:31.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:31.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:31.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:31.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T22:28:31.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:31.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:28:31.388 DEBUG:teuthology.orchestra.run.smithi178:osd.8> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.8.service 2024-06-02T22:28:31.391 INFO:tasks.cephadm:Deploying osd.9 on smithi031 with /dev/vg_nvme/lv_1... 2024-06-02T22:28:31.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T22:28:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:32.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:31 smithi031 ceph-mon[31767]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T22:28:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T22:28:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:31 smithi178 ceph-mon[36614]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T22:28:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: from='osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: osdmap e57: 9 total, 8 up, 9 in 2024-06-02T22:28:32.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:32.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:31 smithi098 ceph-mon[36750]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:28:32.679 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:28:32.509+0000 7fbb771c4700 -1 osd.8 0 waiting for initial osdmap 2024-06-02T22:28:32.679 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:28:32.521+0000 7fbb6efaf700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:28:33.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-mon[36614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:28:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-mon[36614]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T22:28:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:32 smithi178 ceph-mon[36614]: from='osd.8 ' entity='osd.8' 2024-06-02T22:28:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:32 smithi031 ceph-mon[31767]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:28:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:32 smithi031 ceph-mon[31767]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T22:28:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:32 smithi031 ceph-mon[31767]: from='osd.8 ' entity='osd.8' 2024-06-02T22:28:33.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:32 smithi098 ceph-mon[36750]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:28:33.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:32 smithi098 ceph-mon[36750]: osdmap e58: 9 total, 8 up, 9 in 2024-06-02T22:28:33.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:33.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:32 smithi098 ceph-mon[36750]: from='osd.8 ' entity='osd.8' 2024-06-02T22:28:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:28:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:28:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] boot 2024-06-02T22:28:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T22:28:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:33 smithi178 ceph-mon[36614]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] boot 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:34.287 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:33 smithi031 ceph-mon[31767]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T22:28:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:28:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:28:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-06-02T22:28:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: osd.8 [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] boot 2024-06-02T22:28:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: osdmap e59: 9 total, 9 up, 9 in 2024-06-02T22:28:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T22:28:34.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:33 smithi098 ceph-mon[36750]: osdmap e60: 9 total, 9 up, 9 in 2024-06-02T22:28:35.104 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T22:28:35.105 INFO:teuthology.orchestra.run.smithi031.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T22:28:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: stderr: 10+0 records in 2024-06-02T22:28:35.105 INFO:teuthology.orchestra.run.smithi031.stderr:10+0 records out 2024-06-02T22:28:35.105 INFO:teuthology.orchestra.run.smithi031.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033025 s, 318 MB/s 2024-06-02T22:28:35.105 INFO:teuthology.orchestra.run.smithi031.stderr:--> Zapping successful for: 2024-06-02T22:28:36.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi031:vg_nvme/lv_1 2024-06-02T22:28:36.173 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:36.173 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi178 2024-06-02T22:28:36.173 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.173 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T22:28:36.174 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:35 smithi031 ceph-mon[31767]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T22:28:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi178 2024-06-02T22:28:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T22:28:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:35 smithi098 ceph-mon[36750]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T22:28:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi178 2024-06-02T22:28:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 5696M 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: osdmap e61: 9 total, 9 up, 9 in 2024-06-02T22:28:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:35 smithi178 ceph-mon[36614]: osdmap e62: 9 total, 9 up, 9 in 2024-06-02T22:28:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:28:37.263 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:37 smithi031 ceph-mon[31767]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:37.263 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:37 smithi031 ceph-mon[31767]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T22:28:37.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:37 smithi178 ceph-mon[36614]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:37.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:37 smithi178 ceph-mon[36614]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T22:28:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:37 smithi098 ceph-mon[36750]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:37 smithi098 ceph-mon[36750]: osdmap e63: 9 total, 9 up, 9 in 2024-06-02T22:28:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 -- 172.21.15.31:0/2878280265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c1029f0 msgr2=0x7fd25c102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 --2- 172.21.15.31:0/2878280265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c1029f0 0x7fd25c102e10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0098f0 tx=0x7fd24c009c00 comp rx=0 tx=0).stop 2024-06-02T22:28:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 -- 172.21.15.31:0/2878280265 shutdown_connections 2024-06-02T22:28:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 --2- 172.21.15.31:0/2878280265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c102010 0x7fd25c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:38.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 --2- 172.21.15.31:0/2878280265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c1029f0 0x7fd25c102e10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 --2- 172.21.15.31:0/2878280265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.860+0000 7fd260e00700 1 -- 172.21.15.31:0/2878280265 >> 172.21.15.31:0/2878280265 conn(0x7fd25c0fc120 msgr2=0x7fd25c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:28:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.861+0000 7fd260e00700 1 -- 172.21.15.31:0/2878280265 shutdown_connections 2024-06-02T22:28:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.861+0000 7fd260e00700 1 -- 172.21.15.31:0/2878280265 wait complete. 2024-06-02T22:28:38.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 Processor -- start 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 -- start start 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 0x7fd25c19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 0x7fd25c1a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c10d000 con 0x7fd25c101650 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c10ce80 con 0x7fd25c1029f0 2024-06-02T22:28:38.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.862+0000 7fd260e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c10d180 con 0x7fd25c102010 2024-06-02T22:28:38.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd259e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:38.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd259400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 0x7fd25c19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:38.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 0x7fd25c1a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd259400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 0x7fd25c19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:36656/0 (socket says 172.21.15.31:36656) 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd259e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c19a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44098/0 (socket says 172.21.15.31:44098) 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd259400700 1 -- 172.21.15.31:0/3728277828 learned_addr learned my addr 172.21.15.31:0/3728277828 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 -- 172.21.15.31:0/3728277828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 msgr2=0x7fd25c19aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 0x7fd25c19aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 -- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 msgr2=0x7fd25c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 -- 172.21.15.31:0/3728277828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c1a2600 con 0x7fd25c1029f0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.863+0000 7fd25a800700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 0x7fd25c1a1f60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd25400efc0 tx=0x7fd25400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.864+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2540092e0 con 0x7fd25c1029f0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.864+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd254004bb0 con 0x7fd25c1029f0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.864+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd254004280 con 0x7fd25c1029f0 2024-06-02T22:28:38.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.864+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c1a2890 con 0x7fd25c1029f0 2024-06-02T22:28:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.864+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c1a2dd0 con 0x7fd25c1029f0 2024-06-02T22:28:38.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.865+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c069180 con 0x7fd25c1029f0 2024-06-02T22:28:38.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.867+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd25401b030 con 0x7fd25c1029f0 2024-06-02T22:28:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.868+0000 7fd252a00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 0x7fd2400a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:28:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.869+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fd2540ce270 con 0x7fd25c1029f0 2024-06-02T22:28:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.869+0000 7fd259e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 0x7fd2400a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:28:38.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.869+0000 7fd259e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 0x7fd2400a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0098c0 tx=0x7fd24c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:28:38.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:38.873+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd254022020 con 0x7fd25c1029f0 2024-06-02T22:28:39.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:28:39.118+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd25c0fe310 con 0x7fd2400a2c20 2024-06-02T22:28:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:39 smithi031 ceph-mon[31767]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-06-02T22:28:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:39.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:39 smithi178 ceph-mon[36614]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-06-02T22:28:39.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:39.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:39.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:39 smithi098 ceph-mon[36750]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-06-02T22:28:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:28:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:28:39.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:40.465 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:40 smithi031 ceph-mon[31767]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:40.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:40 smithi178 ceph-mon[36614]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:40 smithi098 ceph-mon[36750]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi031:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:28:41.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:41 smithi178 ceph-mon[36614]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:28:41.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:41 smithi031 ceph-mon[31767]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:28:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:41 smithi098 ceph-mon[36750]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:28:43.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:43 smithi178 ceph-mon[36614]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-02T22:28:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:43 smithi031 ceph-mon[31767]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-02T22:28:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:43 smithi098 ceph-mon[36750]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-06-02T22:28:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:44 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]: dispatch 2024-06-02T22:28:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:44 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]': finished 2024-06-02T22:28:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:44 smithi178 ceph-mon[36614]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T22:28:44.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:28:44.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:44 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]: dispatch 2024-06-02T22:28:44.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:44 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]': finished 2024-06-02T22:28:44.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:44 smithi031 ceph-mon[31767]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T22:28:44.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:28:44.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:44 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]: dispatch 2024-06-02T22:28:44.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:44 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2619665951' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72"}]': finished 2024-06-02T22:28:44.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:44 smithi098 ceph-mon[36750]: osdmap e64: 10 total, 9 up, 10 in 2024-06-02T22:28:44.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:28:45.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:45 smithi178 ceph-mon[36614]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T22:28:45.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3731091021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:45 smithi031 ceph-mon[31767]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T22:28:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3731091021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:45 smithi098 ceph-mon[36750]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T22:28:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3731091021' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:28:47.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:47 smithi178 ceph-mon[36614]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:28:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:47 smithi031 ceph-mon[31767]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:28:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:47 smithi098 ceph-mon[36750]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:28:49.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:49 smithi178 ceph-mon[36614]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:49.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:49 smithi031 ceph-mon[31767]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:49.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:49 smithi098 ceph-mon[36750]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:51.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:51 smithi178 ceph-mon[36614]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:51 smithi031 ceph-mon[31767]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:51 smithi098 ceph-mon[36750]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:53.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:53 smithi178 ceph-mon[36614]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:53.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T22:28:53.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:53.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:53 smithi178 ceph-mon[36614]: Deploying daemon osd.9 on smithi031 2024-06-02T22:28:53.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:53 smithi031 ceph-mon[31767]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:53.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T22:28:53.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:53.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:53 smithi031 ceph-mon[31767]: Deploying daemon osd.9 on smithi031 2024-06-02T22:28:53.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:53 smithi098 ceph-mon[36750]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:53.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T22:28:53.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:28:53.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:53 smithi098 ceph-mon[36750]: Deploying daemon osd.9 on smithi031 2024-06-02T22:28:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:55 smithi031 ceph-mon[31767]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:55.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:55 smithi098 ceph-mon[36750]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:55.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:55 smithi178 ceph-mon[36614]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:57.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:57 smithi031 ceph-mon[31767]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:57.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:57 smithi098 ceph-mon[36750]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:57.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:57 smithi178 ceph-mon[36614]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:28:59 smithi031 ceph-mon[31767]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:59.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:28:59 smithi098 ceph-mon[36750]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:28:59.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:28:59 smithi178 ceph-mon[36614]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:01.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:01 smithi031 ceph-mon[31767]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:01.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:01 smithi098 ceph-mon[36750]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:01.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:01 smithi178 ceph-mon[36614]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:03.003 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:03.003 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:03.003 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:03.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:03.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:03 smithi031 ceph-mon[31767]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:03 smithi098 ceph-mon[36750]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:03 smithi178 ceph-mon[36614]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:05 smithi031 ceph-mon[31767]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:05 smithi031 ceph-mon[31767]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:05 smithi031 ceph-mon[31767]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:05 smithi098 ceph-mon[36750]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:05 smithi098 ceph-mon[36750]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:05 smithi098 ceph-mon[36750]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:05 smithi178 ceph-mon[36614]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:05 smithi178 ceph-mon[36614]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:05 smithi178 ceph-mon[36614]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T22:29:06.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.929+0000 7fd252a00700 1 -- 172.21.15.31:0/3728277828 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd25c0fe310 con 0x7fd2400a2c20 2024-06-02T22:29:06.930 INFO:teuthology.orchestra.run.smithi031.stdout:Created osd(s) 9 on host 'smithi031' 2024-06-02T22:29:06.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 msgr2=0x7fd2400a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:06.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 0x7fd2400a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0098c0 tx=0x7fd24c019040 comp rx=0 tx=0).stop 2024-06-02T22:29:06.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 msgr2=0x7fd25c1a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:06.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 0x7fd25c1a1f60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd25400efc0 tx=0x7fd25400c3a0 comp rx=0 tx=0).stop 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 shutdown_connections 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2400a2c20 0x7fd2400a50e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd25c1029f0 0x7fd25c1a1f60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd25c101650 0x7fd25c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 --2- 172.21.15.31:0/3728277828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c102010 0x7fd25c19aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.933+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 >> 172.21.15.31:0/3728277828 conn(0x7fd25c0fc120 msgr2=0x7fd25c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:29:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.934+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 shutdown_connections 2024-06-02T22:29:06.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:29:06.934+0000 7fd260e00700 1 -- 172.21.15.31:0/3728277828 wait complete. 2024-06-02T22:29:06.955 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T22:29:06.955 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:29:06.956 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:06 smithi031 ceph-mon[31767]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T22:29:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T22:29:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T22:29:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:06.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:29:06.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:06 smithi098 ceph-mon[36750]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T22:29:07.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: osdmap e65: 10 total, 9 up, 10 in 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]: dispatch 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi031", "root=default"]}]': finished 2024-06-02T22:29:07.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:06 smithi178 ceph-mon[36614]: osdmap e66: 10 total, 9 up, 10 in 2024-06-02T22:29:07.824 DEBUG:teuthology.orchestra.run.smithi031:osd.9> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.9.service 2024-06-02T22:29:07.831 INFO:tasks.cephadm:Deploying osd.10 on smithi098 with /dev/vg_nvme/lv_1... 2024-06-02T22:29:07.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T22:29:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:07.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:07 smithi098 ceph-mon[36750]: from='osd.9 ' entity='osd.9' 2024-06-02T22:29:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:08.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:08.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:08.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:07 smithi178 ceph-mon[36614]: from='osd.9 ' entity='osd.9' 2024-06-02T22:29:08.076 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:29:08.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:08.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:08.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:08.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:07 smithi031 ceph-mon[31767]: from='osd.9 ' entity='osd.9' 2024-06-02T22:29:08.911 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:29:08.911 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:29:08.912 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:08.912 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] boot 2024-06-02T22:29:08.912 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T22:29:08.912 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:09.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:29:09.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:29:09.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:09.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] boot 2024-06-02T22:29:09.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T22:29:09.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: osd.9 [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] boot 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: osdmap e67: 10 total, 10 up, 10 in 2024-06-02T22:29:09.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T22:29:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:09 smithi098 ceph-mon[36750]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:09 smithi098 ceph-mon[36750]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T22:29:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:09 smithi178 ceph-mon[36614]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:09 smithi178 ceph-mon[36614]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T22:29:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:09 smithi031 ceph-mon[31767]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-06-02T22:29:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:09 smithi031 ceph-mon[31767]: osdmap e68: 10 total, 10 up, 10 in 2024-06-02T22:29:10.227 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T22:29:10.227 INFO:teuthology.orchestra.run.smithi098.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T22:29:10.227 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10+0 records in 2024-06-02T22:29:10.227 INFO:teuthology.orchestra.run.smithi098.stderr:10+0 records out 2024-06-02T22:29:10.228 INFO:teuthology.orchestra.run.smithi098.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014657 s, 715 MB/s 2024-06-02T22:29:10.228 INFO:teuthology.orchestra.run.smithi098.stderr:--> Zapping successful for: 2024-06-02T22:29:11.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-06-02T22:29:11.250 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:29:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:11 smithi098 ceph-mon[36750]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:11 smithi178 ceph-mon[36614]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:11 smithi031 ceph-mon[31767]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 -- 172.21.15.98:0/3818551860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 msgr2=0x7fade0103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 --2- 172.21.15.98:0/3818551860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0103cd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009990 tx=0x7fadd0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 -- 172.21.15.98:0/3818551860 shutdown_connections 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 --2- 172.21.15.98:0/3818551860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0104210 0x7fade010aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 --2- 172.21.15.98:0/3818551860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade0100890 0x7fade0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 --2- 172.21.15.98:0/3818551860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0103cd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 -- 172.21.15.98:0/3818551860 >> 172.21.15.98:0/3818551860 conn(0x7fade00fc1f0 msgr2=0x7fade00fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 -- 172.21.15.98:0/3818551860 shutdown_connections 2024-06-02T22:29:12.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.931+0000 7fade481e700 1 -- 172.21.15.98:0/3818551860 wait complete. 2024-06-02T22:29:12.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 Processor -- start 2024-06-02T22:29:12.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 -- start start 2024-06-02T22:29:12.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0100890 0x7fade01031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade0104210 0x7fade0101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e220 con 0x7fade0104210 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e0a0 con 0x7fade0103870 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.932+0000 7fade481e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e3a0 con 0x7fade0100890 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38332/0 (socket says 172.21.15.98:38332) 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 -- 172.21.15.98:0/439173638 learned_addr learned my addr 172.21.15.98:0/439173638 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadde59c700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0100890 0x7fade01031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 -- 172.21.15.98:0/439173638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0100890 msgr2=0x7fade01031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0100890 0x7fade01031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 -- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade0104210 msgr2=0x7fade0101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade0104210 0x7fade0101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 -- 172.21.15.98:0/439173638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade0102610 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadddd9b700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005910 tx=0x7fadd00047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0027070 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade01a2960 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0022470 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd000f6c0 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.933+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01a2db0 con 0x7fade0103870 2024-06-02T22:29:12.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.934+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade002dca0 con 0x7fade0103870 2024-06-02T22:29:12.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.935+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fadd002a070 con 0x7fade0103870 2024-06-02T22:29:12.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.936+0000 7fadcf7fe700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 0x7fadc80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:12.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.936+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7fadd00cfd40 con 0x7fade0103870 2024-06-02T22:29:12.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.936+0000 7fadde59c700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 0x7fadc80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:12.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.937+0000 7fadde59c700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 0x7fadc80a50e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006fd0 tx=0x7fadd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:29:12.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:12.939+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fadd0031070 con 0x7fade0103870 2024-06-02T22:29:13.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:13.146+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fade00628d0 con 0x7fadc80a2c20 2024-06-02T22:29:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:13.964 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:14.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:14.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:14.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:14.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:14.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:15.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:14 smithi178 ceph-mon[36614]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:15.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:14 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi031 2024-06-02T22:29:15.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:14 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 4273M 2024-06-02T22:29:15.077 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:14 smithi098 ceph-mon[36750]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:15.077 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:14 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi031 2024-06-02T22:29:15.077 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:14 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 4273M 2024-06-02T22:29:15.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:14 smithi031 ceph-mon[31767]: from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:15.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:14 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi031 2024-06-02T22:29:15.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:14 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 4273M 2024-06-02T22:29:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:15 smithi178 ceph-mon[36614]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:16.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:15 smithi031 ceph-mon[31767]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:15 smithi098 ceph-mon[36750]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:17.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:16 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/3844951201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:16 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:16 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]': finished 2024-06-02T22:29:17.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:16 smithi178 ceph-mon[36614]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T22:29:17.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:16 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/3844951201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:16 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:16 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]': finished 2024-06-02T22:29:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:16 smithi031 ceph-mon[31767]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T22:29:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:16 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/3844951201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:16 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]: dispatch 2024-06-02T22:29:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:16 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "668ead78-dca3-48e3-8096-b743361599db"}]': finished 2024-06-02T22:29:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:16 smithi098 ceph-mon[36750]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T22:29:17.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:17 smithi178 ceph-mon[36614]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:18.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:17 smithi178 ceph-mon[36614]: from='client.? 172.21.15.98:0/3656933861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:17 smithi031 ceph-mon[31767]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:17 smithi031 ceph-mon[31767]: from='client.? 172.21.15.98:0/3656933861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:17 smithi098 ceph-mon[36750]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:17 smithi098 ceph-mon[36750]: from='client.? 172.21.15.98:0/3656933861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:19 smithi178 ceph-mon[36614]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:20.103 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:19 smithi098 ceph-mon[36750]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:19 smithi031 ceph-mon[31767]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:21 smithi098 ceph-mon[36750]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:21 smithi178 ceph-mon[36614]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:22.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:21 smithi031 ceph-mon[31767]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:23.848 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:23 smithi098 ceph-mon[36750]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:23 smithi178 ceph-mon[36614]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:23 smithi031 ceph-mon[31767]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:24.859 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:24 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T22:29:24.860 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:24 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:24.860 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:24 smithi098 ceph-mon[36750]: Deploying daemon osd.10 on smithi098 2024-06-02T22:29:25.023 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:24 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T22:29:25.023 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:24 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:25.023 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:24 smithi031 ceph-mon[31767]: Deploying daemon osd.10 on smithi098 2024-06-02T22:29:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:24 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T22:29:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:24 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:24 smithi178 ceph-mon[36614]: Deploying daemon osd.10 on smithi098 2024-06-02T22:29:25.800 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:25 smithi098 ceph-mon[36750]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:25 smithi178 ceph-mon[36614]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:25 smithi031 ceph-mon[31767]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:27.937 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:27 smithi098 ceph-mon[36750]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:27 smithi178 ceph-mon[36614]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:27 smithi031 ceph-mon[31767]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:29 smithi178 ceph-mon[36614]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:30.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:30.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:30.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:30.089 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:29 smithi098 ceph-mon[36750]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:30.089 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:30.089 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:30.089 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:29 smithi031 ceph-mon[31767]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:32.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:31 smithi178 ceph-mon[36614]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:31 smithi031 ceph-mon[31767]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:31 smithi098 ceph-mon[36750]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:33.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.643+0000 7fadcf7fe700 1 -- 172.21.15.98:0/439173638 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fade00628d0 con 0x7fadc80a2c20 2024-06-02T22:29:33.644 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 10 on host 'smithi098' 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 msgr2=0x7fadc80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 0x7fadc80a50e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006fd0 tx=0x7fadd4008040 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 msgr2=0x7fade0101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadd0005910 tx=0x7fadd00047b0 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 shutdown_connections 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fadc80a2c20 0x7fadc80a50e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fade0104210 0x7fade0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade0100890 0x7fade01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 --2- 172.21.15.98:0/439173638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade0103870 0x7fade0101820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:33.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 >> 172.21.15.98:0/439173638 conn(0x7fade00fc1f0 msgr2=0x7fade0106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:29:33.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 shutdown_connections 2024-06-02T22:29:33.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-06-02T22:29:33.645+0000 7fade481e700 1 -- 172.21.15.98:0/439173638 wait complete. 2024-06-02T22:29:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:33.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:34.308 DEBUG:teuthology.orchestra.run.smithi098:osd.10> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.10.service 2024-06-02T22:29:34.310 INFO:tasks.cephadm:Deploying osd.11 on smithi178 with /dev/vg_nvme/lv_1... 2024-06-02T22:29:34.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T22:29:34.559 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:29:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:34 smithi098 ceph-mon[36750]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T22:29:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:34 smithi098 ceph-mon[36750]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:34 smithi098 ceph-mon[36750]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T22:29:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:34 smithi098 ceph-mon[36750]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:35.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:34 smithi178 ceph-mon[36614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T22:29:35.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:34 smithi178 ceph-mon[36614]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:35.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:34 smithi178 ceph-mon[36614]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T22:29:35.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:35.029 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:34 smithi178 ceph-mon[36614]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:34 smithi031 ceph-mon[31767]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T22:29:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:34 smithi031 ceph-mon[31767]: from='osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:34 smithi031 ceph-mon[31767]: osdmap e70: 11 total, 10 up, 11 in 2024-06-02T22:29:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:34 smithi031 ceph-mon[31767]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-06-02T22:29:35.462 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:29:35.242+0000 7f024ad12700 -1 osd.10 0 waiting for initial osdmap 2024-06-02T22:29:35.463 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:29:35.256+0000 7f0242afd700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:29:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: from='osd.10 ' entity='osd.10' 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] boot 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T22:29:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: from='osd.10 ' entity='osd.10' 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] boot 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T22:29:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: osdmap e71: 11 total, 10 up, 11 in 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: from='osd.10 ' entity='osd.10' 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: osd.10 [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] boot 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: osdmap e72: 11 total, 11 up, 11 in 2024-06-02T22:29:36.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T22:29:36.743 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T22:29:36.743 INFO:teuthology.orchestra.run.smithi178.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T22:29:36.744 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10+0 records in 2024-06-02T22:29:36.744 INFO:teuthology.orchestra.run.smithi178.stderr:10+0 records out 2024-06-02T22:29:36.744 INFO:teuthology.orchestra.run.smithi178.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123291 s, 850 MB/s 2024-06-02T22:29:36.744 INFO:teuthology.orchestra.run.smithi178.stderr:--> Zapping successful for: 2024-06-02T22:29:37.441 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:37 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:29:37.441 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:37 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:29:37.441 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:37 smithi178 ceph-mon[36614]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:37.441 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:37 smithi178 ceph-mon[36614]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T22:29:37.467 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2024-06-02T22:29:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:37 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:29:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:37 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:29:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:37 smithi031 ceph-mon[31767]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:37 smithi031 ceph-mon[31767]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T22:29:37.702 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:29:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:37 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:29:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:37 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:29:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:37 smithi098 ceph-mon[36750]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:37 smithi098 ceph-mon[36750]: osdmap e73: 11 total, 11 up, 11 in 2024-06-02T22:29:38.548 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi098 2024-06-02T22:29:38.548 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 4272M 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:38.549 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi098 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 4272M 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:38.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi098 2024-06-02T22:29:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: osdmap e74: 11 total, 11 up, 11 in 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 4272M 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:29:38.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:39.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 -- 172.21.15.178:0/1037246624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c90104090 msgr2=0x7f2c9010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:39.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 --2- 172.21.15.178:0/1037246624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c90104090 0x7f2c9010a940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800b0a0 tx=0x7f2c8800b3b0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 -- 172.21.15.178:0/1037246624 shutdown_connections 2024-06-02T22:29:39.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 --2- 172.21.15.178:0/1037246624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c90104090 0x7f2c9010a940 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.367 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 --2- 172.21.15.178:0/1037246624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 --2- 172.21.15.178:0/1037246624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c901036f0 0x7f2c90103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 -- 172.21.15.178:0/1037246624 >> 172.21.15.178:0/1037246624 conn(0x7f2c900fda90 msgr2=0x7f2c900ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 -- 172.21.15.178:0/1037246624 shutdown_connections 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 -- 172.21.15.178:0/1037246624 wait complete. 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.366+0000 7f2c960bf700 1 Processor -- start 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 -- start start 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c90104090 0x7f2c9019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010e150 con 0x7f2c90104090 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010dfd0 con 0x7f2c901024f0 2024-06-02T22:29:39.368 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c960bf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9010e2d0 con 0x7f2c901036f0 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:45310/0 (socket says 172.21.15.178:45310) 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 -- 172.21.15.178:0/2076997362 learned_addr learned my addr 172.21.15.178:0/2076997362 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8f7fe700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 -- 172.21.15.178:0/2076997362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 msgr2=0x7f2c90198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 -- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c90104090 msgr2=0x7f2c9019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c90104090 0x7f2c9019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 -- 172.21.15.178:0/2076997362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c901a0360 con 0x7f2c901036f0 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8f7fe700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:29:39.369 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.367+0000 7f2c8effd700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b560 tx=0x7f2c8400b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:29:39.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.370+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84015020 con 0x7f2c901036f0 2024-06-02T22:29:39.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.370+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c84011d10 con 0x7f2c901036f0 2024-06-02T22:29:39.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.370+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c901a0650 con 0x7f2c901036f0 2024-06-02T22:29:39.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.370+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400f2e0 con 0x7f2c901036f0 2024-06-02T22:29:39.370 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.370+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901a0c60 con 0x7f2c901036f0 2024-06-02T22:29:39.371 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.371+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c90069180 con 0x7f2c901036f0 2024-06-02T22:29:39.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.372+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2c84018020 con 0x7f2c901036f0 2024-06-02T22:29:39.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.373+0000 7f2c8cff9700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 0x7f2c780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:29:39.372 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.373+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6694+0+0 (secure 0 0 0) 0x7f2c840ce1d0 con 0x7f2c901036f0 2024-06-02T22:29:39.373 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.373+0000 7f2c8f7fe700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 0x7f2c780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:29:39.374 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.374+0000 7f2c8f7fe700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 0x7f2c780a5160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005950 tx=0x7f2c800058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:29:39.377 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.378+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2c8401f020 con 0x7f2c901036f0 2024-06-02T22:29:39.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:39 smithi178 ceph-mon[36614]: pgmap v266: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:39.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:39 smithi178 ceph-mon[36614]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T22:29:39.583 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:39.583+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2c900628d0 con 0x7f2c780a2ca0 2024-06-02T22:29:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:39 smithi098 ceph-mon[36750]: pgmap v266: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:39 smithi098 ceph-mon[36750]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T22:29:39.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:39 smithi031 ceph-mon[31767]: pgmap v266: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:39.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:39 smithi031 ceph-mon[31767]: osdmap e75: 11 total, 11 up, 11 in 2024-06-02T22:29:40.542 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:40 smithi178 ceph-mon[36614]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T22:29:40.542 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:40 smithi178 ceph-mon[36614]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:40.543 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:40.543 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:40.543 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:40 smithi098 ceph-mon[36750]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T22:29:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:40 smithi098 ceph-mon[36750]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:40.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:40 smithi031 ceph-mon[31767]: osdmap e76: 11 total, 11 up, 11 in 2024-06-02T22:29:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:40 smithi031 ceph-mon[31767]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:29:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T22:29:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T22:29:40.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:41 smithi178 ceph-mon[36614]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:41.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:41 smithi031 ceph-mon[31767]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:41 smithi098 ceph-mon[36750]: pgmap v269: 1 pgs: 1 remapped+peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:42 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/3457375310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:42 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:42 smithi031 ceph-mon[31767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]': finished 2024-06-02T22:29:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:42 smithi031 ceph-mon[31767]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T22:29:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:29:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:42 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/3457375310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:42.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:42 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:42 smithi098 ceph-mon[36750]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]': finished 2024-06-02T22:29:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:42 smithi098 ceph-mon[36750]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T22:29:42.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:29:43.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:42 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/3457375310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:43.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:42 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]: dispatch 2024-06-02T22:29:43.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:42 smithi178 ceph-mon[36614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fbafbaf7-677b-4af5-ad84-e68f9ab5221a"}]': finished 2024-06-02T22:29:43.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:42 smithi178 ceph-mon[36614]: osdmap e77: 12 total, 11 up, 12 in 2024-06-02T22:29:43.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:29:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:43 smithi031 ceph-mon[31767]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-06-02T22:29:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:43 smithi031 ceph-mon[31767]: from='client.? 172.21.15.178:0/2682289410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:43 smithi098 ceph-mon[36750]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-06-02T22:29:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:43 smithi098 ceph-mon[36750]: from='client.? 172.21.15.178:0/2682289410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:43 smithi178 ceph-mon[36614]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-06-02T22:29:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:43 smithi178 ceph-mon[36614]: from='client.? 172.21.15.178:0/2682289410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T22:29:45.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:45 smithi031 ceph-mon[31767]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:29:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:45 smithi098 ceph-mon[36750]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:29:45.996 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:45 smithi178 ceph-mon[36614]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T22:29:47.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:47 smithi031 ceph-mon[31767]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-02T22:29:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:47 smithi098 ceph-mon[36750]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-02T22:29:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:47 smithi178 ceph-mon[36614]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-02T22:29:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:49 smithi178 ceph-mon[36614]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T22:29:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:49 smithi031 ceph-mon[31767]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T22:29:49.953 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:49 smithi098 ceph-mon[36750]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T22:29:50.784 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T22:29:50.784 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:50.784 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:50 smithi178 ceph-mon[36614]: Deploying daemon osd.11 on smithi178 2024-06-02T22:29:50.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T22:29:50.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:50.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:50 smithi031 ceph-mon[31767]: Deploying daemon osd.11 on smithi178 2024-06-02T22:29:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T22:29:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:29:50.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:50 smithi098 ceph-mon[36750]: Deploying daemon osd.11 on smithi178 2024-06-02T22:29:51.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:51 smithi178 ceph-mon[36614]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:29:51.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:51 smithi031 ceph-mon[31767]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:29:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:51 smithi098 ceph-mon[36750]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T22:29:53.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:53 smithi031 ceph-mon[31767]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:53.903 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:53 smithi178 ceph-mon[36614]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:53 smithi098 ceph-mon[36750]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:55 smithi098 ceph-mon[36750]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:56.028 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:55 smithi178 ceph-mon[36614]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:55 smithi031 ceph-mon[31767]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:57.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:57.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:57.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:57.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:57.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:29:57.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:29:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:57 smithi098 ceph-mon[36750]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:57 smithi178 ceph-mon[36614]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:57 smithi031 ceph-mon[31767]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:29:59.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.628+0000 7f2c8cff9700 1 -- 172.21.15.178:0/2076997362 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2c900628d0 con 0x7f2c780a2ca0 2024-06-02T22:29:59.628 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 11 on host 'smithi178' 2024-06-02T22:29:59.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 msgr2=0x7f2c780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:59.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 0x7f2c780a5160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2c80005950 tx=0x7f2c800058e0 comp rx=0 tx=0).stop 2024-06-02T22:29:59.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 msgr2=0x7f2c90198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:29:59.630 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400b560 tx=0x7f2c8400b920 comp rx=0 tx=0).stop 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 shutdown_connections 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2c780a2ca0 0x7f2c780a5160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c90104090 0x7f2c9019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2c901024f0 0x7f2c90198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 --2- 172.21.15.178:0/2076997362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c901036f0 0x7f2c90198c40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.630+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 >> 172.21.15.178:0/2076997362 conn(0x7f2c900fda90 msgr2=0x7f2c90106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.631+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 shutdown_connections 2024-06-02T22:29:59.631 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:29:59.631+0000 7f2c960bf700 1 -- 172.21.15.178:0/2076997362 wait complete. 2024-06-02T22:30:00.035 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:00.035 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:00.036 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:29:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:29:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:00.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:29:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:00.251 DEBUG:teuthology.orchestra.run.smithi178:osd.11> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.11.service 2024-06-02T22:30:00.253 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-02T22:30:00.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T22:30:00.721 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:01.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T22:30:01.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T22:30:01.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:01.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:30:01.062 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:30:00.819+0000 7f8528b73700 -1 osd.11 0 waiting for initial osdmap 2024-06-02T22:30:01.062 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:30:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:30:00.833+0000 7f8524966700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.072 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:00 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:30:01.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T22:30:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: from='osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: osdmap e78: 12 total, 11 up, 12 in 2024-06-02T22:30:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-06-02T22:30:01.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:00 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:30:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:01 smithi178 ceph-mon[36614]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:01 smithi178 ceph-mon[36614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:30:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:01 smithi178 ceph-mon[36614]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T22:30:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:01 smithi031 ceph-mon[31767]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:01 smithi031 ceph-mon[31767]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:30:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:01 smithi031 ceph-mon[31767]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T22:30:02.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:01 smithi098 ceph-mon[36750]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:01 smithi098 ceph-mon[36750]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-06-02T22:30:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:01 smithi098 ceph-mon[36750]: osdmap e79: 12 total, 11 up, 12 in 2024-06-02T22:30:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: purged_snaps scrub starts 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: purged_snaps scrub ok 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] boot 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T22:30:02.842 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: purged_snaps scrub starts 2024-06-02T22:30:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: purged_snaps scrub ok 2024-06-02T22:30:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] boot 2024-06-02T22:30:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T22:30:03.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:03.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 -- 172.21.15.31:0/837663617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d01024f0 msgr2=0x7f77d0102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 --2- 172.21.15.31:0/837663617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d01024f0 0x7f77d0102910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f77c00099c0 tx=0x7f77c0009cd0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 -- 172.21.15.31:0/837663617 shutdown_connections 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 --2- 172.21.15.31:0/837663617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d0104090 0x7f77d010a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 --2- 172.21.15.31:0/837663617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d01024f0 0x7f77d0102910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 --2- 172.21.15.31:0/837663617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d0103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 -- 172.21.15.31:0/837663617 >> 172.21.15.31:0/837663617 conn(0x7f77d00fda90 msgr2=0x7f77d00ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 -- 172.21.15.31:0/837663617 shutdown_connections 2024-06-02T22:30:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.270+0000 7f77d6400700 1 -- 172.21.15.31:0/837663617 wait complete. 2024-06-02T22:30:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.271+0000 7f77d6400700 1 Processor -- start 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.271+0000 7f77d6400700 1 -- start start 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.271+0000 7f77d6400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77d6400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77d6400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 0x7f77d01a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77d6400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010e110 con 0x7f77d0104090 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77d6400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010df90 con 0x7f77d01024f0 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77d6400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f77d010e290 con 0x7f77d01036f0 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46536/0 (socket says 172.21.15.31:46536) 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 -- 172.21.15.31:0/3561147852 learned_addr learned my addr 172.21.15.31:0/3561147852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cfe00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 0x7f77d01a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77c6a00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 -- 172.21.15.31:0/3561147852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 msgr2=0x7f77d019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 -- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 msgr2=0x7f77d01a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 0x7f77d01a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cf400700 1 -- 172.21.15.31:0/3561147852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01a2620 con 0x7f77d01024f0 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77c6a00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.272+0000 7f77cfe00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 0x7f77d01a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77cf400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098e0 tx=0x7f77c0009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0027070 con 0x7f77d01024f0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77c000fbc0 con 0x7f77d01024f0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01a28b0 con 0x7f77d01024f0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c0017650 con 0x7f77d01024f0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.273+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01a2d00 con 0x7f77d01024f0 2024-06-02T22:30:03.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.274+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d00691b0 con 0x7f77d01024f0 2024-06-02T22:30:03.276 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: purged_snaps scrub starts 2024-06-02T22:30:03.276 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: purged_snaps scrub ok 2024-06-02T22:30:03.276 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:03.276 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: osd.11 [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] boot 2024-06-02T22:30:03.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T22:30:03.277 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T22:30:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.276+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f77c002a070 con 0x7f77d01024f0 2024-06-02T22:30:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.278+0000 7f77ccc00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 0x7f77b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.278+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f77c00d0280 con 0x7f77d01024f0 2024-06-02T22:30:03.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.278+0000 7f77c6a00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 0x7f77b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:03.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.279+0000 7f77c6a00700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 0x7f77b40a50e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f77b80093a0 tx=0x7f77b800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:03.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.280+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f77d00691b0 con 0x7f77d01024f0 2024-06-02T22:30:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.544+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f77d01a3250 con 0x7f77d01024f0 2024-06-02T22:30:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.545+0000 7f77ccc00700 1 -- 172.21.15.31:0/3561147852 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f77c0031070 con 0x7f77d01024f0 2024-06-02T22:30:03.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 msgr2=0x7f77b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 0x7f77b40a50e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f77b80093a0 tx=0x7f77b800b040 comp rx=0 tx=0).stop 2024-06-02T22:30:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 msgr2=0x7f77d019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098e0 tx=0x7f77c0009580 comp rx=0 tx=0).stop 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 shutdown_connections 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f77b40a2c20 0x7f77b40a50e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77d0104090 0x7f77d01a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77d01024f0 0x7f77d019a9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 --2- 172.21.15.31:0/3561147852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77d01036f0 0x7f77d019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 >> 172.21.15.31:0/3561147852 conn(0x7f77d00fda90 msgr2=0x7f77d00746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 shutdown_connections 2024-06-02T22:30:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:03.548+0000 7f77d6400700 1 -- 172.21.15.31:0/3561147852 wait complete. 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:03 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3561147852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T22:30:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:03 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3561147852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:30:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:04.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:03 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3561147852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T22:30:04.389 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1717367401,"num_in_osds":12,"osd_in_since":1717367382,"num_remapped_pgs":0} 2024-06-02T22:30:04.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:30:04.853 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:05.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:04 smithi031 ceph-mon[31767]: Detected new or changed devices on smithi178 2024-06-02T22:30:05.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:04 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-02T22:30:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:04 smithi098 ceph-mon[36750]: Detected new or changed devices on smithi178 2024-06-02T22:30:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:04 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-02T22:30:05.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:04 smithi178 ceph-mon[36614]: Detected new or changed devices on smithi178 2024-06-02T22:30:05.214 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:04 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 4272M 2024-06-02T22:30:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:05 smithi031 ceph-mon[31767]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:05 smithi098 ceph-mon[36750]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:06.230 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:05 smithi178 ceph-mon[36614]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 -- 172.21.15.31:0/3113715239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394074a50 msgr2=0x7f1394074e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 --2- 172.21.15.31:0/3113715239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394074a50 0x7f1394074e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1384009990 tx=0x7f1384009ca0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 -- 172.21.15.31:0/3113715239 shutdown_connections 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 --2- 172.21.15.31:0/3113715239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 0x7f1394111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 --2- 172.21.15.31:0/3113715239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394074a50 0x7f1394074e30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 --2- 172.21.15.31:0/3113715239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394075370 0x7f139410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 -- 172.21.15.31:0/3113715239 >> 172.21.15.31:0/3113715239 conn(0x7f13940fde80 msgr2=0x7f13941002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 -- 172.21.15.31:0/3113715239 shutdown_connections 2024-06-02T22:30:07.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.204+0000 7f1393200700 1 -- 172.21.15.31:0/3113715239 wait complete. 2024-06-02T22:30:07.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.205+0000 7f1393200700 1 Processor -- start 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.205+0000 7f1393200700 1 -- start start 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 0x7f139419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 0x7f139419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1394114a10 con 0x7f139410ed60 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1394114890 con 0x7f1394074a50 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1393200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1394114b90 con 0x7f1394075370 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1391e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 0x7f139419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:47370/0 (socket says 172.21.15.31:47370) 2024-06-02T22:30:07.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1391e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 0x7f139419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46548/0 (socket says 172.21.15.31:46548) 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 -- 172.21.15.31:0/2359961350 learned_addr learned my addr 172.21.15.31:0/2359961350 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f1392800700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 0x7f139419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 -- 172.21.15.31:0/2359961350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 msgr2=0x7f139419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 0x7f139419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 -- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 msgr2=0x7f139419f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.206+0000 7f138be00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 0x7f139419f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f138be00700 1 -- 172.21.15.31:0/2359961350 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139419fe90 con 0x7f1394075370 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f138be00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f137c00e9a0 tx=0x7f137c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c00cbd0 con 0x7f1394075370 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f137c00cd70 con 0x7f1394075370 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13941a0180 con 0x7f1394075370 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c018750 con 0x7f1394075370 2024-06-02T22:30:07.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.207+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13941a7a00 con 0x7f1394075370 2024-06-02T22:30:07.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.208+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1394075f10 con 0x7f1394075370 2024-06-02T22:30:07.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.211+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f137c010430 con 0x7f1394075370 2024-06-02T22:30:07.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.213+0000 7f138aa00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 0x7f13780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:07.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.213+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f137c0cef00 con 0x7f1394075370 2024-06-02T22:30:07.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.213+0000 7f1391e00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 0x7f13780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:07.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.214+0000 7f1391e00700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 0x7f13780a50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f138400b2e0 tx=0x7f1384005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:07.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.220+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f137c09c260 con 0x7f1394075370 2024-06-02T22:30:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.455+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f139402dca0 con 0x7f1394075370 2024-06-02T22:30:07.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.457+0000 7f138aa00700 1 -- 172.21.15.31:0/2359961350 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18421 (secure 0 0 0) 0x7f137c09bb60 con 0x7f1394075370 2024-06-02T22:30:07.458 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:07.458 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":81,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:30:02.829801+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:30:07.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 msgr2=0x7f13780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 0x7f13780a50e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f138400b2e0 tx=0x7f1384005fd0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 msgr2=0x7f139419b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f137c00e9a0 tx=0x7f137c00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 shutdown_connections 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13780a2c20 0x7f13780a50e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f139410ed60 0x7f139419f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1394074a50 0x7f139419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 --2- 172.21.15.31:0/2359961350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1394075370 0x7f139419b3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:07.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.460+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 >> 172.21.15.31:0/2359961350 conn(0x7f13940fde80 msgr2=0x7f13940feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:07.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.461+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 shutdown_connections 2024-06-02T22:30:07.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:07.461+0000 7f1393200700 1 -- 172.21.15.31:0/2359961350 wait complete. 2024-06-02T22:30:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:07 smithi031 ceph-mon[31767]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:07 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2359961350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:30:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:07 smithi098 ceph-mon[36750]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:07 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2359961350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:30:08.251 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T22:25:40.784938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T22:30:08.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-02T22:30:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:07 smithi178 ceph-mon[36614]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:07 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2359961350' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:30:08.726 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:10.104 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:09 smithi031 ceph-mon[31767]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:09 smithi098 ceph-mon[36750]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:09 smithi178 ceph-mon[36614]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.000+0000 7f5966800700 1 -- 172.21.15.31:0/1883585331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960107840 msgr2=0x7f596010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.000+0000 7f5966800700 1 --2- 172.21.15.31:0/1883585331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960107840 0x7f596010f3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5958009f90 tx=0x7f595800b330 comp rx=0 tx=0).stop 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 -- 172.21.15.31:0/1883585331 shutdown_connections 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 --2- 172.21.15.31:0/1883585331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960107840 0x7f596010f3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 --2- 172.21.15.31:0/1883585331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5960102740 0x7f5960102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 --2- 172.21.15.31:0/1883585331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59601030f0 0x7f5960107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 -- 172.21.15.31:0/1883585331 >> 172.21.15.31:0/1883585331 conn(0x7f59600795f0 msgr2=0x7f5960079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 -- 172.21.15.31:0/1883585331 shutdown_connections 2024-06-02T22:30:11.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.001+0000 7f5966800700 1 -- 172.21.15.31:0/1883585331 wait complete. 2024-06-02T22:30:11.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.002+0000 7f5966800700 1 Processor -- start 2024-06-02T22:30:11.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.002+0000 7f5966800700 1 -- start start 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 0x7f596019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 0x7f596019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59601127d0 con 0x7f5960107840 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5960112650 con 0x7f59601030f0 2024-06-02T22:30:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f5966800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5960112950 con 0x7f5960102740 2024-06-02T22:30:11.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.003+0000 7f595ea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:11.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57698/0 (socket says 172.21.15.31:57698) 2024-06-02T22:30:11.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 -- 172.21.15.31:0/3533206187 learned_addr learned my addr 172.21.15.31:0/3533206187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 0x7f596019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595f400700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 0x7f596019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 -- 172.21.15.31:0/3533206187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 msgr2=0x7f596019add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 0x7f596019add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 -- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 msgr2=0x7f596019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 0x7f596019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595ea00700 1 -- 172.21.15.31:0/3533206187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596019fd90 con 0x7f59601030f0 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595f400700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 0x7f596019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.004+0000 7f595fe00700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 0x7f596019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:30:11.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f595ea00700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e9c0 tx=0x7f594c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c00cbd0 con 0x7f59601030f0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59601a0080 con 0x7f59601030f0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f594c00cd70 con 0x7f59601030f0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c005660 con 0x7f59601030f0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.005+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59601a7900 con 0x7f59601030f0 2024-06-02T22:30:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.006+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5960069180 con 0x7f59601030f0 2024-06-02T22:30:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.010+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f594c004750 con 0x7f59601030f0 2024-06-02T22:30:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.011+0000 7f5957e00700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 0x7f59440a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.012+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f594c0cedb0 con 0x7f59601030f0 2024-06-02T22:30:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.012+0000 7f595f400700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 0x7f59440a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.013+0000 7f595f400700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 0x7f59440a50e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5950009cb0 tx=0x7f5950009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:11.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.016+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f594c0d3070 con 0x7f59601030f0 2024-06-02T22:30:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.244+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f59601a7bc0 con 0x7f59601030f0 2024-06-02T22:30:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.245+0000 7f5957e00700 1 -- 172.21.15.31:0/3533206187 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f594c09c110 con 0x7f59601030f0 2024-06-02T22:30:11.245 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-06-02T22:30:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 msgr2=0x7f59440a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 0x7f59440a50e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5950009cb0 tx=0x7f5950009260 comp rx=0 tx=0).stop 2024-06-02T22:30:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 msgr2=0x7f596019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f594c00e9c0 tx=0x7f594c00ecd0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 shutdown_connections 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59440a2c20 0x7f59440a50e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5960107840 0x7f596019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5960102740 0x7f596019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 --2- 172.21.15.31:0/3533206187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59601030f0 0x7f596019b310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 >> 172.21.15.31:0/3533206187 conn(0x7f59600795f0 msgr2=0x7f5960100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 shutdown_connections 2024-06-02T22:30:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:11.249+0000 7f5966800700 1 -- 172.21.15.31:0/3533206187 wait complete. 2024-06-02T22:30:11.988 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:11 smithi031 ceph-mon[31767]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:11.989 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:11 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3533206187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.a on smithi031 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.d on smithi031 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.g on smithi031 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.j on smithi031 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.b on smithi098 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.e on smithi098 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.h on smithi098 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.k on smithi098 2024-06-02T22:30:12.058 INFO:tasks.cephadm:Adding mds.c on smithi178 2024-06-02T22:30:12.059 INFO:tasks.cephadm:Adding mds.f on smithi178 2024-06-02T22:30:12.059 INFO:tasks.cephadm:Adding mds.i on smithi178 2024-06-02T22:30:12.059 INFO:tasks.cephadm:Adding mds.l on smithi178 2024-06-02T22:30:12.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l' 2024-06-02T22:30:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:11 smithi098 ceph-mon[36750]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:11 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3533206187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:30:12.308 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:30:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:11 smithi178 ceph-mon[36614]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:12.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:11 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3533206187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:30:14.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.034+0000 7f26b7cd0700 1 -- 172.21.15.178:0/671745847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b0102f80 msgr2=0x7f26b0109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:14.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.034+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/671745847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b0102f80 0x7f26b0109830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26a800b0a0 tx=0x7f26a800b3b0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 -- 172.21.15.178:0/671745847 shutdown_connections 2024-06-02T22:30:14.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/671745847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b0102f80 0x7f26b0109830 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/671745847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26b01013e0 0x7f26b0101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/671745847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26b01025e0 0x7f26b0102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 -- 172.21.15.178:0/671745847 >> 172.21.15.178:0/671745847 conn(0x7f26b00fc9c0 msgr2=0x7f26b00fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 -- 172.21.15.178:0/671745847 shutdown_connections 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 -- 172.21.15.178:0/671745847 wait complete. 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 Processor -- start 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.035+0000 7f26b7cd0700 1 -- start start 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26b01025e0 0x7f26b019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26b0102f80 0x7f26b019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f26b010d110 con 0x7f26b01025e0 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f26b010cf90 con 0x7f26b0102f80 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f26b010d290 con 0x7f26b01013e0 2024-06-02T22:30:14.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:57302/0 (socket says 172.21.15.178:57302) 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 -- 172.21.15.178:0/3386873749 learned_addr learned my addr 172.21.15.178:0/3386873749 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 -- 172.21.15.178:0/3386873749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26b0102f80 msgr2=0x7f26b019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26b0102f80 0x7f26b019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 -- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26b01025e0 msgr2=0x7f26b019d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26b01025e0 0x7f26b019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 -- 172.21.15.178:0/3386873749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b01a04b0 con 0x7f26b01013e0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b5a6c700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b500 tx=0x7f26ac00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac015020 con 0x7f26b01013e0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26ac011d10 con 0x7f26b01013e0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b01a07a0 con 0x7f26b01013e0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00f2e0 con 0x7f26b01013e0 2024-06-02T22:30:14.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.036+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b01a0d60 con 0x7f26b01013e0 2024-06-02T22:30:14.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.037+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b0069180 con 0x7f26b01013e0 2024-06-02T22:30:14.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.038+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f26ac018020 con 0x7f26b01013e0 2024-06-02T22:30:14.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.039+0000 7f26a6ffd700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 0x7f269c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:14.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.039+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f26ac0ce3b0 con 0x7f26b01013e0 2024-06-02T22:30:14.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.040+0000 7f26b526b700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 0x7f269c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:14.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.041+0000 7f26b526b700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 0x7f269c0a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26b006bce0 tx=0x7f26a0006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:14.043 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.044+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f26ac01f020 con 0x7f26b01013e0 2024-06-02T22:30:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:13 smithi178 ceph-mon[36614]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:13 smithi098 ceph-mon[36750]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:14.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.251+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}) -- 0x7f26b00629d0 con 0x7f269c0a2c20 2024-06-02T22:30:14.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.267+0000 7f26a6ffd700 1 -- 172.21.15.178:0/3386873749 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f26b00629d0 con 0x7f269c0a2c20 2024-06-02T22:30:14.267 INFO:teuthology.orchestra.run.smithi178.stdout:Scheduled mds.all update... 2024-06-02T22:30:14.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 msgr2=0x7f269c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:14.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 0x7f269c0a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f26b006bce0 tx=0x7f26a0006d20 comp rx=0 tx=0).stop 2024-06-02T22:30:14.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 msgr2=0x7f26b006b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:14.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00b500 tx=0x7f26ac00b8c0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 shutdown_connections 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f269c0a2c20 0x7f269c0a50e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f26b0102f80 0x7f26b019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b01013e0 0x7f26b006b780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 --2- 172.21.15.178:0/3386873749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26b01025e0 0x7f26b019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 >> 172.21.15.178:0/3386873749 conn(0x7f26b00fc9c0 msgr2=0x7f26b01059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 shutdown_connections 2024-06-02T22:30:14.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-06-02T22:30:14.269+0000 7f26b7cd0700 1 -- 172.21.15.178:0/3386873749 wait complete. 2024-06-02T22:30:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:13 smithi031 ceph-mon[31767]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:15.034 DEBUG:teuthology.orchestra.run.smithi031:mds.a> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.a.service 2024-06-02T22:30:15.039 DEBUG:teuthology.orchestra.run.smithi031:mds.d> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.d.service 2024-06-02T22:30:15.084 DEBUG:teuthology.orchestra.run.smithi031:mds.g> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.g.service 2024-06-02T22:30:15.130 DEBUG:teuthology.orchestra.run.smithi031:mds.j> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.j.service 2024-06-02T22:30:15.177 DEBUG:teuthology.orchestra.run.smithi098:mds.b> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.b.service 2024-06-02T22:30:15.180 DEBUG:teuthology.orchestra.run.smithi098:mds.e> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.e.service 2024-06-02T22:30:15.223 DEBUG:teuthology.orchestra.run.smithi098:mds.h> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.h.service 2024-06-02T22:30:15.266 DEBUG:teuthology.orchestra.run.smithi098:mds.k> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.k.service 2024-06-02T22:30:15.309 DEBUG:teuthology.orchestra.run.smithi178:mds.c> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.c.service 2024-06-02T22:30:15.311 DEBUG:teuthology.orchestra.run.smithi178:mds.f> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.f.service 2024-06-02T22:30:15.354 DEBUG:teuthology.orchestra.run.smithi178:mds.i> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.i.service 2024-06-02T22:30:15.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:15 smithi031 ceph-mon[31767]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:15.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:15 smithi031 ceph-mon[31767]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:30:15.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:15 smithi031 ceph-mon[31767]: Saving service mds.all spec with placement smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-02T22:30:15.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:15.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:15.397 DEBUG:teuthology.orchestra.run.smithi178:mds.l> sudo journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.l.service 2024-06-02T22:30:15.440 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-02T22:30:15.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:15 smithi098 ceph-mon[36750]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:15 smithi098 ceph-mon[36750]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:30:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:15 smithi098 ceph-mon[36750]: Saving service mds.all spec with placement smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-02T22:30:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:15.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:15 smithi178 ceph-mon[36614]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:15.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:15 smithi178 ceph-mon[36614]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:30:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:15 smithi178 ceph-mon[36614]: Saving service mds.all spec with placement smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-02T22:30:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:15.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:30:15.873 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:16.297 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.297 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:16.298 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:16.298 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:16.298 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:16.298 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.298 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:16 smithi031 ceph-mon[31767]: Deploying daemon mds.l on smithi178 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.502 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:16 smithi178 ceph-mon[36614]: Deploying daemon mds.l on smithi178 2024-06-02T22:30:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:30:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:16.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:16 smithi098 ceph-mon[36750]: Deploying daemon mds.l on smithi178 2024-06-02T22:30:17.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:17 smithi178 ceph-mon[36614]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:17.812 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:17 smithi178 systemd[1]: Starting Ceph mds.l for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:17.833 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:17 smithi031 ceph-mon[31767]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:17.887 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:17 smithi098 ceph-mon[36750]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:18.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.178+0000 7f274a400700 1 -- 172.21.15.31:0/3467450089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2744104f80 msgr2=0x7f2744111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:18.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.178+0000 7f274a400700 1 --2- 172.21.15.31:0/3467450089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2744104f80 0x7f2744111440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f273c00b0d0 tx=0x7f273c00b3e0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 -- 172.21.15.31:0/3467450089 shutdown_connections 2024-06-02T22:30:18.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 --2- 172.21.15.31:0/3467450089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2744104f80 0x7f2744111440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 --2- 172.21.15.31:0/3467450089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274410a670 0x7f274410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 --2- 172.21.15.31:0/3467450089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27441045c0 0x7f2744104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 -- 172.21.15.31:0/3467450089 >> 172.21.15.31:0/3467450089 conn(0x7f2744100070 msgr2=0x7f2744102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:18.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 -- 172.21.15.31:0/3467450089 shutdown_connections 2024-06-02T22:30:18.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.179+0000 7f274a400700 1 -- 172.21.15.31:0/3467450089 wait complete. 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.180+0000 7f274a400700 1 Processor -- start 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.180+0000 7f274a400700 1 -- start start 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.180+0000 7f274a400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27441045c0 0x7f27441a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f274a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 0x7f27441a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f274a400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f274a400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2744114970 con 0x7f27441045c0 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f274a400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27441147f0 con 0x7f274410a670 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f274a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2744114af0 con 0x7f2744104f80 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27441045c0 0x7f27441a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57712/0 (socket says 172.21.15.31:57712) 2024-06-02T22:30:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 -- 172.21.15.31:0/1345995022 learned_addr learned my addr 172.21.15.31:0/1345995022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:18.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2743e00700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 0x7f27441a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:18.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 -- 172.21.15.31:0/1345995022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 msgr2=0x7f27441a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:18.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 0x7f27441a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 -- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27441045c0 msgr2=0x7f27441a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27441045c0 0x7f27441a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2749a00700 1 -- 172.21.15.31:0/1345995022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274419b250 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.181+0000 7f2743e00700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 0x7f27441a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f2749a00700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f273c00d010 tx=0x7f273c0079a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c003c00 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f273c022070 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c01b6c0 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274419b4e0 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.182+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27441a7800 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.183+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2744105ce0 con 0x7f274410a670 2024-06-02T22:30:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.185+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f273c009ba0 con 0x7f274410a670 2024-06-02T22:30:18.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.187+0000 7f2741600700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 0x7f272c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:18.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.187+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f273c00f020 con 0x7f274410a670 2024-06-02T22:30:18.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.187+0000 7f2749000700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 0x7f272c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:18.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.188+0000 7f2749000700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 0x7f272c0a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2738009c60 tx=0x7f2738009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:18.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.191+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f273c09cd10 con 0x7f274410a670 2024-06-02T22:30:18.197 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:17 smithi178 podman[67154]: 2024-06-02 22:30:17.833463466 +0000 UTC m=+0.017914039 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:18.197 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:17 smithi178 podman[67154]: 2024-06-02 22:30:17.945492773 +0000 UTC m=+0.129943354 container create fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T22:30:18.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.479+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27441a79d0 con 0x7f274410a670 2024-06-02T22:30:18.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.479+0000 7f2741600700 1 -- 172.21.15.31:0/1345995022 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f273c09c610 con 0x7f274410a670 2024-06-02T22:30:18.480 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T22:30:18.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.482+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 msgr2=0x7f272c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:18.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.482+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 0x7f272c0a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2738009c60 tx=0x7f2738009260 comp rx=0 tx=0).stop 2024-06-02T22:30:18.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.482+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 msgr2=0x7f274419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:18.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.482+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f273c00d010 tx=0x7f273c0079a0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 shutdown_connections 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f272c0a2ca0 0x7f272c0a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f274410a670 0x7f274419aaf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27441045c0 0x7f27441a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 --2- 172.21.15.31:0/1345995022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744104f80 0x7f27441a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 >> 172.21.15.31:0/1345995022 conn(0x7f2744100070 msgr2=0x7f27441015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 shutdown_connections 2024-06-02T22:30:18.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:18.483+0000 7f274a400700 1 -- 172.21.15.31:0/1345995022 wait complete. 2024-06-02T22:30:18.485 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 podman[67154]: 2024-06-02 22:30:18.198353649 +0000 UTC m=+0.382804208 container init fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 podman[67154]: 2024-06-02 22:30:18.201004431 +0000 UTC m=+0.385454991 container start fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 ceph-mds[67174]: -- 172.21.15.178:0/2378885077 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a234645a40 con 0x55a234618800 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: starting mds.l at 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 bash[67154]: fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 2024-06-02T22:30:18.562 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:30:18 smithi178 systemd[1]: Started Ceph mds.l for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6832/1728134779,v1:172.21.15.178:6833/1728134779] up:boot 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: fsmap 1 up:standby 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.385 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.386 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:19.386 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:19.386 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:19.386 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: Deploying daemon mds.k on smithi098 2024-06-02T22:30:19.386 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:19 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1345995022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6832/1728134779,v1:172.21.15.178:6833/1728134779] up:boot 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: fsmap 1 up:standby 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:19.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:19.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: Deploying daemon mds.k on smithi098 2024-06-02T22:30:19.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:19 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1345995022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:19.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:19.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6832/1728134779,v1:172.21.15.178:6833/1728134779] up:boot 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: fsmap 1 up:standby 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: Deploying daemon mds.k on smithi098 2024-06-02T22:30:19.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:19 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1345995022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:20.962 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:20 smithi098 systemd[1]: Starting Ceph mds.k for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:21.238 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:20 smithi098 podman[65939]: 2024-06-02 22:30:20.885817233 +0000 UTC m=+0.017677065 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:21.238 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 podman[65939]: 2024-06-02 22:30:21.010864312 +0000 UTC m=+0.142724177 container create 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:30:21.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:21.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:21 smithi178 ceph-mon[36614]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:21 smithi031 ceph-mon[31767]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:21 smithi098 ceph-mon[36750]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 podman[65939]: 2024-06-02 22:30:21.272471586 +0000 UTC m=+0.404331408 container init 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 podman[65939]: 2024-06-02 22:30:21.275246901 +0000 UTC m=+0.407106733 container start 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 ceph-mds[65958]: -- 172.21.15.98:0/2656920232 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55825b0fda40 con 0x55825b0d1000 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k[65954]: starting mds.k at 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 bash[65939]: 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 2024-06-02T22:30:21.713 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:30:21 smithi098 systemd[1]: Started Ceph mds.k for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:21.851 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: Deploying daemon mds.j on smithi031 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6832/3988257834,v1:172.21.15.98:6833/3988257834] up:boot 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: fsmap 2 up:standby 2024-06-02T22:30:22.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: Deploying daemon mds.j on smithi031 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6832/3988257834,v1:172.21.15.98:6833/3988257834] up:boot 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: fsmap 2 up:standby 2024-06-02T22:30:22.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T22:30:22.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: Deploying daemon mds.j on smithi031 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6832/3988257834,v1:172.21.15.98:6833/3988257834] up:boot 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: fsmap 2 up:standby 2024-06-02T22:30:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T22:30:23.784 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:23 smithi031 ceph-mon[31767]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:23 smithi178 ceph-mon[36614]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:23 smithi098 ceph-mon[36750]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:24.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 -- 172.21.15.31:0/3085139687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 msgr2=0x7f7e0c1112e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:24.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 --2- 172.21.15.31:0/3085139687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c1112e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009f90 tx=0x7f7e0800b330 comp rx=0 tx=0).stop 2024-06-02T22:30:24.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 -- 172.21.15.31:0/3085139687 shutdown_connections 2024-06-02T22:30:24.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 --2- 172.21.15.31:0/3085139687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c1112e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 --2- 172.21.15.31:0/3085139687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 --2- 172.21.15.31:0/3085139687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 0x7f7e0c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.530+0000 7f7e14800700 1 -- 172.21.15.31:0/3085139687 >> 172.21.15.31:0/3085139687 conn(0x7f7e0c0795f0 msgr2=0x7f7e0c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:24.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.531+0000 7f7e14800700 1 -- 172.21.15.31:0/3085139687 shutdown_connections 2024-06-02T22:30:24.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.531+0000 7f7e14800700 1 -- 172.21.15.31:0/3085139687 wait complete. 2024-06-02T22:30:24.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 Processor -- start 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 -- start start 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 0x7f7e0c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c114a40 con 0x7f7e0c0746c0 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c1148c0 con 0x7f7e0c10eef0 2024-06-02T22:30:24.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.532+0000 7f7e14800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c114bc0 con 0x7f7e0c074fe0 2024-06-02T22:30:24.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e11e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:24.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:24.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e11e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52238/0 (socket says 172.21.15.31:52238) 2024-06-02T22:30:24.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e11e00700 1 -- 172.21.15.31:0/1982302883 learned_addr learned my addr 172.21.15.31:0/1982302883 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:24.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e11400700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 0x7f7e0c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 -- 172.21.15.31:0/1982302883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 msgr2=0x7f7e0c19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 0x7f7e0c19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 -- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 msgr2=0x7f7e0c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 -- 172.21.15.31:0/1982302883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c19fdc0 con 0x7f7e0c10eef0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.533+0000 7f7e12800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c19f680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c06acc0 tx=0x7f7e0800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.534+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08021070 con 0x7f7e0c10eef0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.534+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e08007ac0 con 0x7f7e0c10eef0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.534+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08005040 con 0x7f7e0c10eef0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.534+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c1a0050 con 0x7f7e0c10eef0 2024-06-02T22:30:24.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.534+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c1a7930 con 0x7f7e0c10eef0 2024-06-02T22:30:24.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.535+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c069180 con 0x7f7e0c10eef0 2024-06-02T22:30:24.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.537+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7e08024070 con 0x7f7e0c10eef0 2024-06-02T22:30:24.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.538+0000 7f7e06a00700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 0x7f7df40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:24.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.538+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f7e080cf910 con 0x7f7e0c10eef0 2024-06-02T22:30:24.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.539+0000 7f7e11e00700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 0x7f7df40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:24.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.539+0000 7f7e11e00700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 0x7f7df40a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005d10 tx=0x7f7e00009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:24.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.543+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7e0809cd00 con 0x7f7e0c10eef0 2024-06-02T22:30:24.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.828+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e0c1a7b00 con 0x7f7e0c10eef0 2024-06-02T22:30:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.829+0000 7f7e06a00700 1 -- 172.21.15.31:0/1982302883 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f7e080bc090 con 0x7f7e0c10eef0 2024-06-02T22:30:24.830 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:24.830 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T22:30:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 msgr2=0x7f7df40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 0x7f7df40a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e00005d10 tx=0x7f7e00009310 comp rx=0 tx=0).stop 2024-06-02T22:30:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 msgr2=0x7f7e0c19f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c19f680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c06acc0 tx=0x7f7e0800cef0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 shutdown_connections 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7df40a2ca0 0x7f7df40a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e0c10eef0 0x7f7e0c19f680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e0c0746c0 0x7f7e0c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 --2- 172.21.15.31:0/1982302883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e0c074fe0 0x7f7e0c19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 >> 172.21.15.31:0/1982302883 conn(0x7f7e0c0795f0 msgr2=0x7f7e0c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 shutdown_connections 2024-06-02T22:30:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:24.833+0000 7f7e14800700 1 -- 172.21.15.31:0/1982302883 wait complete. 2024-06-02T22:30:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-06-02T22:30:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:25 smithi178 ceph-mon[36614]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:25 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1982302883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:25.839 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:25 smithi031 ceph-mon[31767]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:25.839 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:25 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1982302883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:25 smithi098 ceph-mon[36750]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:25 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1982302883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:26.839 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:26 smithi031 podman[71938]: 2024-06-02 22:30:26.582110432 +0000 UTC m=+0.171725422 container create 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:26 smithi031 podman[71938]: 2024-06-02 22:30:26.920144397 +0000 UTC m=+0.509759430 container init 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:26 smithi031 podman[71938]: 2024-06-02 22:30:26.931369771 +0000 UTC m=+0.520984771 container start 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:26 smithi031 ceph-mds[71964]: -- 172.21.15.31:0/508939463 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f4a22fa40 con 0x561f4a202c00 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: starting mds.j at 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:27 smithi031 bash[71938]: 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 2024-06-02T22:30:27.122 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:30:27 smithi031 systemd[1]: Started Ceph mds.j for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:27.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:27.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:27.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:27.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:27.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:28.737 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:28 smithi031 ceph-mon[31767]: Deploying daemon mds.d on smithi031 2024-06-02T22:30:28.738 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:28 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6834/2351522534,v1:172.21.15.31:6835/2351522534] up:boot 2024-06-02T22:30:28.738 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:28 smithi031 ceph-mon[31767]: fsmap 3 up:standby 2024-06-02T22:30:28.738 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:28 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:30:28.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:28 smithi178 ceph-mon[36614]: Deploying daemon mds.d on smithi031 2024-06-02T22:30:28.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:28 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6834/2351522534,v1:172.21.15.31:6835/2351522534] up:boot 2024-06-02T22:30:28.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:28 smithi178 ceph-mon[36614]: fsmap 3 up:standby 2024-06-02T22:30:28.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:28 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:30:28.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:28 smithi098 ceph-mon[36750]: Deploying daemon mds.d on smithi031 2024-06-02T22:30:28.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:28 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6834/2351522534,v1:172.21.15.31:6835/2351522534] up:boot 2024-06-02T22:30:28.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:28 smithi098 ceph-mon[36750]: fsmap 3 up:standby 2024-06-02T22:30:28.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:28 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:30:29.486 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:29 smithi178 ceph-mon[36614]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:29.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:29 smithi031 ceph-mon[31767]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:29 smithi098 ceph-mon[36750]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:30.607 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:30 smithi031 systemd[1]: Starting Ceph mds.d for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:31.372 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 podman[72348]: 2024-06-02 22:30:31.086738153 +0000 UTC m=+0.034779342 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:31.372 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 podman[72348]: 2024-06-02 22:30:31.212299158 +0000 UTC m=+0.160340384 container create db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:30:31.720 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:31 smithi031 ceph-mon[31767]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:31.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:31 smithi178 ceph-mon[36614]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:31 smithi098 ceph-mon[36750]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:32.019 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 podman[72348]: 2024-06-02 22:30:31.742831701 +0000 UTC m=+0.690872902 container init db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T22:30:32.019 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 podman[72348]: 2024-06-02 22:30:31.752629028 +0000 UTC m=+0.700670254 container start db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-02T22:30:32.019 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 ceph-mds[72390]: -- 172.21.15.31:0/2127950107 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b95783ba40 con 0x55b95780e800 2024-06-02T22:30:32.019 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d[72382]: starting mds.d at 2024-06-02T22:30:32.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 -- 172.21.15.31:0/3436909288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 msgr2=0x7f998410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:32.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 --2- 172.21.15.31:0/3436909288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f998410f2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f997c009f90 tx=0x7f997c00b330 comp rx=0 tx=0).stop 2024-06-02T22:30:32.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 -- 172.21.15.31:0/3436909288 shutdown_connections 2024-06-02T22:30:32.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 --2- 172.21.15.31:0/3436909288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f998410f2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 --2- 172.21.15.31:0/3436909288 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f99841029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 --2- 172.21.15.31:0/3436909288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 0x7f9984107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 -- 172.21.15.31:0/3436909288 >> 172.21.15.31:0/3436909288 conn(0x7f99840fdea0 msgr2=0x7f99841002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:32.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.069+0000 7f9983200700 1 -- 172.21.15.31:0/3436909288 shutdown_connections 2024-06-02T22:30:32.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.070+0000 7f9983200700 1 -- 172.21.15.31:0/3436909288 wait complete. 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 Processor -- start 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 -- start start 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f998419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 0x7f998419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f9984198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9984112730 con 0x7f9984102610 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99841125b0 con 0x7f99841076f0 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.071+0000 7f9983200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99841128b0 con 0x7f9984102fc0 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9981e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f998419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:32.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9981400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 0x7f998419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9981e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f998419e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60386/0 (socket says 172.21.15.31:60386) 2024-06-02T22:30:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9981e00700 1 -- 172.21.15.31:0/3918421279 learned_addr learned my addr 172.21.15.31:0/3918421279 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:32.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f9984198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 -- 172.21.15.31:0/3918421279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 msgr2=0x7f998419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 0x7f998419ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 -- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 msgr2=0x7f998419e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f998419e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 -- 172.21.15.31:0/3918421279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984199070 con 0x7f99841076f0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.072+0000 7f9982800700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f9984198910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f997c009790 tx=0x7f997c00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.073+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c021070 con 0x7f99841076f0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.073+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9984199300 con 0x7f99841076f0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.073+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f997c00be10 con 0x7f99841076f0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.073+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c005040 con 0x7f99841076f0 2024-06-02T22:30:32.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.073+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841a5620 con 0x7f99841076f0 2024-06-02T22:30:32.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.074+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9984069180 con 0x7f99841076f0 2024-06-02T22:30:32.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.076+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f997c024070 con 0x7f99841076f0 2024-06-02T22:30:32.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.078+0000 7f997aa00700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 0x7f99680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:32.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.078+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f997c00f020 con 0x7f99841076f0 2024-06-02T22:30:32.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.078+0000 7f9981e00700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 0x7f99680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:32.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.078+0000 7f9981e00700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 0x7f99680a50e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9984199a50 tx=0x7f9974009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:32.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.082+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f997c02b020 con 0x7f99841076f0 2024-06-02T22:30:32.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.367+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99841a57f0 con 0x7f99841076f0 2024-06-02T22:30:32.368 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:32 smithi031 bash[72348]: db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 2024-06-02T22:30:32.368 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:30:32 smithi031 systemd[1]: Started Ceph mds.d for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:32.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.368+0000 7f997aa00700 1 -- 172.21.15.31:0/3918421279 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f997c09d2d0 con 0x7f99841076f0 2024-06-02T22:30:32.368 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:32.369 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T22:30:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 msgr2=0x7f99680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 0x7f99680a50e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9984199a50 tx=0x7f9974009310 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 msgr2=0x7f9984198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f9984198910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f997c009790 tx=0x7f997c00bc20 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 shutdown_connections 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f99680a2c20 0x7f99680a50e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99841076f0 0x7f9984198910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9984102610 0x7f998419e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 --2- 172.21.15.31:0/3918421279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9984102fc0 0x7f998419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.371+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 >> 172.21.15.31:0/3918421279 conn(0x7f99840fdea0 msgr2=0x7f99840fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.372+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 shutdown_connections 2024-06-02T22:30:32.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:32.372+0000 7f9983200700 1 -- 172.21.15.31:0/3918421279 wait complete. 2024-06-02T22:30:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 4 2024-06-02T22:30:33.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: Deploying daemon mds.e on smithi098 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3918421279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:33.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6836/3658195000,v1:172.21.15.31:6837/3658195000] up:boot 2024-06-02T22:30:33.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: fsmap 4 up:standby 2024-06-02T22:30:33.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T22:30:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: Deploying daemon mds.e on smithi098 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3918421279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6836/3658195000,v1:172.21.15.31:6837/3658195000] up:boot 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: fsmap 4 up:standby 2024-06-02T22:30:33.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T22:30:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: Deploying daemon mds.e on smithi098 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3918421279' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6836/3658195000,v1:172.21.15.31:6837/3658195000] up:boot 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: fsmap 4 up:standby 2024-06-02T22:30:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T22:30:34.672 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 systemd[1]: Starting Ceph mds.e for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:34.927 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 podman[66242]: 2024-06-02 22:30:34.575216215 +0000 UTC m=+0.017196300 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:34.927 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 podman[66242]: 2024-06-02 22:30:34.68370826 +0000 UTC m=+0.125688361 container create 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:34.928 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 podman[66242]: 2024-06-02 22:30:34.928552599 +0000 UTC m=+0.370532678 container init 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:35.212 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 podman[66242]: 2024-06-02 22:30:34.931127501 +0000 UTC m=+0.373107580 container start 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-02T22:30:35.213 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 ceph-mds[66261]: -- 172.21.15.98:0/213266224 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564652d11a40 con 0x564652ce4c00 2024-06-02T22:30:35.213 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: starting mds.e at 2024-06-02T22:30:35.213 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:35 smithi098 bash[66242]: 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 2024-06-02T22:30:35.213 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:30:35 smithi098 systemd[1]: Started Ceph mds.e for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:35.237 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:35.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:35.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:35.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:35.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:35.712 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:35.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:35.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:35.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:36.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:36 smithi178 ceph-mon[36614]: Deploying daemon mds.f on smithi178 2024-06-02T22:30:36.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:36 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6834/2455073763,v1:172.21.15.98:6835/2455073763] up:boot 2024-06-02T22:30:36.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:36 smithi178 ceph-mon[36614]: fsmap 5 up:standby 2024-06-02T22:30:36.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:36 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:30:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:36 smithi031 ceph-mon[31767]: Deploying daemon mds.f on smithi178 2024-06-02T22:30:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:36 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6834/2455073763,v1:172.21.15.98:6835/2455073763] up:boot 2024-06-02T22:30:36.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:36 smithi031 ceph-mon[31767]: fsmap 5 up:standby 2024-06-02T22:30:36.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:36 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:30:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:36 smithi098 ceph-mon[36750]: Deploying daemon mds.f on smithi178 2024-06-02T22:30:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:36 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6834/2455073763,v1:172.21.15.98:6835/2455073763] up:boot 2024-06-02T22:30:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:36 smithi098 ceph-mon[36750]: fsmap 5 up:standby 2024-06-02T22:30:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:36 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:30:37.544 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:37 smithi031 ceph-mon[31767]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:37.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:37 smithi178 ceph-mon[36614]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:37.562 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 systemd[1]: Starting Ceph mds.f for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:37 smithi098 ceph-mon[36750]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:37.966 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 podman[67473]: 2024-06-02 22:30:37.603845473 +0000 UTC m=+0.017318096 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:37.966 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 podman[67473]: 2024-06-02 22:30:37.712091343 +0000 UTC m=+0.125563966 container create d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T22:30:37.966 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 podman[67473]: 2024-06-02 22:30:37.940785963 +0000 UTC m=+0.354258586 container init d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:37.966 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 podman[67473]: 2024-06-02 22:30:37.943575563 +0000 UTC m=+0.357048195 container start d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:37.966 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 ceph-mds[67492]: -- 172.21.15.178:0/2392396273 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560fde9cda40 con 0x560fde9a0c00 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 -- 172.21.15.31:0/3815840849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90107700 msgr2=0x7feb9010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 --2- 172.21.15.31:0/3815840849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90107700 0x7feb9010f2d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feb8800b0d0 tx=0x7feb8800b3e0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 -- 172.21.15.31:0/3815840849 shutdown_connections 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 --2- 172.21.15.31:0/3815840849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90107700 0x7feb9010f2d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 --2- 172.21.15.31:0/3815840849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102620 0x7feb90102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 --2- 172.21.15.31:0/3815840849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90102fd0 0x7feb90107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 -- 172.21.15.31:0/3815840849 >> 172.21.15.31:0/3815840849 conn(0x7feb900fdf10 msgr2=0x7feb90100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 -- 172.21.15.31:0/3815840849 shutdown_connections 2024-06-02T22:30:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.098+0000 7feb8fe00700 1 -- 172.21.15.31:0/3815840849 wait complete. 2024-06-02T22:30:38.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.100+0000 7feb8fe00700 1 Processor -- start 2024-06-02T22:30:38.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.100+0000 7feb8fe00700 1 -- start start 2024-06-02T22:30:38.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.100+0000 7feb8fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.100+0000 7feb8fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 0x7feb9019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8fe00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 0x7feb9019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8fe00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feb90112740 con 0x7feb90102fd0 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8fe00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb901125c0 con 0x7feb90107700 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feb901128c0 con 0x7feb90102620 2024-06-02T22:30:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59280/0 (socket says 172.21.15.31:59280) 2024-06-02T22:30:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 -- 172.21.15.31:0/2332919447 learned_addr learned my addr 172.21.15.31:0/2332919447 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8e000700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 0x7feb9019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:38.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8f400700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 0x7feb9019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 -- 172.21.15.31:0/2332919447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 msgr2=0x7feb9019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 0x7feb9019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 -- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 msgr2=0x7feb9019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 0x7feb9019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8ea00700 1 -- 172.21.15.31:0/2332919447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9019fd20 con 0x7feb90102620 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8e000700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 0x7feb9019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.101+0000 7feb8f400700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 0x7feb9019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.102+0000 7feb8ea00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e9a0 tx=0x7feb8000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.103+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8000cbd0 con 0x7feb90102620 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.103+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb8000cd70 con 0x7feb90102620 2024-06-02T22:30:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.103+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb901a0010 con 0x7feb90102620 2024-06-02T22:30:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.103+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb800187c0 con 0x7feb90102620 2024-06-02T22:30:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.103+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb901a7890 con 0x7feb90102620 2024-06-02T22:30:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.104+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb90069180 con 0x7feb90102620 2024-06-02T22:30:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.106+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb80010430 con 0x7feb90102620 2024-06-02T22:30:38.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.107+0000 7feb87400700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 0x7feb740a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.107+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7feb800ceef0 con 0x7feb90102620 2024-06-02T22:30:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.107+0000 7feb8e000700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 0x7feb740a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:38.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.108+0000 7feb8e000700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 0x7feb740a5160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb90100890 tx=0x7feb7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:38.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.111+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7feb8009c250 con 0x7feb90102620 2024-06-02T22:30:38.311 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: starting mds.f at 2024-06-02T22:30:38.311 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:38 smithi178 bash[67473]: d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 2024-06-02T22:30:38.311 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:30:38 smithi178 systemd[1]: Started Ceph mds.f for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:38.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.398+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb901a7af0 con 0x7feb90102620 2024-06-02T22:30:38.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.398+0000 7feb87400700 1 -- 172.21.15.31:0/2332919447 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5521 (secure 0 0 0) 0x7feb8009bb50 con 0x7feb90102620 2024-06-02T22:30:38.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:38.398 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-06-02T22:30:38.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 msgr2=0x7feb740a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:38.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 0x7feb740a5160 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb90100890 tx=0x7feb7c009260 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 msgr2=0x7feb9019ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e9a0 tx=0x7feb8000ed60 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 shutdown_connections 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7feb740a2ca0 0x7feb740a5160 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb90107700 0x7feb9019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb90102620 0x7feb9019ad10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 --2- 172.21.15.31:0/2332919447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb90102fd0 0x7feb9019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 >> 172.21.15.31:0/2332919447 conn(0x7feb900fdf10 msgr2=0x7feb9010d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:38.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 shutdown_connections 2024-06-02T22:30:38.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:38.402+0000 7feb8fe00700 1 -- 172.21.15.31:0/2332919447 wait complete. 2024-06-02T22:30:38.403 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 7 2024-06-02T22:30:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: Deploying daemon mds.c on smithi178 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6834/262655409,v1:172.21.15.178:6835/262655409] up:boot 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: fsmap 6 up:standby 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:30:39.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:39 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2332919447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: Deploying daemon mds.c on smithi178 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6834/262655409,v1:172.21.15.178:6835/262655409] up:boot 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: fsmap 6 up:standby 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:30:39.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:39 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2332919447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:39.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:39.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:39.482 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: Deploying daemon mds.c on smithi178 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6834/262655409,v1:172.21.15.178:6835/262655409] up:boot 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: fsmap 6 up:standby 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:30:39.483 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:39 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2332919447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:40.562 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 systemd[1]: Starting Ceph mds.c for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:40.856 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 podman[67772]: 2024-06-02 22:30:40.492362353 +0000 UTC m=+0.017281351 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:40.856 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 podman[67772]: 2024-06-02 22:30:40.628898037 +0000 UTC m=+0.153817012 container create 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0) 2024-06-02T22:30:40.856 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 podman[67772]: 2024-06-02 22:30:40.857000932 +0000 UTC m=+0.381919907 container init 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:30:41.287 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:41.311 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 podman[67772]: 2024-06-02 22:30:40.8596151 +0000 UTC m=+0.384534083 container start 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T22:30:41.311 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 ceph-mds[67791]: -- 172.21.15.178:0/4107797014 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557732369a40 con 0x55773233d000 2024-06-02T22:30:41.312 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: starting mds.c at 2024-06-02T22:30:41.312 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 bash[67772]: 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c 2024-06-02T22:30:41.312 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:30:40 smithi178 systemd[1]: Started Ceph mds.c for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:41.789 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:42.196 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:boot 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: fsmap 7 up:standby 2024-06-02T22:30:42.197 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:42 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:30:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:boot 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: fsmap 7 up:standby 2024-06-02T22:30:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:42 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:30:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:boot 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: fsmap 7 up:standby 2024-06-02T22:30:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:42 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:30:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:43 smithi031 ceph-mon[31767]: Deploying daemon mds.h on smithi098 2024-06-02T22:30:43.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:43 smithi178 ceph-mon[36614]: Deploying daemon mds.h on smithi098 2024-06-02T22:30:43.416 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:43 smithi098 ceph-mon[36750]: Deploying daemon mds.h on smithi098 2024-06-02T22:30:43.416 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 systemd[1]: Starting Ceph mds.h for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:43.700 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 podman[66544]: 2024-06-02 22:30:43.319663037 +0000 UTC m=+0.017110661 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:43.701 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 podman[66544]: 2024-06-02 22:30:43.43195153 +0000 UTC m=+0.129399200 container create daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-06-02T22:30:43.962 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 podman[66544]: 2024-06-02 22:30:43.701746773 +0000 UTC m=+0.399194388 container init daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T22:30:43.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 podman[66544]: 2024-06-02 22:30:43.704412736 +0000 UTC m=+0.401860358 container start daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:30:43.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 ceph-mds[66563]: -- 172.21.15.98:0/3806501176 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f809935a40 con 0x55f809909000 2024-06-02T22:30:43.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: starting mds.h at 2024-06-02T22:30:43.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 bash[66544]: daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec 2024-06-02T22:30:43.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:30:43 smithi098 systemd[1]: Started Ceph mds.h for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:44.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:44.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:44.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:44 smithi031 ceph-mon[31767]: Deploying daemon mds.i on smithi178 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 -- 172.21.15.31:0/3534843715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 msgr2=0x7f4920107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 --2- 172.21.15.31:0/3534843715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920107830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4910009990 tx=0x7f4910009ca0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 -- 172.21.15.31:0/3534843715 shutdown_connections 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 --2- 172.21.15.31:0/3534843715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f492010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 --2- 172.21.15.31:0/3534843715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920107830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 --2- 172.21.15.31:0/3534843715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f49201029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.128+0000 7f4925400700 1 -- 172.21.15.31:0/3534843715 >> 172.21.15.31:0/3534843715 conn(0x7f49200795f0 msgr2=0x7f4920079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.129+0000 7f4925400700 1 -- 172.21.15.31:0/3534843715 shutdown_connections 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.129+0000 7f4925400700 1 -- 172.21.15.31:0/3534843715 wait complete. 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.130+0000 7f4925400700 1 Processor -- start 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.130+0000 7f4925400700 1 -- start start 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.130+0000 7f4925400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f4920074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.130+0000 7f4925400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f4925400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f4925400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4920112830 con 0x7f4920102540 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f4925400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f49201126b0 con 0x7f4920102ee0 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f4925400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f49201129b0 con 0x7f4920107450 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42622/0 (socket says 172.21.15.31:42622) 2024-06-02T22:30:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 -- 172.21.15.31:0/2393154371 learned_addr learned my addr 172.21.15.31:0/2393154371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491e800700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f4920074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491f200700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 -- 172.21.15.31:0/2393154371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 msgr2=0x7f4920075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 -- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 msgr2=0x7f4920074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f4920074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491de00700 1 -- 172.21.15.31:0/2393154371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49201a71c0 con 0x7f4920102ee0 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491f200700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.131+0000 7f491e800700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f4920074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:30:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f491de00700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e9a0 tx=0x7f490c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c00ca10 con 0x7f4920102ee0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f490c00cbb0 con 0x7f4920102ee0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49201a74b0 con 0x7f4920102ee0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490c018680 con 0x7f4920102ee0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.132+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49201a7a40 con 0x7f4920102ee0 2024-06-02T22:30:44.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.133+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4920069180 con 0x7f4920102ee0 2024-06-02T22:30:44.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.136+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f490c010430 con 0x7f4920102ee0 2024-06-02T22:30:44.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.137+0000 7f4917400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 0x7f49040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:44.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.137+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f490c0cedc0 con 0x7f4920102ee0 2024-06-02T22:30:44.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.137+0000 7f491e800700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 0x7f49040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:44.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.138+0000 7f491e800700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 0x7f49040a5160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f491000b2e0 tx=0x7f4910005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.142+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f490c09c120 con 0x7f4920102ee0 2024-06-02T22:30:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:44 smithi178 ceph-mon[36614]: Deploying daemon mds.i on smithi178 2024-06-02T22:30:44.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.429+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f492010aa80 con 0x7f4920102ee0 2024-06-02T22:30:44.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.430+0000 7f4917400700 1 -- 172.21.15.31:0/2393154371 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7171 (secure 0 0 0) 0x7f490c09ba20 con 0x7f4920102ee0 2024-06-02T22:30:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:44.430 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 msgr2=0x7f49040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 0x7f49040a5160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f491000b2e0 tx=0x7f4910005fd0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 msgr2=0x7f4920074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f490c00e9a0 tx=0x7f490c00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 shutdown_connections 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f49040a2ca0 0x7f49040a5160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4920107450 0x7f4920075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4920102540 0x7f4920074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 --2- 172.21.15.31:0/2393154371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4920102ee0 0x7f4920074cd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:44.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 >> 172.21.15.31:0/2393154371 conn(0x7f49200795f0 msgr2=0x7f4920100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:44.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 shutdown_connections 2024-06-02T22:30:44.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:44.434+0000 7f4925400700 1 -- 172.21.15.31:0/2393154371 wait complete. 2024-06-02T22:30:44.435 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 9 2024-06-02T22:30:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:44.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:44.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:44.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:44 smithi098 ceph-mon[36750]: Deploying daemon mds.i on smithi178 2024-06-02T22:30:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:45 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6836/511134673,v1:172.21.15.98:6837/511134673] up:boot 2024-06-02T22:30:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:45 smithi031 ceph-mon[31767]: fsmap 8 up:standby 2024-06-02T22:30:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:30:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:45 smithi031 ceph-mon[31767]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2393154371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:45.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:45 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6836/511134673,v1:172.21.15.98:6837/511134673] up:boot 2024-06-02T22:30:45.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:45 smithi178 ceph-mon[36614]: fsmap 8 up:standby 2024-06-02T22:30:45.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:30:45.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:45 smithi178 ceph-mon[36614]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:45.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2393154371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:45.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:45 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6836/511134673,v1:172.21.15.98:6837/511134673] up:boot 2024-06-02T22:30:45.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:45 smithi098 ceph-mon[36750]: fsmap 8 up:standby 2024-06-02T22:30:45.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:30:45.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:45 smithi098 ceph-mon[36750]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:45.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2393154371' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:46.309 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 systemd[1]: Starting Ceph mds.i for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:46.562 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 podman[68072]: 2024-06-02 22:30:46.212652077 +0000 UTC m=+0.017480369 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:46.562 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 podman[68072]: 2024-06-02 22:30:46.353361498 +0000 UTC m=+0.158189822 container create 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-02T22:30:47.061 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 podman[68072]: 2024-06-02 22:30:46.573065965 +0000 UTC m=+0.377894255 container init 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-02T22:30:47.062 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 podman[68072]: 2024-06-02 22:30:46.575967357 +0000 UTC m=+0.380795647 container start 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-02T22:30:47.062 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 ceph-mds[68091]: -- 172.21.15.178:0/572816589 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0f608da40 con 0x55b0f6060c00 2024-06-02T22:30:47.062 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: starting mds.i at 2024-06-02T22:30:47.062 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 bash[68072]: 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 2024-06-02T22:30:47.062 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:30:46 smithi178 systemd[1]: Started Ceph mds.i for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:47.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:47.993 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: Deploying daemon mds.g on smithi031 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:boot 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: fsmap 9 up:standby 2024-06-02T22:30:47.994 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:30:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:48.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: Deploying daemon mds.g on smithi031 2024-06-02T22:30:48.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:boot 2024-06-02T22:30:48.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: fsmap 9 up:standby 2024-06-02T22:30:48.063 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:30:48.165 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:48.166 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.166 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.166 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:48.166 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: Deploying daemon mds.g on smithi031 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:boot 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: fsmap 9 up:standby 2024-06-02T22:30:48.167 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:30:48.451 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:49 smithi178 ceph-mon[36614]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:49 smithi031 ceph-mon[31767]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:49 smithi098 ceph-mon[36750]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:50.310 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:50 smithi031 systemd[1]: Starting Ceph mds.g for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:51.252 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:50 smithi031 podman[73123]: 2024-06-02 22:30:50.852172372 +0000 UTC m=+0.036419451 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:51.252 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:50 smithi031 podman[73123]: 2024-06-02 22:30:50.97158655 +0000 UTC m=+0.155833666 container create 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-06-02T22:30:51.622 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 podman[73123]: 2024-06-02 22:30:51.345874656 +0000 UTC m=+0.530121852 container init 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-06-02T22:30:51.622 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 podman[73123]: 2024-06-02 22:30:51.356914255 +0000 UTC m=+0.541161344 container start 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-02T22:30:51.622 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mds[73156]: -- 172.21.15.31:0/4207978545 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca824a1a40 con 0x55ca82475000 2024-06-02T22:30:51.622 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: starting mds.g at 2024-06-02T22:30:51.623 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 bash[73123]: 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a 2024-06-02T22:30:51.623 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:30:51 smithi031 systemd[1]: Started Ceph mds.g for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:51.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.947+0000 7f0938a00700 1 -- 172.21.15.31:0/1039070214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f093406a170 msgr2=0x7f093406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:51.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.947+0000 7f0938a00700 1 --2- 172.21.15.31:0/1039070214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f093406a170 0x7f093406a5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0920009990 tx=0x7f0920009ca0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 -- 172.21.15.31:0/1039070214 shutdown_connections 2024-06-02T22:30:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 --2- 172.21.15.31:0/1039070214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406ab10 0x7f093410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 --2- 172.21.15.31:0/1039070214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09341084e0 0x7f09341088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 --2- 172.21.15.31:0/1039070214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f093406a170 0x7f093406a5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 -- 172.21.15.31:0/1039070214 >> 172.21.15.31:0/1039070214 conn(0x7f09340782c0 msgr2=0x7f09340786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:51.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 -- 172.21.15.31:0/1039070214 shutdown_connections 2024-06-02T22:30:51.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.948+0000 7f0938a00700 1 -- 172.21.15.31:0/1039070214 wait complete. 2024-06-02T22:30:51.950 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:51.950 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:51.950 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:51.951 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:51.951 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:51.951 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:51.951 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:51.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.949+0000 7f0938a00700 1 Processor -- start 2024-06-02T22:30:51.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.949+0000 7f0938a00700 1 -- start start 2024-06-02T22:30:51.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.949+0000 7f0938a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 0x7f093419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:51.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.949+0000 7f0938a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:51.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0938a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:51.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0938a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0934112740 con 0x7f093406a170 2024-06-02T22:30:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0938a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09341125c0 con 0x7f09341084e0 2024-06-02T22:30:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0938a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f09341128c0 con 0x7f093406ab10 2024-06-02T22:30:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0932800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0931400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0931e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 0x7f093419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0932800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:59884/0 (socket says 172.21.15.31:59884) 2024-06-02T22:30:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0932800700 1 -- 172.21.15.31:0/133958112 learned_addr learned my addr 172.21.15.31:0/133958112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.950+0000 7f0931400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43246/0 (socket says 172.21.15.31:43246) 2024-06-02T22:30:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 -- 172.21.15.31:0/133958112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 msgr2=0x7f093419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 -- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 msgr2=0x7f093419ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 0x7f093419ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 -- 172.21.15.31:0/133958112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093419fe10 con 0x7f093406ab10 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931e00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 0x7f093419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0932800700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0931400700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0920006010 tx=0x7f0920005590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920027070 con 0x7f093406ab10 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0920022470 con 0x7f093406ab10 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.951+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09341a00a0 con 0x7f093406ab10 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.952+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920017630 con 0x7f093406ab10 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.952+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09341a7980 con 0x7f093406ab10 2024-06-02T22:30:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.953+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0934069180 con 0x7f093406ab10 2024-06-02T22:30:51.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.955+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f092002a070 con 0x7f093406ab10 2024-06-02T22:30:51.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.956+0000 7f092aa00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 0x7f09180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:51.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.956+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f09200cf7b0 con 0x7f093406ab10 2024-06-02T22:30:51.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.956+0000 7f0931e00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 0x7f09180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:51.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.957+0000 7f0931e00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 0x7f09180a5160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0924009fd0 tx=0x7f0924009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:51.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:51.960+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0920013070 con 0x7f093406ab10 2024-06-02T22:30:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:52.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:52.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:52.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:52.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.238+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f093419c160 con 0x7f093406ab10 2024-06-02T22:30:52.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.239+0000 7f092aa00700 1 -- 172.21.15.31:0/133958112 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8827 (secure 0 0 0) 0x7f092009cba0 con 0x7f093406ab10 2024-06-02T22:30:52.238 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:52.239 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-06-02T22:30:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 msgr2=0x7f09180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 0x7f09180a5160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0924009fd0 tx=0x7f0924009260 comp rx=0 tx=0).stop 2024-06-02T22:30:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 msgr2=0x7f093419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0920006010 tx=0x7f0920005590 comp rx=0 tx=0).stop 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 shutdown_connections 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f09180a2ca0 0x7f09180a5160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09341084e0 0x7f093419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f093406a170 0x7f093419ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 --2- 172.21.15.31:0/133958112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093406ab10 0x7f093419b340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 >> 172.21.15.31:0/133958112 conn(0x7f09340782c0 msgr2=0x7f093410d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 shutdown_connections 2024-06-02T22:30:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:52.242+0000 7f0938a00700 1 -- 172.21.15.31:0/133958112 wait complete. 2024-06-02T22:30:52.243 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 11 2024-06-02T22:30:53.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:52 smithi178 ceph-mon[36614]: Deploying daemon mds.a on smithi031 2024-06-02T22:30:53.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:52 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:boot 2024-06-02T22:30:53.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:52 smithi178 ceph-mon[36614]: fsmap 10 up:standby 2024-06-02T22:30:53.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:30:53.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:52 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/133958112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:53.087 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:52 smithi031 ceph-mon[31767]: Deploying daemon mds.a on smithi031 2024-06-02T22:30:53.087 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:52 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:boot 2024-06-02T22:30:53.087 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:52 smithi031 ceph-mon[31767]: fsmap 10 up:standby 2024-06-02T22:30:53.087 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:30:53.087 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:52 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/133958112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:52 smithi098 ceph-mon[36750]: Deploying daemon mds.a on smithi031 2024-06-02T22:30:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:52 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:boot 2024-06-02T22:30:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:52 smithi098 ceph-mon[36750]: fsmap 10 up:standby 2024-06-02T22:30:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:30:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:52 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/133958112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:53 smithi178 ceph-mon[36614]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:53 smithi031 ceph-mon[31767]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:53 smithi098 ceph-mon[36750]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:55.154 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:30:55.773 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:55 smithi031 systemd[1]: Starting Ceph mds.a for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:30:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:55 smithi178 ceph-mon[36614]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:55 smithi031 ceph-mon[31767]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:56.121 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:55 smithi031 podman[73519]: 2024-06-02 22:30:55.831354974 +0000 UTC m=+0.039827371 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:30:56.122 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:55 smithi031 podman[73519]: 2024-06-02 22:30:55.982375182 +0000 UTC m=+0.190847619 container create 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-02T22:30:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:55 smithi098 ceph-mon[36750]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:56.553 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:30:56.621 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 podman[73519]: 2024-06-02 22:30:56.303742837 +0000 UTC m=+0.512215298 container init 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS) 2024-06-02T22:30:56.621 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 podman[73519]: 2024-06-02 22:30:56.314543421 +0000 UTC m=+0.523015827 container start 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0) 2024-06-02T22:30:56.621 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 ceph-mds[73557]: -- 172.21.15.31:0/2347485454 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5555fb6044e0 con 0x5555fb5dac00 2024-06-02T22:30:56.622 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 ceph-mds[73557]: -- 172.21.15.31:0/2347485454 <== mon.0 v2:172.21.15.31:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555fb607a40 con 0x5555fb5dac00 2024-06-02T22:30:56.622 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: starting mds.a at 2024-06-02T22:30:56.622 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 bash[73519]: 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 2024-06-02T22:30:56.622 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:30:56 smithi031 systemd[1]: Started Ceph mds.a for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:57.846 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:57.846 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.846 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.846 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: Deploying daemon mds.b on smithi098 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:boot 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: fsmap 11 up:standby 2024-06-02T22:30:57.847 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:57 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:30:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: Deploying daemon mds.b on smithi098 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:boot 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: fsmap 11 up:standby 2024-06-02T22:30:57.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:57 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:30:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: Deploying daemon mds.b on smithi098 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:boot 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: fsmap 11 up:standby 2024-06-02T22:30:58.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:57 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 -- 172.21.15.31:0/483644417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe018108500 msgr2=0x7fe0181088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 --2- 172.21.15.31:0/483644417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe018108500 0x7fe0181088e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0080098f0 tx=0x7fe008009c00 comp rx=0 tx=0).stop 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 -- 172.21.15.31:0/483644417 shutdown_connections 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 --2- 172.21.15.31:0/483644417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe01806ab30 0x7fe01810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 --2- 172.21.15.31:0/483644417 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe018108500 0x7fe0181088e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 --2- 172.21.15.31:0/483644417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806a170 0x7fe01806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 -- 172.21.15.31:0/483644417 >> 172.21.15.31:0/483644417 conn(0x7fe018078340 msgr2=0x7fe018078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 -- 172.21.15.31:0/483644417 shutdown_connections 2024-06-02T22:30:59.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.056+0000 7fe01e400700 1 -- 172.21.15.31:0/483644417 wait complete. 2024-06-02T22:30:59.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.057+0000 7fe01e400700 1 Processor -- start 2024-06-02T22:30:59.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 -- start start 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 0x7fe0181019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe018108500 0x7fe018101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe0181127b0 con 0x7fe01806ab30 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe018112630 con 0x7fe01806a170 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe01e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe018112930 con 0x7fe018108500 2024-06-02T22:30:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.058+0000 7fe017400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:59922/0 (socket says 172.21.15.31:59922) 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 -- 172.21.15.31:0/1304031103 learned_addr learned my addr 172.21.15.31:0/1304031103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe00ea00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 0x7fe0181019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017e00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe018108500 0x7fe018101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 -- 172.21.15.31:0/1304031103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe018108500 msgr2=0x7fe018101ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe018108500 0x7fe018101ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 -- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 msgr2=0x7fe0181019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 0x7fe0181019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 -- 172.21.15.31:0/1304031103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0181a7250 con 0x7fe01806a170 2024-06-02T22:30:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe00ea00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 0x7fe0181019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.059+0000 7fe017400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe008005950 tx=0x7fe0080050f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.060+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008005390 con 0x7fe01806a170 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.060+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe008005530 con 0x7fe01806a170 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.060+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0181a74e0 con 0x7fe01806a170 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.060+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008003d40 con 0x7fe01806a170 2024-06-02T22:30:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.060+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181a7930 con 0x7fe01806a170 2024-06-02T22:30:59.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.061+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01810a9e0 con 0x7fe01806a170 2024-06-02T22:30:59.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.063+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe00800b560 con 0x7fe01806a170 2024-06-02T22:30:59.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.064+0000 7fe014c00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 0x7fdff80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:30:59.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.064+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe0080cfee0 con 0x7fe01806a170 2024-06-02T22:30:59.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.064+0000 7fe00ea00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 0x7fdff80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:30:59.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.065+0000 7fe00ea00700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 0x7fdff80a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe018078a60 tx=0x7fe000009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:30:59.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.069+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe008013030 con 0x7fe01806a170 2024-06-02T22:30:59.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.347+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe018102990 con 0x7fe01806a170 2024-06-02T22:30:59.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.348+0000 7fe014c00700 1 -- 172.21.15.31:0/1304031103 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9653 (secure 0 0 0) 0x7fe00809d2d0 con 0x7fe01806a170 2024-06-02T22:30:59.347 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:30:59.347 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-06-02T22:30:59.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 msgr2=0x7fdff80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:59.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 0x7fdff80a50e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe018078a60 tx=0x7fe000009310 comp rx=0 tx=0).stop 2024-06-02T22:30:59.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 msgr2=0x7fe018101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:30:59.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe008005950 tx=0x7fe0080050f0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 shutdown_connections 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdff80a2c20 0x7fdff80a50e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe018108500 0x7fe018101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe01806a170 0x7fe018101460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 --2- 172.21.15.31:0/1304031103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe01806ab30 0x7fe0181019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 >> 172.21.15.31:0/1304031103 conn(0x7fe018078340 msgr2=0x7fe0181001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 shutdown_connections 2024-06-02T22:30:59.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:30:59.351+0000 7fe01e400700 1 -- 172.21.15.31:0/1304031103 wait complete. 2024-06-02T22:30:59.352 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-06-02T22:30:59.588 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:30:59 smithi098 systemd[1]: Started Ceph mds.b for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1304031103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:30:59 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:30:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1304031103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:30:59.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:30:59.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:30:59 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1304031103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:30:59 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:00 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:boot 2024-06-02T22:31:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:00 smithi031 ceph-mon[31767]: fsmap 12 up:standby 2024-06-02T22:31:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:00 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:31:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:00 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:00.918 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:00 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:boot 2024-06-02T22:31:00.919 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:00 smithi178 ceph-mon[36614]: fsmap 12 up:standby 2024-06-02T22:31:00.919 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:00 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:31:00.919 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:00 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:00.936 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:00 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:boot 2024-06-02T22:31:00.936 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:00 smithi098 ceph-mon[36750]: fsmap 12 up:standby 2024-06-02T22:31:00.936 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:00 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:31:00.936 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:00 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:01.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:01 smithi031 ceph-mon[31767]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:01.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:01 smithi098 ceph-mon[36750]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:01 smithi178 ceph-mon[36614]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.289 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:31:02.740 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:02.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:03.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:03 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:04.030 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.031 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:03 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:04.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:03 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:31:05.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 -- 172.21.15.31:0/3782785936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e41094c0 msgr2=0x7f44e4115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 --2- 172.21.15.31:0/3782785936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e41094c0 0x7f44e4115980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00b0a0 tx=0x7f44dc00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 -- 172.21.15.31:0/3782785936 shutdown_connections 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 --2- 172.21.15.31:0/3782785936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e41094c0 0x7f44e4115980 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 --2- 172.21.15.31:0/3782785936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e410eab0 0x7f44e410ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 --2- 172.21.15.31:0/3782785936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 0x7f44e4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.067+0000 7f44ea200700 1 -- 172.21.15.31:0/3782785936 >> 172.21.15.31:0/3782785936 conn(0x7f44e4075c60 msgr2=0x7f44e4078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.068+0000 7f44ea200700 1 -- 172.21.15.31:0/3782785936 shutdown_connections 2024-06-02T22:31:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.068+0000 7f44ea200700 1 -- 172.21.15.31:0/3782785936 wait complete. 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.069+0000 7f44ea200700 1 Processor -- start 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.069+0000 7f44ea200700 1 -- start start 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.069+0000 7f44ea200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 0x7f44e419f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.069+0000 7f44ea200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44ea200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 0x7f44e41a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44ea200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4118e30 con 0x7f44e41094c0 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44ea200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4118cb0 con 0x7f44e410eab0 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44ea200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4118fb0 con 0x7f44e4108b00 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44dbe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:05.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44dbe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41608/0 (socket says 172.21.15.31:41608) 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 0x7f44e419f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44dbe00700 1 -- 172.21.15.31:0/1501744718 learned_addr learned my addr 172.21.15.31:0/1501744718 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 0x7f44e41a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 -- 172.21.15.31:0/1501744718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 msgr2=0x7f44e419f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 0x7f44e419f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 -- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 msgr2=0x7f44e419f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.070+0000 7f44e3e00700 1 -- 172.21.15.31:0/1501744718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e41a41e0 con 0x7f44e410eab0 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44dbe00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:05.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44e3e00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 0x7f44e41a3aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00b070 tx=0x7f44dc004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc021070 con 0x7f44e410eab0 2024-06-02T22:31:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44dc007b80 con 0x7f44e410eab0 2024-06-02T22:31:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e41a4470 con 0x7f44e410eab0 2024-06-02T22:31:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc005040 con 0x7f44e410eab0 2024-06-02T22:31:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.071+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e41abd50 con 0x7f44e410eab0 2024-06-02T22:31:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.072+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e4069180 con 0x7f44e410eab0 2024-06-02T22:31:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.074+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f44dc024070 con 0x7f44e410eab0 2024-06-02T22:31:05.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.076+0000 7f44e0c00700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 0x7f44c80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:05.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.076+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f44dc00f020 con 0x7f44e410eab0 2024-06-02T22:31:05.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.076+0000 7f44e3400700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 0x7f44c80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:05.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.077+0000 7f44e3400700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 0x7f44c80a5160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009be0 tx=0x7f44d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.080+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f44dc02b020 con 0x7f44e410eab0 2024-06-02T22:31:05.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.369+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44e41a0530 con 0x7f44e410eab0 2024-06-02T22:31:05.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.370+0000 7f44e0c00700 1 -- 172.21.15.31:0/1501744718 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10479 (secure 0 0 0) 0x7f44dc007d30 con 0x7f44e410eab0 2024-06-02T22:31:05.371 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:05.371 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 msgr2=0x7f44c80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 0x7f44c80a5160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009be0 tx=0x7f44d4009260 comp rx=0 tx=0).stop 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 msgr2=0x7f44e41a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 0x7f44e41a3aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00b070 tx=0x7f44dc004c80 comp rx=0 tx=0).stop 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 shutdown_connections 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f44c80a2ca0 0x7f44c80a5160 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f44e410eab0 0x7f44e41a3aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44e4108b00 0x7f44e419f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 --2- 172.21.15.31:0/1501744718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f44e41094c0 0x7f44e419f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:05.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.373+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 >> 172.21.15.31:0/1501744718 conn(0x7f44e4075c60 msgr2=0x7f44e4076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:05.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.374+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 shutdown_connections 2024-06-02T22:31:05.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:05.374+0000 7f44ea200700 1 -- 172.21.15.31:0/1501744718 wait complete. 2024-06-02T22:31:05.375 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 13 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:05.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:05.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:05.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:06.603 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:06 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1501744718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:06.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-02T22:31:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:06 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1501744718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:06.762 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:06 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1501744718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:07.121 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:07.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:07 smithi031 ceph-mon[31767]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:07.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:07 smithi098 ceph-mon[36750]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:07.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:07 smithi178 ceph-mon[36614]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:09.289 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.289 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.289 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:09.290 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:09.290 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.290 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:09 smithi031 ceph-mon[31767]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:09.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:09.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:09 smithi098 ceph-mon[36750]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:09.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:31:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:31:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:31:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:09 smithi178 ceph-mon[36614]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 -- 172.21.15.31:0/266749925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5410a690 msgr2=0x7f5b5410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 --2- 172.21.15.31:0/266749925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5410a690 0x7f5b5410aa70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b440098f0 tx=0x7f5b44009c00 comp rx=0 tx=0).stop 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 -- 172.21.15.31:0/266749925 shutdown_connections 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 --2- 172.21.15.31:0/266749925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54105050 0x7f5b54111560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 --2- 172.21.15.31:0/266749925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b5410a690 0x7f5b5410aa70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 --2- 172.21.15.31:0/266749925 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b54104690 0x7f5b54104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 -- 172.21.15.31:0/266749925 >> 172.21.15.31:0/266749925 conn(0x7f5b541001a0 msgr2=0x7f5b541025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.592+0000 7f5b59200700 1 -- 172.21.15.31:0/266749925 shutdown_connections 2024-06-02T22:31:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.593+0000 7f5b59200700 1 -- 172.21.15.31:0/266749925 wait complete. 2024-06-02T22:31:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.594+0000 7f5b59200700 1 Processor -- start 2024-06-02T22:31:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.594+0000 7f5b59200700 1 -- start start 2024-06-02T22:31:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54104690 0x7f5b5419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b54105050 0x7f5b5419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54114a30 con 0x7f5b5410a690 2024-06-02T22:31:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b541148b0 con 0x7f5b54105050 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b59200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5b54114bb0 con 0x7f5b54104690 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b52800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b51e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54104690 0x7f5b5419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b52800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41616/0 (socket says 172.21.15.31:41616) 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b52800700 1 -- 172.21.15.31:0/2551733128 learned_addr learned my addr 172.21.15.31:0/2551733128 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.595+0000 7f5b51400700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b54105050 0x7f5b5419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 -- 172.21.15.31:0/2551733128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54104690 msgr2=0x7f5b5419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54104690 0x7f5b5419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 -- 172.21.15.31:0/2551733128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b54105050 msgr2=0x7f5b5419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b54105050 0x7f5b5419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 -- 172.21.15.31:0/2551733128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5419fe90 con 0x7f5b5410a690 2024-06-02T22:31:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b52800700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00ef30 tx=0x7f5b4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0092e0 con 0x7f5b5410a690 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b541a0120 con 0x7f5b5410a690 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4c004bb0 con 0x7f5b5410a690 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c004280 con 0x7f5b5410a690 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.596+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b541a7a00 con 0x7f5b5410a690 2024-06-02T22:31:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.598+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b5410cc20 con 0x7f5b5410a690 2024-06-02T22:31:09.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.600+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5b4c01b030 con 0x7f5b5410a690 2024-06-02T22:31:09.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.601+0000 7f5b4aa00700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 0x7f5b380a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:09.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.601+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5b4c0ce6a0 con 0x7f5b5410a690 2024-06-02T22:31:09.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.601+0000 7f5b51e00700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 0x7f5b380a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:09.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.602+0000 7f5b51e00700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 0x7f5b380a50e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009810 tx=0x7f5b44019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:09.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.605+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b4c022020 con 0x7f5b5410a690 2024-06-02T22:31:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.835+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5b5419c1e0 con 0x7f5b5410a690 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.836+0000 7f5b4aa00700 1 -- 172.21.15.31:0/2551733128 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f5b4c010040 con 0x7f5b5410a690 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:31:09.837 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-06-02T22:31:09.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 msgr2=0x7f5b380a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 0x7f5b380a50e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009810 tx=0x7f5b44019040 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 msgr2=0x7f5b5419f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00ef30 tx=0x7f5b4c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 shutdown_connections 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b380a2c20 0x7f5b380a50e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b5410a690 0x7f5b5419f750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b54104690 0x7f5b5419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 --2- 172.21.15.31:0/2551733128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b54105050 0x7f5b5419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 >> 172.21.15.31:0/2551733128 conn(0x7f5b541001a0 msgr2=0x7f5b541007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 shutdown_connections 2024-06-02T22:31:09.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:09.840+0000 7f5b59200700 1 -- 172.21.15.31:0/2551733128 wait complete. 2024-06-02T22:31:10.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:10 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2551733128' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T22:31:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:10 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2551733128' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T22:31:10.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:10 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2551733128' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T22:31:10.791 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T22:31:10.792 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T22:31:11.275 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:11.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:11 smithi031 ceph-mon[31767]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:11 smithi098 ceph-mon[36750]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:11.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:11 smithi178 ceph-mon[36614]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:13.447 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:13 smithi031 ceph-mon[31767]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:13.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:13 smithi178 ceph-mon[36614]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:13 smithi098 ceph-mon[36750]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 -- 172.21.15.31:0/2082610948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d010eac0 msgr2=0x7fd3d010eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 --2- 172.21.15.31:0/2082610948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d010eac0 0x7fd3d010eea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009990 tx=0x7fd3c0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 -- 172.21.15.31:0/2082610948 shutdown_connections 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 --2- 172.21.15.31:0/2082610948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d0115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 --2- 172.21.15.31:0/2082610948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d010eac0 0x7fd3d010eea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 --2- 172.21.15.31:0/2082610948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d0108ac0 0x7fd3d0108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 -- 172.21.15.31:0/2082610948 >> 172.21.15.31:0/2082610948 conn(0x7fd3d0075c60 msgr2=0x7fd3d01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 -- 172.21.15.31:0/2082610948 shutdown_connections 2024-06-02T22:31:13.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.768+0000 7fd3d6400700 1 -- 172.21.15.31:0/2082610948 wait complete. 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 Processor -- start 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 -- start start 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d010eac0 0x7fd3d01a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0118e60 con 0x7fd3d0108ac0 2024-06-02T22:31:13.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0118ce0 con 0x7fd3d0109480 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.769+0000 7fd3d6400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d0118fe0 con 0x7fd3d010eac0 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56810/0 (socket says 172.21.15.31:56810) 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 -- 172.21.15.31:0/1845188703 learned_addr learned my addr 172.21.15.31:0/1845188703 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cea00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:13.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cfe00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d010eac0 0x7fd3d01a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 -- 172.21.15.31:0/1845188703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d010eac0 msgr2=0x7fd3d01a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d010eac0 0x7fd3d01a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 -- 172.21.15.31:0/1845188703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 msgr2=0x7fd3d019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cf400700 1 -- 172.21.15.31:0/1845188703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d01a42c0 con 0x7fd3d0108ac0 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.770+0000 7fd3cea00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3cf400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0005910 tx=0x7fd3c000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:13.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0027070 con 0x7fd3d0108ac0 2024-06-02T22:31:13.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c0003d70 con 0x7fd3d0108ac0 2024-06-02T22:31:13.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d01a4550 con 0x7fd3d0108ac0 2024-06-02T22:31:13.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000f460 con 0x7fd3d0108ac0 2024-06-02T22:31:13.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.771+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d01abe30 con 0x7fd3d0108ac0 2024-06-02T22:31:13.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.773+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d0069180 con 0x7fd3d0108ac0 2024-06-02T22:31:13.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.775+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd3c002a070 con 0x7fd3d0108ac0 2024-06-02T22:31:13.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.776+0000 7fd3c7e00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 0x7fd3b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:13.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.776+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd3c00d01b0 con 0x7fd3d0108ac0 2024-06-02T22:31:13.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.776+0000 7fd3cea00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 0x7fd3b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:13.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.777+0000 7fd3cea00700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 0x7fd3b40a50e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0077bb0 tx=0x7fd3bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:13.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:13.779+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd3c0031070 con 0x7fd3d0108ac0 2024-06-02T22:31:14.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.011+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd3d002dca0 con 0x7fd3d0108ac0 2024-06-02T22:31:14.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.619+0000 7fd3c7e00700 1 -- 172.21.15.31:0/1845188703 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7fd3c0013070 con 0x7fd3d0108ac0 2024-06-02T22:31:14.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.624+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 msgr2=0x7fd3b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:14.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.624+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 0x7fd3b40a50e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0077bb0 tx=0x7fd3bc009260 comp rx=0 tx=0).stop 2024-06-02T22:31:14.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.624+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 msgr2=0x7fd3d019f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:14.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.624+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0005910 tx=0x7fd3c000bab0 comp rx=0 tx=0).stop 2024-06-02T22:31:14.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 shutdown_connections 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3b40a2c20 0x7fd3b40a50e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d010eac0 0x7fd3d01a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3d0108ac0 0x7fd3d019f2b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 --2- 172.21.15.31:0/1845188703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3d0109480 0x7fd3d019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.625+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 >> 172.21.15.31:0/1845188703 conn(0x7fd3d0075c60 msgr2=0x7fd3d0076240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.626+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 shutdown_connections 2024-06-02T22:31:14.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:14.626+0000 7fd3d6400700 1 -- 172.21.15.31:0/1845188703 wait complete. 2024-06-02T22:31:14.631 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-06-02T22:31:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:14 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T22:31:15.035 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:14 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T22:31:15.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:14 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T22:31:15.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-02T22:31:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:15 smithi031 ceph-mon[31767]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:15 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T22:31:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:15 smithi031 ceph-mon[31767]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T22:31:15.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:15 smithi031 ceph-mon[31767]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T22:31:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:15 smithi098 ceph-mon[36750]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:15 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T22:31:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:15 smithi098 ceph-mon[36750]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T22:31:15.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:15 smithi098 ceph-mon[36750]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T22:31:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:15 smithi178 ceph-mon[36614]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:15 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1845188703' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T22:31:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:15 smithi178 ceph-mon[36614]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T22:31:16.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:15 smithi178 ceph-mon[36614]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T22:31:16.088 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:16 smithi031 ceph-mon[31767]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:16.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:16 smithi031 ceph-mon[31767]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T22:31:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:16 smithi098 ceph-mon[36750]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:16.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:16 smithi098 ceph-mon[36750]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T22:31:17.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:16 smithi178 ceph-mon[36614]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:17.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:16 smithi178 ceph-mon[36614]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T22:31:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:17 smithi098 ceph-mon[36750]: pgmap v324: 33 pgs: 1 creating+activating, 8 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:18.049 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:17 smithi031 ceph-mon[31767]: pgmap v324: 33 pgs: 1 creating+activating, 8 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:17 smithi178 ceph-mon[36614]: pgmap v324: 33 pgs: 1 creating+activating, 8 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 -- 172.21.15.31:0/1982984396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330107700 msgr2=0x7fb33010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 --2- 172.21.15.31:0/1982984396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330107700 0x7fb33010f2d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb328009fc0 tx=0x7fb32800b330 comp rx=0 tx=0).stop 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 -- 172.21.15.31:0/1982984396 shutdown_connections 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 --2- 172.21.15.31:0/1982984396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330107700 0x7fb33010f2d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 --2- 172.21.15.31:0/1982984396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 --2- 172.21.15.31:0/1982984396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330102fd0 0x7fb330107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 -- 172.21.15.31:0/1982984396 >> 172.21.15.31:0/1982984396 conn(0x7fb3300fdf10 msgr2=0x7fb330100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:18.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 -- 172.21.15.31:0/1982984396 shutdown_connections 2024-06-02T22:31:18.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.662+0000 7fb334c00700 1 -- 172.21.15.31:0/1982984396 wait complete. 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.663+0000 7fb334c00700 1 Processor -- start 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.663+0000 7fb334c00700 1 -- start start 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330107700 0x7fb330075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb330112740 con 0x7fb330102fd0 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301125c0 con 0x7fb330102620 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb334c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb3301128c0 con 0x7fb330107700 2024-06-02T22:31:18.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56826/0 (socket says 172.21.15.31:56826) 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb32f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 -- 172.21.15.31:0/1865795752 learned_addr learned my addr 172.21.15.31:0/1865795752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb32fe00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330107700 0x7fb330075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 -- 172.21.15.31:0/1865795752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330107700 msgr2=0x7fb330075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330107700 0x7fb330075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 -- 172.21.15.31:0/1865795752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 msgr2=0x7fb330074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.664+0000 7fb326a00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb326a00700 1 -- 172.21.15.31:0/1865795752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3301a7060 con 0x7fb330102fd0 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb32f400700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:18.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb326a00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ea30 tx=0x7fb31800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:18.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31800cbd0 con 0x7fb330102fd0 2024-06-02T22:31:18.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb318004500 con 0x7fb330102fd0 2024-06-02T22:31:18.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318003e30 con 0x7fb330102fd0 2024-06-02T22:31:18.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.665+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3301a7350 con 0x7fb330102fd0 2024-06-02T22:31:18.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.666+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3301a7840 con 0x7fb330102fd0 2024-06-02T22:31:18.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.667+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb330069180 con 0x7fb330102fd0 2024-06-02T22:31:18.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.669+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb318004000 con 0x7fb330102fd0 2024-06-02T22:31:18.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.670+0000 7fb32cc00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 0x7fb3140a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:18.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.671+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7fb3180cee40 con 0x7fb330102fd0 2024-06-02T22:31:18.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.671+0000 7fb32f400700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 0x7fb3140a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:18.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.671+0000 7fb32f400700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 0x7fb3140a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb320009750 tx=0x7fb320009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:18.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.674+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb31809c030 con 0x7fb330102fd0 2024-06-02T22:31:18.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:18.913+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb330075cc0 con 0x7fb330102fd0 2024-06-02T22:31:19.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.715+0000 7fb32cc00700 1 -- 172.21.15.31:0/1865795752 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v85) ==== 171+0+0 (secure 0 0 0) 0x7fb330075cc0 con 0x7fb330102fd0 2024-06-02T22:31:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.722+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 msgr2=0x7fb3140a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.722+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 0x7fb3140a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb320009750 tx=0x7fb320009310 comp rx=0 tx=0).stop 2024-06-02T22:31:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.722+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 msgr2=0x7fb330074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.722+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ea30 tx=0x7fb31800ed40 comp rx=0 tx=0).stop 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 shutdown_connections 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb3140a2ca0 0x7fb3140a5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb330107700 0x7fb330075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb330102620 0x7fb330074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 --2- 172.21.15.31:0/1865795752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb330102fd0 0x7fb330074cd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:19.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.723+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 >> 172.21.15.31:0/1865795752 conn(0x7fb3300fdf10 msgr2=0x7fb3300fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:19.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.725+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 shutdown_connections 2024-06-02T22:31:19.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:19.725+0000 7fb334c00700 1 -- 172.21.15.31:0/1865795752 wait complete. 2024-06-02T22:31:19.730 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-06-02T22:31:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:19 smithi098 ceph-mon[36750]: pgmap v326: 33 pgs: 1 creating+activating, 8 creating+peering, 19 active+clean, 5 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:19 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T22:31:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:19 smithi178 ceph-mon[36614]: pgmap v326: 33 pgs: 1 creating+activating, 8 creating+peering, 19 active+clean, 5 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:20.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:19 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T22:31:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:19 smithi031 ceph-mon[31767]: pgmap v326: 33 pgs: 1 creating+activating, 8 creating+peering, 19 active+clean, 5 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:20.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:19 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-02T22:31:20.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T22:31:20.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:20 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T22:31:20.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:20 smithi031 ceph-mon[31767]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T22:31:20.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:20 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T22:31:20.983 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:20 smithi098 ceph-mon[36750]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T22:31:21.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:20 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1865795752' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-02T22:31:21.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:20 smithi178 ceph-mon[36614]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T22:31:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:21 smithi031 ceph-mon[31767]: pgmap v328: 97 pgs: 55 unknown, 9 creating+peering, 1 creating+activating, 32 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:21 smithi031 ceph-mon[31767]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T22:31:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:21 smithi178 ceph-mon[36614]: pgmap v328: 97 pgs: 55 unknown, 9 creating+peering, 1 creating+activating, 32 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:22.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:21 smithi178 ceph-mon[36614]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T22:31:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:21 smithi098 ceph-mon[36750]: pgmap v328: 97 pgs: 55 unknown, 9 creating+peering, 1 creating+activating, 32 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:21 smithi098 ceph-mon[36750]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T22:31:22.835 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:22 smithi031 ceph-mon[31767]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T22:31:23.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:22 smithi178 ceph-mon[36614]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T22:31:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:22 smithi098 ceph-mon[36750]: osdmap e87: 12 total, 12 up, 12 in 2024-06-02T22:31:23.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.352+0000 7fbdb0a00700 1 -- 172.21.15.31:0/3500384241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102fd0 msgr2=0x7fbdac107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:23.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.352+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/3500384241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102fd0 0x7fbdac107020 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbd940099c0 tx=0x7fbd94009cd0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.352+0000 7fbdb0a00700 1 -- 172.21.15.31:0/3500384241 shutdown_connections 2024-06-02T22:31:23.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.352+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/3500384241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 0x7fbdac10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.352+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/3500384241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102620 0x7fbdac102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.353+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/3500384241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102fd0 0x7fbdac107020 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.353+0000 7fbdb0a00700 1 -- 172.21.15.31:0/3500384241 >> 172.21.15.31:0/3500384241 conn(0x7fbdac0fdf10 msgr2=0x7fbdac100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:23.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.353+0000 7fbdb0a00700 1 -- 172.21.15.31:0/3500384241 shutdown_connections 2024-06-02T22:31:23.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.353+0000 7fbdb0a00700 1 -- 172.21.15.31:0/3500384241 wait complete. 2024-06-02T22:31:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 Processor -- start 2024-06-02T22:31:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 -- start start 2024-06-02T22:31:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 0x7fbdac19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 0x7fbdac19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:23.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 0x7fbdac19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1126c0 con 0x7fbdac102620 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac112540 con 0x7fbdac102fd0 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.354+0000 7fbdb0a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac112840 con 0x7fbdac107700 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbdaa800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 0x7fbdac19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 0x7fbdac19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbdaa800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 0x7fbdac19ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46354/0 (socket says 172.21.15.31:46354) 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbdaa800700 1 -- 172.21.15.31:0/4065462040 learned_addr learned my addr 172.21.15.31:0/4065462040 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbdab200700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 0x7fbdac19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 -- 172.21.15.31:0/4065462040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 msgr2=0x7fbdac19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 0x7fbdac19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 -- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 msgr2=0x7fbdac19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 0x7fbdac19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 -- 172.21.15.31:0/4065462040 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac19fdf0 con 0x7fbdac102fd0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.355+0000 7fbda1e00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 0x7fbdac19b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400b580 tx=0x7fbd94003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.356+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009e60 con 0x7fbdac102fd0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.356+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac1a0080 con 0x7fbdac102fd0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.356+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd94003680 con 0x7fbdac102fd0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.356+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400fda0 con 0x7fbdac102fd0 2024-06-02T22:31:23.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.356+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a7960 con 0x7fbdac102fd0 2024-06-02T22:31:23.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.357+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac069180 con 0x7fbdac102fd0 2024-06-02T22:31:23.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.359+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbd9400f460 con 0x7fbdac102fd0 2024-06-02T22:31:23.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.360+0000 7fbda3e00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 0x7fbd900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:23.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.361+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7fbd940cf780 con 0x7fbdac102fd0 2024-06-02T22:31:23.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.361+0000 7fbdaa800700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 0x7fbd900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:23.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.361+0000 7fbdaa800700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 0x7fbd900a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009d20 tx=0x7fbd9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:23.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.363+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbd94013070 con 0x7fbdac102fd0 2024-06-02T22:31:23.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.642+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbdac1a7b30 con 0x7fbdac102fd0 2024-06-02T22:31:23.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.757+0000 7fbda3e00700 1 -- 172.21.15.31:0/4065462040 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fbd9409c880 con 0x7fbdac102fd0 2024-06-02T22:31:23.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.763+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 msgr2=0x7fbd900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.763+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 0x7fbd900a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009d20 tx=0x7fbd9c009260 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.763+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 msgr2=0x7fbdac19b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.763+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 0x7fbdac19b320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400b580 tx=0x7fbd94003e00 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 shutdown_connections 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd900a2c20 0x7fbd900a50e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac107700 0x7fbdac19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac102620 0x7fbdac19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 --2- 172.21.15.31:0/4065462040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdac102fd0 0x7fbdac19b320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:23.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 >> 172.21.15.31:0/4065462040 conn(0x7fbdac0fdf10 msgr2=0x7fbdac10efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:23.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.764+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 shutdown_connections 2024-06-02T22:31:23.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:23.765+0000 7fbdb0a00700 1 -- 172.21.15.31:0/4065462040 wait complete. 2024-06-02T22:31:23.767 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T22:31:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:23 smithi178 ceph-mon[36614]: pgmap v331: 97 pgs: 21 unknown, 11 creating+peering, 65 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:23 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/4065462040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:23 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:23 smithi178 ceph-mon[36614]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-06-02T22:31:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:23 smithi031 ceph-mon[31767]: pgmap v331: 97 pgs: 21 unknown, 11 creating+peering, 65 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:23 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/4065462040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:23 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:23 smithi031 ceph-mon[31767]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-06-02T22:31:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:23 smithi098 ceph-mon[36750]: pgmap v331: 97 pgs: 21 unknown, 11 creating+peering, 65 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:23 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/4065462040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:23 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T22:31:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:23 smithi098 ceph-mon[36750]: daemon mds.a assigned to filesystem cephfs as rank 0 2024-06-02T22:31:24.616 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-02T22:31:24.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-02T22:31:24.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:24 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T22:31:24.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:24 smithi031 ceph-mon[31767]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T22:31:24.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:24 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-06-02T22:31:24.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:24 smithi031 ceph-mon[31767]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-06-02T22:31:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:24 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T22:31:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:24 smithi178 ceph-mon[36614]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T22:31:25.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:24 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-06-02T22:31:25.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:24 smithi178 ceph-mon[36614]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-06-02T22:31:25.088 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:24 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T22:31:25.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:24 smithi098 ceph-mon[36750]: osdmap e88: 12 total, 12 up, 12 in 2024-06-02T22:31:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:24 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:creating} 11 up:standby 2024-06-02T22:31:25.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:24 smithi098 ceph-mon[36750]: daemon mds.a is now active in filesystem cephfs as rank 0 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: pgmap v333: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: Cluster is now healthy 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:active 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:25 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: pgmap v333: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T22:31:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: Cluster is now healthy 2024-06-02T22:31:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:active 2024-06-02T22:31:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:25 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: pgmap v333: 97 pgs: 11 creating+peering, 86 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-02T22:31:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: Cluster is now healthy 2024-06-02T22:31:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] up:active 2024-06-02T22:31:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:25 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:27.042 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:31:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: 2024-06-02T22:31:26.790+0000 7f4165200700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 -- 172.21.15.31:0/741196535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 msgr2=0x7f18ac107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 --2- 172.21.15.31:0/741196535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac107110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1898009990 tx=0x7f1898009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 -- 172.21.15.31:0/741196535 shutdown_connections 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 --2- 172.21.15.31:0/741196535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac107840 0x7f18ac10f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 --2- 172.21.15.31:0/741196535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac102740 0x7f18ac102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 --2- 172.21.15.31:0/741196535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac107110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 -- 172.21.15.31:0/741196535 >> 172.21.15.31:0/741196535 conn(0x7f18ac0795f0 msgr2=0x7f18ac079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:27.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.210+0000 7f18b3000700 1 -- 172.21.15.31:0/741196535 shutdown_connections 2024-06-02T22:31:27.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.211+0000 7f18b3000700 1 -- 172.21.15.31:0/741196535 wait complete. 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 Processor -- start 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 -- start start 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 0x7f18ac1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac1127a0 con 0x7f18ac102740 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac112620 con 0x7f18ac107840 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18b3000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac112920 con 0x7f18ac1030f0 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18abe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.212+0000 7f18abe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46370/0 (socket says 172.21.15.31:46370) 2024-06-02T22:31:27.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 -- 172.21.15.31:0/1799740168 learned_addr learned my addr 172.21.15.31:0/1799740168 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18ab400700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18b1000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 0x7f18ac1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:27.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 -- 172.21.15.31:0/1799740168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 msgr2=0x7f18ac19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 -- 172.21.15.31:0/1799740168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 msgr2=0x7f18ac1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 0x7f18ac1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 -- 172.21.15.31:0/1799740168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac199140 con 0x7f18ac102740 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18b1000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 0x7f18ac1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.213+0000 7f18abe00700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f189c00e9a0 tx=0x7f189c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.214+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c00cbd0 con 0x7f18ac102740 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.214+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f189c00cd70 con 0x7f18ac102740 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.214+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac199430 con 0x7f18ac102740 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.214+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c018750 con 0x7f18ac102740 2024-06-02T22:31:27.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.214+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac1a56f0 con 0x7f18ac102740 2024-06-02T22:31:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.216+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac069180 con 0x7f18ac102740 2024-06-02T22:31:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.218+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f189c010430 con 0x7f18ac102740 2024-06-02T22:31:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.219+0000 7f18a8c00700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 0x7f18900a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.219+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f189c0cf280 con 0x7f18ac102740 2024-06-02T22:31:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.219+0000 7f18ab400700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 0x7f18900a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.220+0000 7f18ab400700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 0x7f18900a50e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f18ac1070c0 tx=0x7f189800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.224+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f189c053850 con 0x7f18ac102740 2024-06-02T22:31:27.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.464+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f18ac02dca0 con 0x7f18ac102740 2024-06-02T22:31:27.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.784+0000 7f18a8c00700 1 -- 172.21.15.31:0/1799740168 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v89) ==== 157+0+0 (secure 0 0 0) 0x7f189c09c290 con 0x7f18ac102740 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.788+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 msgr2=0x7f18900a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.788+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 0x7f18900a50e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f18ac1070c0 tx=0x7f189800b260 comp rx=0 tx=0).stop 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.788+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 msgr2=0x7f18ac19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.788+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f189c00e9a0 tx=0x7f189c00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.788+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 shutdown_connections 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f18900a2c20 0x7f18900a50e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18ac107840 0x7f18ac1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18ac102740 0x7f18ac19e820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 --2- 172.21.15.31:0/1799740168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18ac1030f0 0x7f18ac19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:27.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 >> 172.21.15.31:0/1799740168 conn(0x7f18ac0795f0 msgr2=0x7f18ac1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:27.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 shutdown_connections 2024-06-02T22:31:27.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:27.789+0000 7f18b3000700 1 -- 172.21.15.31:0/1799740168 wait complete. 2024-06-02T22:31:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:27 smithi178 ceph-mon[36614]: pgmap v334: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-06-02T22:31:28.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:27 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T22:31:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:27 smithi031 ceph-mon[31767]: pgmap v334: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-06-02T22:31:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:27 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T22:31:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:27 smithi098 ceph-mon[36750]: pgmap v334: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 2 op/s 2024-06-02T22:31:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:27 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-02T22:31:28.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T22:31:28.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:28 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T22:31:28.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:28 smithi031 ceph-mon[31767]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T22:31:29.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:28 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T22:31:29.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:28 smithi178 ceph-mon[36614]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T22:31:29.129 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:28 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1799740168' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-02T22:31:29.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:28 smithi098 ceph-mon[36750]: osdmap e89: 12 total, 12 up, 12 in 2024-06-02T22:31:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:29 smithi178 ceph-mon[36614]: pgmap v336: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 KiB/s wr, 6 op/s 2024-06-02T22:31:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:29 smithi031 ceph-mon[31767]: pgmap v336: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 KiB/s wr, 6 op/s 2024-06-02T22:31:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:29 smithi098 ceph-mon[36750]: pgmap v336: 97 pgs: 97 active+clean; 578 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2 KiB/s wr, 6 op/s 2024-06-02T22:31:31.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 -- 172.21.15.31:0/2663471804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006b360 msgr2=0x7f895010e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:31.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 --2- 172.21.15.31:0/2663471804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006b360 0x7f895010e9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8938009990 tx=0x7f8938009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 -- 172.21.15.31:0/2663471804 shutdown_connections 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 --2- 172.21.15.31:0/2663471804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895010ef30 0x7f8950111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 --2- 172.21.15.31:0/2663471804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895006aa40 0x7f895006ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 --2- 172.21.15.31:0/2663471804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006b360 0x7f895010e9f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.487+0000 7f8955c00700 1 -- 172.21.15.31:0/2663471804 >> 172.21.15.31:0/2663471804 conn(0x7f89500783d0 msgr2=0x7f89500787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.488+0000 7f8955c00700 1 -- 172.21.15.31:0/2663471804 shutdown_connections 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.488+0000 7f8955c00700 1 -- 172.21.15.31:0/2663471804 wait complete. 2024-06-02T22:31:31.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.489+0000 7f8955c00700 1 Processor -- start 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.489+0000 7f8955c00700 1 -- start start 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895006b360 0x7f895019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895010ef30 0x7f895019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f89501149d0 con 0x7f895010ef30 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8950114850 con 0x7f895006b360 2024-06-02T22:31:31.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8955c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8950114b50 con 0x7f895006aa40 2024-06-02T22:31:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f894ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f894ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:34610/0 (socket says 172.21.15.31:34610) 2024-06-02T22:31:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f894ea00700 1 -- 172.21.15.31:0/2758929285 learned_addr learned my addr 172.21.15.31:0/2758929285 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.490+0000 7f8946000700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895006b360 0x7f895019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894f400700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895010ef30 0x7f895019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 -- 172.21.15.31:0/2758929285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895006b360 msgr2=0x7f895019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895006b360 0x7f895019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 -- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895010ef30 msgr2=0x7f895019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895010ef30 0x7f895019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 -- 172.21.15.31:0/2758929285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895019fd60 con 0x7f895006aa40 2024-06-02T22:31:31.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.491+0000 7f894ea00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9a0 tx=0x7f894000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.492+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894000cbd0 con 0x7f895006aa40 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.492+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894000cd70 con 0x7f895006aa40 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.492+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89501a0050 con 0x7f895006aa40 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.492+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940018750 con 0x7f895006aa40 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.492+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89501a78d0 con 0x7f895006aa40 2024-06-02T22:31:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.493+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950050a00 con 0x7f895006aa40 2024-06-02T22:31:31.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.495+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8940010430 con 0x7f895006aa40 2024-06-02T22:31:31.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.496+0000 7f8947e00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 0x7f89340a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:31.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.497+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8277+0+0 (secure 0 0 0) 0x7f89400cf7b0 con 0x7f895006aa40 2024-06-02T22:31:31.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.497+0000 7f8946000700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 0x7f89340a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:31.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.498+0000 7f8946000700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 0x7f89340a5200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89380098e0 tx=0x7f8938005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:31.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.499+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f894009c680 con 0x7f895006aa40 2024-06-02T22:31:31.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:31.744+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f895002dca0 con 0x7f895006aa40 2024-06-02T22:31:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:32 smithi098 ceph-mon[36750]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:32 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2758929285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:32 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:32 smithi178 ceph-mon[36614]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:32.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:32 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2758929285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:32 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.832+0000 7f8947e00700 1 -- 172.21.15.31:0/2758929285 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v91) ==== 228+0+0 (secure 0 0 0) 0x7f894009bf80 con 0x7f895006aa40 2024-06-02T22:31:32.836 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:32 smithi031 ceph-mon[31767]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:32.836 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:32 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2758929285' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.836 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:32 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T22:31:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.841+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 msgr2=0x7f89340a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.841+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 0x7f89340a5200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89380098e0 tx=0x7f8938005960 comp rx=0 tx=0).stop 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.841+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 msgr2=0x7f895019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.841+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f894000e9a0 tx=0x7f894000ecb0 comp rx=0 tx=0).stop 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 shutdown_connections 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89340a2d40 0x7f89340a5200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f895010ef30 0x7f895019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f895006aa40 0x7f895019ada0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:32.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 --2- 172.21.15.31:0/2758929285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f895006b360 0x7f895019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 >> 172.21.15.31:0/2758929285 conn(0x7f89500783d0 msgr2=0x7f89501102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.842+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 shutdown_connections 2024-06-02T22:31:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:32.843+0000 7f8955c00700 1 -- 172.21.15.31:0/2758929285 wait complete. 2024-06-02T22:31:32.848 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' created 2024-06-02T22:31:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:33 smithi031 ceph-mon[31767]: pgmap v339: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:33 smithi031 ceph-mon[31767]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T22:31:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:33 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T22:31:33.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:33 smithi031 ceph-mon[31767]: osdmap e91: 12 total, 12 up, 12 in 2024-06-02T22:31:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:33 smithi098 ceph-mon[36750]: pgmap v339: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:33 smithi098 ceph-mon[36750]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T22:31:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:33 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T22:31:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:33 smithi098 ceph-mon[36750]: osdmap e91: 12 total, 12 up, 12 in 2024-06-02T22:31:33.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-02T22:31:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:33 smithi178 ceph-mon[36614]: pgmap v339: 97 pgs: 97 active+clean; 579 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-02T22:31:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:33 smithi178 ceph-mon[36614]: osdmap e90: 12 total, 12 up, 12 in 2024-06-02T22:31:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:33 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T22:31:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:33 smithi178 ceph-mon[36614]: osdmap e91: 12 total, 12 up, 12 in 2024-06-02T22:31:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:35.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:34 smithi031 ceph-mon[31767]: osdmap e92: 12 total, 12 up, 12 in 2024-06-02T22:31:35.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:34 smithi098 ceph-mon[36750]: osdmap e92: 12 total, 12 up, 12 in 2024-06-02T22:31:35.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:34 smithi178 ceph-mon[36614]: osdmap e92: 12 total, 12 up, 12 in 2024-06-02T22:31:36.007 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:35 smithi031 ceph-mon[31767]: pgmap v342: 129 pgs: 1 creating+activating, 5 creating+peering, 25 unknown, 98 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-02T22:31:36.007 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:35 smithi031 ceph-mon[31767]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:36.007 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:35 smithi031 ceph-mon[31767]: osdmap e93: 12 total, 12 up, 12 in 2024-06-02T22:31:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:35 smithi098 ceph-mon[36750]: pgmap v342: 129 pgs: 1 creating+activating, 5 creating+peering, 25 unknown, 98 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-02T22:31:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:35 smithi098 ceph-mon[36750]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:35 smithi098 ceph-mon[36750]: osdmap e93: 12 total, 12 up, 12 in 2024-06-02T22:31:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:35 smithi178 ceph-mon[36614]: pgmap v342: 129 pgs: 1 creating+activating, 5 creating+peering, 25 unknown, 98 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-06-02T22:31:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:35 smithi178 ceph-mon[36614]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-02T22:31:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:35 smithi178 ceph-mon[36614]: osdmap e93: 12 total, 12 up, 12 in 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 -- 172.21.15.31:0/115163145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 msgr2=0x7f139010f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 --2- 172.21.15.31:0/115163145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139010f330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f138800b0a0 tx=0x7f138800b3b0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 -- 172.21.15.31:0/115163145 shutdown_connections 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 --2- 172.21.15.31:0/115163145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139010f330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 --2- 172.21.15.31:0/115163145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13901084f0 0x7f13901088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 --2- 172.21.15.31:0/115163145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1390102550 0x7f13901029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 -- 172.21.15.31:0/115163145 >> 172.21.15.31:0/115163145 conn(0x7f1390079650 msgr2=0x7f1390079a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 -- 172.21.15.31:0/115163145 shutdown_connections 2024-06-02T22:31:36.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.551+0000 7f1396a00700 1 -- 172.21.15.31:0/115163145 wait complete. 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.552+0000 7f1396a00700 1 Processor -- start 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 -- start start 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 0x7f1390198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f13901127b0 con 0x7f1390102550 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1390112630 con 0x7f1390102f10 2024-06-02T22:31:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f1396a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1390112930 con 0x7f13901084f0 2024-06-02T22:31:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f138fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.553+0000 7f138fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56722/0 (socket says 172.21.15.31:56722) 2024-06-02T22:31:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 -- 172.21.15.31:0/3135002170 learned_addr learned my addr 172.21.15.31:0/3135002170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f1394a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 0x7f1390198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138f400700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 -- 172.21.15.31:0/3135002170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 msgr2=0x7f1390198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 0x7f1390198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 -- 172.21.15.31:0/3135002170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 msgr2=0x7f139019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 -- 172.21.15.31:0/3135002170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1390199190 con 0x7f1390102550 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f1394a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 0x7f1390198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:36.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.554+0000 7f138fe00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f138000e9a0 tx=0x7f138000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.555+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138000ca10 con 0x7f1390102550 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.555+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f138000cbb0 con 0x7f1390102550 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.555+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1390199480 con 0x7f1390102550 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.555+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380018680 con 0x7f1390102550 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.555+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13901a56f0 con 0x7f1390102550 2024-06-02T22:31:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.556+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1390069180 con 0x7f1390102550 2024-06-02T22:31:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.558+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1380010430 con 0x7f1390102550 2024-06-02T22:31:36.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.561+0000 7f138cc00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 0x7f13740a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:36.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.561+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8770+0+0 (secure 0 0 0) 0x7f13800cf8d0 con 0x7f1390102550 2024-06-02T22:31:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.561+0000 7f138f400700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 0x7f13740a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:36.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.562+0000 7f138f400700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 0x7f13740a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1390079b50 tx=0x7f137c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:36.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.564+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f138009c5b0 con 0x7f1390102550 2024-06-02T22:31:36.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.800+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f13901a5990 con 0x7f1390102550 2024-06-02T22:31:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.850+0000 7f138cc00700 1 -- 172.21.15.31:0/3135002170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v94) ==== 169+0+0 (secure 0 0 0) 0x7f138009beb0 con 0x7f1390102550 2024-06-02T22:31:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 msgr2=0x7f13740a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 0x7f13740a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1390079b50 tx=0x7f137c009260 comp rx=0 tx=0).stop 2024-06-02T22:31:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 msgr2=0x7f139019e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f138000e9a0 tx=0x7f138000ecb0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 shutdown_connections 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f13740a2c20 0x7f13740a50e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13901084f0 0x7f1390198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1390102550 0x7f139019e820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 --2- 172.21.15.31:0/3135002170 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1390102f10 0x7f139019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 >> 172.21.15.31:0/3135002170 conn(0x7f1390079650 msgr2=0x7f1390100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 shutdown_connections 2024-06-02T22:31:36.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:36.854+0000 7f1396a00700 1 -- 172.21.15.31:0/3135002170 wait complete. 2024-06-02T22:31:36.857 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 4 allow_ec_overwrites to true 2024-06-02T22:31:37.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:36 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T22:31:37.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:36 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T22:31:37.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:36 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-02T22:31:37.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-02T22:31:38.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:37 smithi031 ceph-mon[31767]: pgmap v344: 129 pgs: 1 creating+activating, 5 creating+peering, 8 unknown, 115 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:37 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T22:31:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:37 smithi031 ceph-mon[31767]: osdmap e94: 12 total, 12 up, 12 in 2024-06-02T22:31:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:37 smithi098 ceph-mon[36750]: pgmap v344: 129 pgs: 1 creating+activating, 5 creating+peering, 8 unknown, 115 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:37 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T22:31:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:37 smithi098 ceph-mon[36750]: osdmap e94: 12 total, 12 up, 12 in 2024-06-02T22:31:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:37 smithi178 ceph-mon[36614]: pgmap v344: 129 pgs: 1 creating+activating, 5 creating+peering, 8 unknown, 115 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:38.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:37 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3135002170' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-02T22:31:38.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:37 smithi178 ceph-mon[36614]: osdmap e94: 12 total, 12 up, 12 in 2024-06-02T22:31:40.078 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:39 smithi031 ceph-mon[31767]: pgmap v346: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:39 smithi098 ceph-mon[36750]: pgmap v346: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:39 smithi178 ceph-mon[36614]: pgmap v346: 129 pgs: 1 creating+activating, 4 creating+peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 -- 172.21.15.31:0/3028179091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501072f0 msgr2=0x7fa6501076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 --2- 172.21.15.31:0/3028179091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501072f0 0x7fa6501076d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa640009990 tx=0x7fa640009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 -- 172.21.15.31:0/3028179091 shutdown_connections 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 --2- 172.21.15.31:0/3028179091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501066d0 0x7fa65010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 --2- 172.21.15.31:0/3028179091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501072f0 0x7fa6501076d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 --2- 172.21.15.31:0/3028179091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa650105ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 -- 172.21.15.31:0/3028179091 >> 172.21.15.31:0/3028179091 conn(0x7fa650077590 msgr2=0x7fa6500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 -- 172.21.15.31:0/3028179091 shutdown_connections 2024-06-02T22:31:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.410+0000 7fa655200700 1 -- 172.21.15.31:0/3028179091 wait complete. 2024-06-02T22:31:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.412+0000 7fa655200700 1 Processor -- start 2024-06-02T22:31:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 -- start start 2024-06-02T22:31:40.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 0x7fa65019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 0x7fa65019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa65019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111710 con 0x7fa650107ca0 2024-06-02T22:31:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111590 con 0x7fa6501072f0 2024-06-02T22:31:40.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.413+0000 7fa655200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa650111890 con 0x7fa6501066d0 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64d400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 0x7fa65019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 0x7fa65019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64d400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 0x7fa65019b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52704/0 (socket says 172.21.15.31:52704) 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64d400700 1 -- 172.21.15.31:0/3671886131 learned_addr learned my addr 172.21.15.31:0/3671886131 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64e800700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa65019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 -- 172.21.15.31:0/3671886131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 msgr2=0x7fa65019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:40.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 0x7fa65019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 -- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 msgr2=0x7fa65019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa65019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64de00700 1 -- 172.21.15.31:0/3671886131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65019fee0 con 0x7fa6501066d0 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.414+0000 7fa64e800700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa65019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa64de00700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 0x7fa65019aed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa64000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:40.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640027070 con 0x7fa6501066d0 2024-06-02T22:31:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa64000be60 con 0x7fa6501066d0 2024-06-02T22:31:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6501a0170 con 0x7fa6501066d0 2024-06-02T22:31:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640022e30 con 0x7fa6501066d0 2024-06-02T22:31:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.415+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501a7a50 con 0x7fa6501066d0 2024-06-02T22:31:40.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.416+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa650100990 con 0x7fa6501066d0 2024-06-02T22:31:40.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.419+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa64002a070 con 0x7fa6501066d0 2024-06-02T22:31:40.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.420+0000 7fa646a00700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 0x7fa6340a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:40.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.420+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8770+0+0 (secure 0 0 0) 0x7fa6400cff20 con 0x7fa6501066d0 2024-06-02T22:31:40.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.420+0000 7fa64d400700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 0x7fa6340a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:40.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.421+0000 7fa64d400700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 0x7fa6340a5160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa65010e6e0 tx=0x7fa63c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:40.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.424+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa640013070 con 0x7fa6501066d0 2024-06-02T22:31:40.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.708+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fa650069180 con 0x7fa6501066d0 2024-06-02T22:31:40.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.879+0000 7fa646a00700 1 -- 172.21.15.31:0/3671886131 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fa64009cc90 con 0x7fa6501066d0 2024-06-02T22:31:40.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 msgr2=0x7fa6340a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:40.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 0x7fa6340a5160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa65010e6e0 tx=0x7fa63c009260 comp rx=0 tx=0).stop 2024-06-02T22:31:40.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 msgr2=0x7fa65019aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 0x7fa65019aed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6400098e0 tx=0x7fa64000b8a0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 shutdown_connections 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6340a2ca0 0x7fa6340a5160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa650107ca0 0x7fa65019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6501066d0 0x7fa65019aed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 --2- 172.21.15.31:0/3671886131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6501072f0 0x7fa65019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 >> 172.21.15.31:0/3671886131 conn(0x7fa650077590 msgr2=0x7fa6500ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 shutdown_connections 2024-06-02T22:31:40.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:40.884+0000 7fa655200700 1 -- 172.21.15.31:0/3671886131 wait complete. 2024-06-02T22:31:40.886 INFO:teuthology.orchestra.run.smithi031.stderr:added data pool 4 to fsmap 2024-06-02T22:31:41.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:40 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3671886131' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.169 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:40 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:40 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3671886131' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:40 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:40 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3671886131' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:40 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-02T22:31:41.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:31:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:41 smithi031 ceph-mon[31767]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:41 smithi031 ceph-mon[31767]: osdmap e95: 12 total, 12 up, 12 in 2024-06-02T22:31:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:41 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T22:31:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:41 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:41 smithi098 ceph-mon[36750]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:41 smithi098 ceph-mon[36750]: osdmap e95: 12 total, 12 up, 12 in 2024-06-02T22:31:42.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:41 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T22:31:42.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:41 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:42.281 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:41 smithi178 ceph-mon[36614]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:41 smithi178 ceph-mon[36614]: osdmap e95: 12 total, 12 up, 12 in 2024-06-02T22:31:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:41 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-02T22:31:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:41 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:31:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:42 smithi031 ceph-mon[31767]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T22:31:43.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:42 smithi031 ceph-mon[31767]: Cluster is now healthy 2024-06-02T22:31:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:42 smithi098 ceph-mon[36750]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T22:31:43.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:42 smithi098 ceph-mon[36750]: Cluster is now healthy 2024-06-02T22:31:43.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:42 smithi178 ceph-mon[36614]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-02T22:31:43.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:42 smithi178 ceph-mon[36614]: Cluster is now healthy 2024-06-02T22:31:44.057 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:43 smithi031 ceph-mon[31767]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:43 smithi098 ceph-mon[36750]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:43 smithi178 ceph-mon[36614]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:44.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 -- 172.21.15.31:0/4234087606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209810eab0 msgr2=0x7f209810ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:44.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 --2- 172.21.15.31:0/4234087606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209810eab0 0x7f209810ee90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f208c0098f0 tx=0x7f208c009c00 comp rx=0 tx=0).stop 2024-06-02T22:31:44.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 -- 172.21.15.31:0/4234087606 shutdown_connections 2024-06-02T22:31:44.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 --2- 172.21.15.31:0/4234087606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f2098115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 --2- 172.21.15.31:0/4234087606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f209810eab0 0x7f209810ee90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 --2- 172.21.15.31:0/4234087606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f2098108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 -- 172.21.15.31:0/4234087606 >> 172.21.15.31:0/4234087606 conn(0x7f2098075c60 msgr2=0x7f2098078080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 -- 172.21.15.31:0/4234087606 shutdown_connections 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.656+0000 7f209fa00700 1 -- 172.21.15.31:0/4234087606 wait complete. 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.658+0000 7f209fa00700 1 Processor -- start 2024-06-02T22:31:44.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.658+0000 7f209fa00700 1 -- start start 2024-06-02T22:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.658+0000 7f209fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f209819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209fa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209fa00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 0x7f20981a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209fa00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2098118e00 con 0x7f20981094c0 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209fa00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2098118c80 con 0x7f20981a3df0 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2098118f80 con 0x7f2098108b00 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50636/0 (socket says 172.21.15.31:50636) 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 -- 172.21.15.31:0/2601512155 learned_addr learned my addr 172.21.15.31:0/2601512155 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209d000700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f209819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f209da00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 0x7f20981a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 -- 172.21.15.31:0/2601512155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 msgr2=0x7f209819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f209819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 -- 172.21.15.31:0/2601512155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 msgr2=0x7f20981a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 0x7f20981a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.659+0000 7f2097e00700 1 -- 172.21.15.31:0/2601512155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20981a4910 con 0x7f20981094c0 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f209da00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 0x7f20981a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:44.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f209d000700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f209819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f2097e00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f208400e9c0 tx=0x7f208400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208400cbd0 con 0x7f20981094c0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20981a4c00 con 0x7f20981094c0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f208400ee60 con 0x7f20981094c0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084005630 con 0x7f20981094c0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.660+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20981ac3e0 con 0x7f20981094c0 2024-06-02T22:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.661+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2098069180 con 0x7f20981094c0 2024-06-02T22:31:44.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.665+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2084004750 con 0x7f20981094c0 2024-06-02T22:31:44.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.666+0000 7f2095600700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 0x7f20800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:44.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.666+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f20840cf710 con 0x7f20981094c0 2024-06-02T22:31:44.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.667+0000 7f209d000700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 0x7f20800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:44.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.667+0000 7f209d000700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 0x7f20800a50e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.669+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2084053850 con 0x7f20981094c0 2024-06-02T22:31:44.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.958+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f209802dca0 con 0x7f20981094c0 2024-06-02T22:31:44.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.960+0000 7f2095600700 1 -- 172.21.15.31:0/2601512155 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7f208409c430 con 0x7f20981094c0 2024-06-02T22:31:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:44.960 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:31:40.710824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24517,"qdb_cluster":[24517]},"id":1}]} 2024-06-02T22:31:44.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.962+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 msgr2=0x7f20800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:44.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.962+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 0x7f20800a50e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c019040 comp rx=0 tx=0).stop 2024-06-02T22:31:44.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 msgr2=0x7f209819fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:44.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f208400e9c0 tx=0x7f208400ecd0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 shutdown_connections 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20800a2c20 0x7f20800a50e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20981a3df0 0x7f20981a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2098108b00 0x7f209819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 --2- 172.21.15.31:0/2601512155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20981094c0 0x7f209819fa60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 >> 172.21.15.31:0/2601512155 conn(0x7f2098075c60 msgr2=0x7f20980765b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 shutdown_connections 2024-06-02T22:31:44.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:44.963+0000 7f209fa00700 1 -- 172.21.15.31:0/2601512155 wait complete. 2024-06-02T22:31:44.964 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-06-02T22:31:45.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:31:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:45 smithi031 ceph-mon[31767]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2601512155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:45 smithi098 ceph-mon[36750]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:46.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2601512155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:45 smithi178 ceph-mon[36614]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2601512155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:47 smithi098 ceph-mon[36750]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:48.217 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:47 smithi031 ceph-mon[31767]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:47 smithi178 ceph-mon[36614]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:48.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 -- 172.21.15.31:0/2436322142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 msgr2=0x7fac301088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:48.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 --2- 172.21.15.31:0/2436322142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac301088e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac24009990 tx=0x7fac24009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 -- 172.21.15.31:0/2436322142 shutdown_connections 2024-06-02T22:31:48.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 --2- 172.21.15.31:0/2436322142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 --2- 172.21.15.31:0/2436322142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac301088e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 --2- 172.21.15.31:0/2436322142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 0x7fac3006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 -- 172.21.15.31:0/2436322142 >> 172.21.15.31:0/2436322142 conn(0x7fac30078340 msgr2=0x7fac30078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:48.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 -- 172.21.15.31:0/2436322142 shutdown_connections 2024-06-02T22:31:48.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.751+0000 7fac38000700 1 -- 172.21.15.31:0/2436322142 wait complete. 2024-06-02T22:31:48.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 Processor -- start 2024-06-02T22:31:48.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 -- start start 2024-06-02T22:31:48.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 0x7fac3019e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:48.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:48.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac30198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:48.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fac301127d0 con 0x7fac3006ab30 2024-06-02T22:31:48.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fac30112650 con 0x7fac30108500 2024-06-02T22:31:48.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.753+0000 7fac38000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fac30112950 con 0x7fac3006a170 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac34c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac30198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac34c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3019ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50658/0 (socket says 172.21.15.31:50658) 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac34c00700 1 -- 172.21.15.31:0/2091443305 learned_addr learned my addr 172.21.15.31:0/2091443305 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac35600700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 0x7fac3019e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:48.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 -- 172.21.15.31:0/2091443305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 msgr2=0x7fac3019e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 0x7fac3019e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 -- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 msgr2=0x7fac3019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.754+0000 7fac36000700 1 -- 172.21.15.31:0/2091443305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301991f0 con 0x7fac30108500 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac36000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac30198a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac2800efc0 tx=0x7fac2800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac280092e0 con 0x7fac30108500 2024-06-02T22:31:48.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac28004bb0 con 0x7fac30108500 2024-06-02T22:31:48.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac30199480 con 0x7fac30108500 2024-06-02T22:31:48.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004280 con 0x7fac30108500 2024-06-02T22:31:48.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.755+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac301a57a0 con 0x7fac30108500 2024-06-02T22:31:48.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.756+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3010a9e0 con 0x7fac30108500 2024-06-02T22:31:48.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.758+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fac28044d10 con 0x7fac30108500 2024-06-02T22:31:48.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.759+0000 7fac2e000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 0x7fac180a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:48.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.760+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7fac280cf120 con 0x7fac30108500 2024-06-02T22:31:48.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.760+0000 7fac35600700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 0x7fac180a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:48.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.760+0000 7fac35600700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 0x7fac180a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac30199bd0 tx=0x7fac2401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:48.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.762+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fac28022020 con 0x7fac30108500 2024-06-02T22:31:48.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.993+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac3010a3c0 con 0x7fac30108500 2024-06-02T22:31:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.995+0000 7fac2e000700 1 -- 172.21.15.31:0/2091443305 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24093 (secure 0 0 0) 0x7fac28010040 con 0x7fac30108500 2024-06-02T22:31:48.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:48.995 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":95,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:31:40.710389+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 msgr2=0x7fac180a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:48.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 0x7fac180a5160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac30199bd0 tx=0x7fac2401a040 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 msgr2=0x7fac30198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac30198a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac2800efc0 tx=0x7fac2800c3a0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 shutdown_connections 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fac180a2ca0 0x7fac180a5160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fac30108500 0x7fac30198a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac3006a170 0x7fac3019e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 --2- 172.21.15.31:0/2091443305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac3006ab30 0x7fac3019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 >> 172.21.15.31:0/2091443305 conn(0x7fac30078340 msgr2=0x7fac300fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 shutdown_connections 2024-06-02T22:31:48.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:48.998+0000 7fac38000700 1 -- 172.21.15.31:0/2091443305 wait complete. 2024-06-02T22:31:49.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:31:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:49 smithi098 ceph-mon[36750]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2091443305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:49 smithi178 ceph-mon[36614]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2091443305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:50.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:49 smithi031 ceph-mon[31767]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2091443305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:50.435 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:52.113 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:51 smithi031 ceph-mon[31767]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:51 smithi098 ceph-mon[36750]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:51 smithi178 ceph-mon[36614]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 -- 172.21.15.31:0/2808799725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 msgr2=0x7f8dc4104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2808799725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc4104b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009990 tx=0x7f8db0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 -- 172.21.15.31:0/2808799725 shutdown_connections 2024-06-02T22:31:52.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2808799725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 0x7f8dc4111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2808799725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc410aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2808799725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc4104b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 -- 172.21.15.31:0/2808799725 >> 172.21.15.31:0/2808799725 conn(0x7f8dc4100190 msgr2=0x7f8dc41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 -- 172.21.15.31:0/2808799725 shutdown_connections 2024-06-02T22:31:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.956+0000 7f8dcc200700 1 -- 172.21.15.31:0/2808799725 wait complete. 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.957+0000 7f8dcc200700 1 Processor -- start 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.957+0000 7f8dcc200700 1 -- start start 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.957+0000 7f8dcc200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.957+0000 7f8dcc200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 0x7f8dc419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dcc200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dcc200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41149f0 con 0x7f8dc41046a0 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dcc200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4114870 con 0x7f8dc410a6a0 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dcc200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4114b70 con 0x7f8dc4105060 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dc9800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dc9800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53926/0 (socket says 172.21.15.31:53926) 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dc9800700 1 -- 172.21.15.31:0/2410940946 learned_addr learned my addr 172.21.15.31:0/2410940946 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dc8e00700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 0x7f8dc419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 -- 172.21.15.31:0/2410940946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 msgr2=0x7f8dc419b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 0x7f8dc419b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 -- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 msgr2=0x7f8dc419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dca200700 1 -- 172.21.15.31:0/2410940946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc419fed0 con 0x7f8dc410a6a0 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.958+0000 7f8dc9800700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:52.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dca200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc419f790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00efc0 tx=0x7f8dbc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0092e0 con 0x7f8dc410a6a0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dbc004bb0 con 0x7f8dc410a6a0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc41a0160 con 0x7f8dc410a6a0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004280 con 0x7f8dc410a6a0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.959+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc41a7a40 con 0x7f8dc410a6a0 2024-06-02T22:31:52.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.960+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4069180 con 0x7f8dc410a6a0 2024-06-02T22:31:52.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.962+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8dbc01b030 con 0x7f8dc410a6a0 2024-06-02T22:31:52.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.963+0000 7f8dc2000700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 0x7f8dac0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:52.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.963+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8802+0+0 (secure 0 0 0) 0x7f8dbc0ced40 con 0x7f8dc410a6a0 2024-06-02T22:31:52.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.964+0000 7f8dc9800700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 0x7f8dac0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:52.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.964+0000 7f8dc9800700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 0x7f8dac0a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db8011550 tx=0x7f8db8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:52.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:52.968+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8dbc022020 con 0x7f8dc410a6a0 2024-06-02T22:31:53.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.212+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dc402dca0 con 0x7f8dc410a6a0 2024-06-02T22:31:53.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.214+0000 7f8dc2000700 1 -- 172.21.15.31:0/2410940946 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24093 (secure 0 0 0) 0x7f8dbc010040 con 0x7f8dc410a6a0 2024-06-02T22:31:53.214 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:53.215 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":95,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:31:40.710389+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:31:53.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.217+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 msgr2=0x7f8dac0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:53.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.217+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 0x7f8dac0a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db8011550 tx=0x7f8db8009260 comp rx=0 tx=0).stop 2024-06-02T22:31:53.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.217+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 msgr2=0x7f8dc419f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:53.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.217+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc419f790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00efc0 tx=0x7f8dbc00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 shutdown_connections 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8dac0a2ca0 0x7f8dac0a5160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8dc410a6a0 0x7f8dc419f790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8dc41046a0 0x7f8dc419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 --2- 172.21.15.31:0/2410940946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8dc4105060 0x7f8dc419b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 >> 172.21.15.31:0/2410940946 conn(0x7f8dc4100190 msgr2=0x7f8dc4100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 shutdown_connections 2024-06-02T22:31:53.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:53.218+0000 7f8dcc200700 1 -- 172.21.15.31:0/2410940946 wait complete. 2024-06-02T22:31:54.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:31:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:53 smithi098 ceph-mon[36750]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:53 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2410940946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:53 smithi178 ceph-mon[36614]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:53 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2410940946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:54.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:53 smithi031 ceph-mon[31767]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:53 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2410940946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:31:54.535 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-02T22:31:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-06-02T22:31:55.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:54 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-02T22:31:55.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-02T22:31:55.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-06-02T22:31:55.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:54 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-06-02T22:31:55.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-06-02T22:31:55.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-06-02T22:31:55.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-06-02T22:31:55.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:54 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-06-02T22:31:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-02T22:31:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-06-02T22:31:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-02T22:31:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-02T22:31:56.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:55 smithi031 ceph-mon[31767]: osdmap e96: 12 total, 12 up, 12 in 2024-06-02T22:31:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-06-02T22:31:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-02T22:31:56.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:55 smithi178 ceph-mon[36614]: osdmap e96: 12 total, 12 up, 12 in 2024-06-02T22:31:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-06-02T22:31:56.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:55 smithi098 ceph-mon[36750]: osdmap e96: 12 total, 12 up, 12 in 2024-06-02T22:31:56.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.773+0000 7f539aa00700 1 -- 172.21.15.31:0/3279335411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5394105050 msgr2=0x7f5394111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.773+0000 7f539aa00700 1 --2- 172.21.15.31:0/3279335411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5394105050 0x7f5394111560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b0a0 tx=0x7f538c00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 -- 172.21.15.31:0/3279335411 shutdown_connections 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 --2- 172.21.15.31:0/3279335411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5394105050 0x7f5394111560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 --2- 172.21.15.31:0/3279335411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539410a690 0x7f539410aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 --2- 172.21.15.31:0/3279335411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f5394104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 -- 172.21.15.31:0/3279335411 >> 172.21.15.31:0/3279335411 conn(0x7f53941001a0 msgr2=0x7f53941025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 -- 172.21.15.31:0/3279335411 shutdown_connections 2024-06-02T22:31:56.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.774+0000 7f539aa00700 1 -- 172.21.15.31:0/3279335411 wait complete. 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.775+0000 7f539aa00700 1 Processor -- start 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.775+0000 7f539aa00700 1 -- start start 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f539419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5394105050 0x7f539419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5394114a70 con 0x7f539410a690 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53941148f0 con 0x7f5394104690 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f539aa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5394114bf0 con 0x7f5394105050 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f5398a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:56.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f5398a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53940/0 (socket says 172.21.15.31:53940) 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f5398a00700 1 -- 172.21.15.31:0/1079278394 learned_addr learned my addr 172.21.15.31:0/1079278394 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f5393e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f539419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.776+0000 7f5393400700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5394105050 0x7f539419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 -- 172.21.15.31:0/1079278394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5394105050 msgr2=0x7f539419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5394105050 0x7f539419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 -- 172.21.15.31:0/1079278394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 msgr2=0x7f539419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f539419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 -- 172.21.15.31:0/1079278394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539419fe90 con 0x7f539410a690 2024-06-02T22:31:56.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5393e00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f539419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:31:56.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5398a00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b070 tx=0x7f538c004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:56.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c021070 con 0x7f539410a690 2024-06-02T22:31:56.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c003c00 con 0x7f539410a690 2024-06-02T22:31:56.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c004740 con 0x7f539410a690 2024-06-02T22:31:56.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.777+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53941a0120 con 0x7f539410a690 2024-06-02T22:31:56.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.778+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53941a7a00 con 0x7f539410a690 2024-06-02T22:31:56.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.779+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5394105dd0 con 0x7f539410a690 2024-06-02T22:31:56.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.782+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f538c007980 con 0x7f539410a690 2024-06-02T22:31:56.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.784+0000 7f5390c00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 0x7f53780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:31:56.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.784+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f538c00f020 con 0x7f539410a690 2024-06-02T22:31:56.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.784+0000 7f5393e00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 0x7f53780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:31:56.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.785+0000 7f5393e00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 0x7f53780a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5384009fd0 tx=0x7f5384009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:31:56.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:56.787+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f538c02a020 con 0x7f539410a690 2024-06-02T22:31:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.067+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f539402dca0 con 0x7f539410a690 2024-06-02T22:31:57.067 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:56 smithi031 ceph-mon[31767]: osdmap e97: 12 total, 12 up, 12 in 2024-06-02T22:31:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.069+0000 7f5390c00700 1 -- 172.21.15.31:0/1079278394 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7f538c09d6d0 con 0x7f539410a690 2024-06-02T22:31:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:31:57.069 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:31:40.710824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24517,"qdb_cluster":[24517]},"id":1}]} 2024-06-02T22:31:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.073+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 msgr2=0x7f53780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.073+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 0x7f53780a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5384009fd0 tx=0x7f5384009260 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.073+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 msgr2=0x7f539419f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.073+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b070 tx=0x7f538c004c60 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 shutdown_connections 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f53780a2ca0 0x7f53780a5160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f539410a690 0x7f539419f750 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5394104690 0x7f539419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 --2- 172.21.15.31:0/1079278394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5394105050 0x7f539419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 >> 172.21.15.31:0/1079278394 conn(0x7f53941001a0 msgr2=0x7f53941006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 shutdown_connections 2024-06-02T22:31:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:31:57.074+0000 7f539aa00700 1 -- 172.21.15.31:0/1079278394 wait complete. 2024-06-02T22:31:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-06-02T22:31:57.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:56 smithi178 ceph-mon[36614]: osdmap e97: 12 total, 12 up, 12 in 2024-06-02T22:31:57.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:56 smithi098 ceph-mon[36750]: osdmap e97: 12 total, 12 up, 12 in 2024-06-02T22:31:57.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:31:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:57 smithi031 ceph-mon[31767]: pgmap v358: 129 pgs: 5 peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:57 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1079278394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:57 smithi178 ceph-mon[36614]: pgmap v358: 129 pgs: 5 peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:57 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1079278394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:31:58.358 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:31:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:57 smithi098 ceph-mon[36750]: pgmap v358: 129 pgs: 5 peering, 124 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:31:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:57 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1079278394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:32:00.291 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:31:59 smithi031 ceph-mon[31767]: pgmap v359: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:31:59 smithi178 ceph-mon[36614]: pgmap v359: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:31:59 smithi098 ceph-mon[36750]: pgmap v359: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:00.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 -- 172.21.15.31:0/826754988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d0074fe0 msgr2=0x7fa6d010e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 --2- 172.21.15.31:0/826754988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d0074fe0 0x7fa6d010e980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009990 tx=0x7fa6b8009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 -- 172.21.15.31:0/826754988 shutdown_connections 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 --2- 172.21.15.31:0/826754988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d010eec0 0x7fa6d01112b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 --2- 172.21.15.31:0/826754988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d00746c0 0x7fa6d0074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 --2- 172.21.15.31:0/826754988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d0074fe0 0x7fa6d010e980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 -- 172.21.15.31:0/826754988 >> 172.21.15.31:0/826754988 conn(0x7fa6d0079560 msgr2=0x7fa6d0079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 -- 172.21.15.31:0/826754988 shutdown_connections 2024-06-02T22:32:00.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.626+0000 7fa6d6200700 1 -- 172.21.15.31:0/826754988 wait complete. 2024-06-02T22:32:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.627+0000 7fa6d6200700 1 Processor -- start 2024-06-02T22:32:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.627+0000 7fa6d6200700 1 -- start start 2024-06-02T22:32:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d00746c0 0x7fa6d019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d010eec0 0x7fa6d019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0114a40 con 0x7fa6d010eec0 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01148c0 con 0x7fa6d0074fe0 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6d6200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0114bc0 con 0x7fa6d00746c0 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6c6a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6cfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d010eec0 0x7fa6d019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6c6a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57278/0 (socket says 172.21.15.31:57278) 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6c6a00700 1 -- 172.21.15.31:0/242776269 learned_addr learned my addr 172.21.15.31:0/242776269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.628+0000 7fa6cf400700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d00746c0 0x7fa6d019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 -- 172.21.15.31:0/242776269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d00746c0 msgr2=0x7fa6d019ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d00746c0 0x7fa6d019ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 -- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d010eec0 msgr2=0x7fa6d019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d010eec0 0x7fa6d019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 -- 172.21.15.31:0/242776269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d019fe40 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6c6a00700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000c00 tx=0x7fa6b800ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8027070 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6b8003d70 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a00d0 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800f460 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.629+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a79b0 con 0x7fa6d0074fe0 2024-06-02T22:32:00.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.630+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d0075db0 con 0x7fa6d0074fe0 2024-06-02T22:32:00.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.632+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa6b802a070 con 0x7fa6d0074fe0 2024-06-02T22:32:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.634+0000 7fa6ccc00700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 0x7fa6b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.634+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fa6b80d0330 con 0x7fa6d0074fe0 2024-06-02T22:32:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.634+0000 7fa6cf400700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 0x7fa6b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.635+0000 7fa6cf400700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 0x7fa6b40a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000f540 tx=0x7fa6c000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.638+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa6b805e850 con 0x7fa6d0074fe0 2024-06-02T22:32:00.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.879+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6d0069180 con 0x7fa6d0074fe0 2024-06-02T22:32:00.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.881+0000 7fa6ccc00700 1 -- 172.21.15.31:0/242776269 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24621 (secure 0 0 0) 0x7fa6d0069180 con 0x7fa6d0074fe0 2024-06-02T22:32:00.881 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:32:00.881 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":97,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:31:55.962368+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:32:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 msgr2=0x7fa6b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 0x7fa6b40a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000f540 tx=0x7fa6c000b040 comp rx=0 tx=0).stop 2024-06-02T22:32:00.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 msgr2=0x7fa6d019b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000c00 tx=0x7fa6b800ba90 comp rx=0 tx=0).stop 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 shutdown_connections 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa6b40a2c20 0x7fa6b40a50e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6d010eec0 0x7fa6d019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6d00746c0 0x7fa6d019ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 --2- 172.21.15.31:0/242776269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa6d0074fe0 0x7fa6d019b370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 >> 172.21.15.31:0/242776269 conn(0x7fa6d0079560 msgr2=0x7fa6d00ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 shutdown_connections 2024-06-02T22:32:00.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:00.885+0000 7fa6d6200700 1 -- 172.21.15.31:0/242776269 wait complete. 2024-06-02T22:32:01.293 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:01 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/242776269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:01.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:01 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/242776269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:01.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:01 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/242776269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:01.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T22:31:23.645237+0000', 'modified': '2024-06-02T22:31:40.710824+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24517': {'gid': 24517, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.31:6841/3282614730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6840', 'nonce': 3282614730}, {'type': 'v1', 'addr': '172.21.15.31:6841', 'nonce': 3282614730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24517, 'qdb_cluster': [24517]} 2024-06-02T22:32:01.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T22:32:01.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-06-02T22:32:02.226 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:02 smithi178 ceph-mon[36614]: pgmap v360: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:02.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:02 smithi031 ceph-mon[31767]: pgmap v360: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:02 smithi098 ceph-mon[36750]: pgmap v360: 129 pgs: 1 activating, 5 peering, 123 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:04.251 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:04 smithi031 ceph-mon[31767]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:04 smithi178 ceph-mon[36614]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:04.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 -- 172.21.15.31:0/2995716095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500772e0 msgr2=0x7f1e50112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 --2- 172.21.15.31:0/2995716095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500772e0 0x7f1e50112d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009990 tx=0x7f1e3c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 -- 172.21.15.31:0/2995716095 shutdown_connections 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 --2- 172.21.15.31:0/2995716095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 0x7f1e50115630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 --2- 172.21.15.31:0/2995716095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500769c0 0x7f1e50076da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 --2- 172.21.15.31:0/2995716095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500772e0 0x7f1e50112d00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.423+0000 7f1e56a00700 1 -- 172.21.15.31:0/2995716095 >> 172.21.15.31:0/2995716095 conn(0x7f1e501000d0 msgr2=0x7f1e501024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.424+0000 7f1e56a00700 1 -- 172.21.15.31:0/2995716095 shutdown_connections 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.424+0000 7f1e56a00700 1 -- 172.21.15.31:0/2995716095 wait complete. 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 Processor -- start 2024-06-02T22:32:04.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 -- start start 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500772e0 0x7f1e5019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 0x7f1e501a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50118d60 con 0x7f1e500769c0 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50118be0 con 0x7f1e50113240 2024-06-02T22:32:04.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.425+0000 7f1e56a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1e50118ee0 con 0x7f1e500772e0 2024-06-02T22:32:04.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40284/0 (socket says 172.21.15.31:40284) 2024-06-02T22:32:04.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 -- 172.21.15.31:0/3985006439 learned_addr learned my addr 172.21.15.31:0/3985006439 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:04.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e54c00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500772e0 0x7f1e5019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e56000700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 0x7f1e501a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 -- 172.21.15.31:0/3985006439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500772e0 msgr2=0x7f1e5019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500772e0 0x7f1e5019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 -- 172.21.15.31:0/3985006439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 msgr2=0x7f1e501a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 0x7f1e501a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.426+0000 7f1e55600700 1 -- 172.21.15.31:0/3985006439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e501a41a0 con 0x7f1e500769c0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e55600700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400ef10 tx=0x7f1e4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e4e000700 1 -- 172.21.15.31:0/3985006439 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400c9c0 con 0x7f1e500769c0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e4e000700 1 -- 172.21.15.31:0/3985006439 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e44019070 con 0x7f1e500769c0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e4e000700 1 -- 172.21.15.31:0/3985006439 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44007e60 con 0x7f1e500769c0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e501a4430 con 0x7f1e500769c0 2024-06-02T22:32:04.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.427+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e501abd10 con 0x7f1e500769c0 2024-06-02T22:32:04.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.430+0000 7f1e4e000700 1 -- 172.21.15.31:0/3985006439 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e44012050 con 0x7f1e500769c0 2024-06-02T22:32:04.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e628cbb80 1 Processor -- start 2024-06-02T22:32:04.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e4e000700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 0x7f1e380a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e628cbb80 1 -- start start 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e4e000700 1 -- 172.21.15.31:0/3985006439 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f1e440cf3a0 con 0x7f1e500769c0 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e56000700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 0x7f1e380a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.432+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc3a4e0 0x560f0bc3c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f0bb3e9c0 con 0x560f0bc3a4e0 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f0bb81ab0 con 0x560f0bc2f630 2024-06-02T22:32:04.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560f0bb3c8a0 con 0x560f0bc2ed10 2024-06-02T22:32:04.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e54c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e54c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57304/0 (socket says 172.21.15.31:57304) 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:52450/0 (socket says 172.21.15.31:52450) 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 -- 172.21.15.31:0/2145800726 learned_addr learned my addr 172.21.15.31:0/2145800726 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e56000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc3a4e0 0x560f0bc3c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e56000700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 0x7f1e380a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5006baf0 tx=0x7f1e48011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 -- 172.21.15.31:0/2145800726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 msgr2=0x560f0bc39fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 -- 172.21.15.31:0/2145800726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc3a4e0 msgr2=0x560f0bc3c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc3a4e0 0x560f0bc3c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.433+0000 7f1e55600700 1 -- 172.21.15.31:0/2145800726 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f0bb29f40 con 0x560f0bc2ed10 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.434+0000 7f1e55600700 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e44097ca0 tx=0x7f1e4409b2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65273a6e507b213 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.434+0000 7f1e42a00700 1 -- 172.21.15.31:0/2145800726 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4409b840 con 0x560f0bc2ed10 2024-06-02T22:32:04.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.434+0000 7f1e42a00700 1 -- 172.21.15.31:0/2145800726 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409fbf0 con 0x560f0bc2ed10 2024-06-02T22:32:04.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.434+0000 7f1e42a00700 1 -- 172.21.15.31:0/2145800726 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440a4020 con 0x560f0bc2ed10 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2145800726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 msgr2=0x560f0bc2f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e44097ca0 tx=0x7f1e4409b2a0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2145800726 shutdown_connections 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc3a4e0 0x560f0bc3c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc2f0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2145800726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2145800726 >> 172.21.15.31:0/2145800726 conn(0x560f0bb5c120 msgr2=0x560f0bc2b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2145800726 shutdown_connections 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.435+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2145800726 wait complete. 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.436+0000 7f1e628cbb80 1 -- start start 2024-06-02T22:32:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.436+0000 7f1e628cbb80 1 Processor -- start 2024-06-02T22:32:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.436+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.436+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2f630 0x560f0bc37000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc37540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f0bb1df10 con 0x560f0bc2f630 2024-06-02T22:32:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f0bb7da70 con 0x560f0bc3a4e0 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc3cf10 con 0x560f0bc2ed10 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e628cbb80 10 client.0 _ll_register_callbacks cb 0x560f0bb17330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e54c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2f630 0x560f0bc37000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:52464/0 (socket says 172.21.15.31:52464) 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 -- 172.21.15.31:0/1339831529 learned_addr learned my addr 172.21.15.31:0/1339831529 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e56000700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc37540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 -- 172.21.15.31:0/1339831529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 msgr2=0x560f0bc37540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc37540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 -- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2f630 msgr2=0x560f0bc37000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2f630 0x560f0bc37000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.437+0000 7f1e55600700 1 -- 172.21.15.31:0/1339831529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f0bad0880 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e55600700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cfd0 tx=0x7f1e440ccaa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df667e168629ad4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e37400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440b3070 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4409fbf0 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f1e440a4020 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1e440cf150 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e628cbb80 10 client.24622 fetch_fsmap learned FSMap version 17 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.438+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560f0bc476a0 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4409fbf0 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f1e4409ac90 con 0x560f0bc2ed10 2024-06-02T22:32:04.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 10 client.24622 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 10 client.24622 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 20 client.24622 populate_metadata read hostname 'smithi031' 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bc489f0 0x560f0bc4abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 4 client.24622 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f0bb8efb0 con 0x560f0bc489f0 2024-06-02T22:32:04.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.439+0000 7f1e54c00700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bc489f0 0x560f0bc4abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.440+0000 7f1e54c00700 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bc489f0 0x560f0bc4abe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf28cad3c198409e server_cookie=36d0f082437908c0 in_seq=0 out_seq=0 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.440+0000 7f1e37400700 10 client.24622 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.441+0000 7f1e37400700 1 -- 172.21.15.31:0/1339831529 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560f0bb8efb0 con 0x560f0bc489f0 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.441+0000 7f1e37400700 10 client.24622 handle_command_reply: tid=0 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.441+0000 7f1e628cbb80 1 client.24622 shutdown 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 msgr2=0x560f0bc39d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cfd0 tx=0x7f1e440ccaa0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 shutdown_connections 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bc489f0 0x560f0bc4abe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc37540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2ed10 0x560f0bc39d00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/1339831529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2f630 0x560f0bc37000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e37400700 0 client.24622 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 >> 172.21.15.31:0/1339831529 conn(0x560f0bb5c120 msgr2=0x560f0bc2ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 shutdown_connections 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 1 -- 172.21.15.31:0/1339831529 wait complete. 2024-06-02T22:32:04.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.442+0000 7f1e628cbb80 20 client.24622 trim_cache size 0 max 16384 2024-06-02T22:32:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:04 smithi098 ceph-mon[36750]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 205 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.466+0000 7f1e628cbb80 1 Processor -- start 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.466+0000 7f1e628cbb80 1 -- start start 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc3a4e0 0x560f0bc35c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc48f20 con 0x560f0bc2ed10 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc495f0 con 0x560f0bc2f630 2024-06-02T22:32:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc49cc0 con 0x560f0bc3a4e0 2024-06-02T22:32:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc32780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40318/0 (socket says 172.21.15.31:40318) 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e55600700 1 -- 172.21.15.31:0/3960628515 learned_addr learned my addr 172.21.15.31:0/3960628515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e56000700 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc3a4e0 0x560f0bc35c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 -- 172.21.15.31:0/3960628515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc3a4e0 msgr2=0x560f0bc35c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc3a4e0 0x560f0bc35c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 -- 172.21.15.31:0/3960628515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 msgr2=0x560f0bc32780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc32780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.467+0000 7f1e54c00700 1 -- 172.21.15.31:0/3960628515 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f0bc2bd00 con 0x560f0bc2f630 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.468+0000 7f1e54c00700 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c006010 tx=0x7f1e3c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43c4eea55d449f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.468+0000 7f1e42000700 1 -- 172.21.15.31:0/3960628515 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0050b0 con 0x560f0bc2f630 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.468+0000 7f1e42000700 1 -- 172.21.15.31:0/3960628515 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c003680 con 0x560f0bc2f630 2024-06-02T22:32:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.468+0000 7f1e42000700 1 -- 172.21.15.31:0/3960628515 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00f6c0 con 0x560f0bc2f630 2024-06-02T22:32:04.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- 172.21.15.31:0/3960628515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 msgr2=0x560f0bc39840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c006010 tx=0x7f1e3c00b260 comp rx=0 tx=0).stop 2024-06-02T22:32:04.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- 172.21.15.31:0/3960628515 shutdown_connections 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc3a4e0 0x560f0bc35c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/3960628515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc2f630 0x560f0bc39840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- 172.21.15.31:0/3960628515 >> 172.21.15.31:0/3960628515 conn(0x560f0bb5c120 msgr2=0x560f0bc35570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- 172.21.15.31:0/3960628515 shutdown_connections 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- 172.21.15.31:0/3960628515 wait complete. 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.469+0000 7f1e628cbb80 1 -- start start 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 Processor -- start 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2f630 0x560f0bc4e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc4aa60 con 0x560f0bc2ed10 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc4a390 con 0x560f0bc3a4e0 2024-06-02T22:32:04.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560f0bc4b130 con 0x560f0bc2f630 2024-06-02T22:32:04.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.470+0000 7f1e628cbb80 10 client.0 _ll_register_callbacks cb 0x560f0bb17330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:32:04.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e55600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40334/0 (socket says 172.21.15.31:40334) 2024-06-02T22:32:04.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e54c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2f630 0x560f0bc4e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e55600700 1 -- 172.21.15.31:0/2322988553 learned_addr learned my addr 172.21.15.31:0/2322988553 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57336/0 (socket says 172.21.15.31:57336) 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 -- 172.21.15.31:0/2322988553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2f630 msgr2=0x560f0bc4e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2f630 0x560f0bc4e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 -- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 msgr2=0x560f0bc4e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 -- 172.21.15.31:0/2322988553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f0bc30530 con 0x560f0bc3a4e0 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e55600700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e56000700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e4801e950 tx=0x7f1e48016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1f76aba6d5c1f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.471+0000 7f1e37400700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:32:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48017040 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f1e48004a30 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c003680 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1e48034050 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e628cbb80 10 client.24605 fetch_fsmap learned FSMap version 17 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560f0bcb5660 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e3c003680 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.472+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f1e48028070 con 0x560f0bc3a4e0 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 10 client.24605 fetch_fsmap finished waiting for FSMap version 17 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 10 client.24605 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 20 client.24605 populate_metadata read hostname 'smithi031' 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bcba320 0x560f0bcb9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 4 client.24605 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "status"}) -- 0x560f0bb89530 con 0x560f0bcba320 2024-06-02T22:32:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e55600700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bcba320 0x560f0bcb9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e55600700 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bcba320 0x560f0bcb9030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4f711c5fda1085 server_cookie=6fd98c8ca7d04116 in_seq=0 out_seq=0 2024-06-02T22:32:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.473+0000 7f1e37400700 10 client.24605 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:32:04.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e37400700 1 -- 172.21.15.31:0/2322988553 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560f0bb89530 con 0x560f0bcba320 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e37400700 10 client.24605 handle_command_reply: tid=0 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 client.24605 shutdown 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 msgr2=0x560f0bc52a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1e4801e950 tx=0x7f1e48016000 comp rx=0 tx=0).stop 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 shutdown_connections 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560f0bcba320 0x560f0bcb9030 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560f0bc3a4e0 0x560f0bc52a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560f0bc2ed10 0x560f0bc4e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 --2- 172.21.15.31:0/2322988553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f0bc2f630 0x560f0bc4e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 >> 172.21.15.31:0/2322988553 conn(0x560f0bb5c120 msgr2=0x560f0bc38830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e37400700 0 client.24605 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 shutdown_connections 2024-06-02T22:32:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.474+0000 7f1e628cbb80 1 -- 172.21.15.31:0/2322988553 wait complete. 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.475+0000 7f1e628cbb80 20 client.24605 trim_cache size 0 max 16384 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24517, 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 40.718101322999999, 2024-06-02T22:32:04.478 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 17, 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 97, 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 95, 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 68.104462056000003 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.475+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 msgr2=0x7f1e380a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.475+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 0x7f1e380a50e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e5006baf0 tx=0x7f1e48011440 comp rx=0 tx=0).stop 2024-06-02T22:32:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.475+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 msgr2=0x7f1e5019f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.475+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400ef10 tx=0x7f1e4400c3a0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 shutdown_connections 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1e380a2c20 0x7f1e380a50e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1e50113240 0x7f1e501a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e500769c0 0x7f1e5019f190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 --2- 172.21.15.31:0/3985006439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e500772e0 0x7f1e5019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 >> 172.21.15.31:0/3985006439 conn(0x7f1e501000d0 msgr2=0x7f1e501024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 shutdown_connections 2024-06-02T22:32:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:04.476+0000 7f1e56a00700 1 -- 172.21.15.31:0/3985006439 wait complete. 2024-06-02T22:32:05.475 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:32:05.475 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:05.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T22:32:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:06 smithi178 ceph-mon[36614]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:06.333 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:06 smithi031 ceph-mon[31767]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:06 smithi098 ceph-mon[36750]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T22:32:08.280 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:08 smithi031 ceph-mon[31767]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 160 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:08 smithi178 ceph-mon[36614]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 160 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:08 smithi098 ceph-mon[36750]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 160 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:08.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 -- 172.21.15.31:0/336978706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc107840 msgr2=0x7fbdbc10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:08.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/336978706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc107840 0x7fbdbc10f3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400b0d0 tx=0x7fbdb400b3e0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 -- 172.21.15.31:0/336978706 shutdown_connections 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/336978706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc107840 0x7fbdbc10f3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/336978706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc102740 0x7fbdbc102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/336978706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 -- 172.21.15.31:0/336978706 >> 172.21.15.31:0/336978706 conn(0x7fbdbc0795f0 msgr2=0x7fbdbc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 -- 172.21.15.31:0/336978706 shutdown_connections 2024-06-02T22:32:08.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.601+0000 7fbdc2a00700 1 -- 172.21.15.31:0/336978706 wait complete. 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 Processor -- start 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 -- start start 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc107840 0x7fbdbc075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1127b0 con 0x7fbdbc107840 2024-06-02T22:32:08.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc112630 con 0x7fbdbc1030f0 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.603+0000 7fbdc2a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc112930 con 0x7fbdbc102740 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57354/0 (socket says 172.21.15.31:57354) 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 -- 172.21.15.31:0/4074047468 learned_addr learned my addr 172.21.15.31:0/4074047468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:52498/0 (socket says 172.21.15.31:52498) 2024-06-02T22:32:08.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdc0a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc107840 0x7fbdbc075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 -- 172.21.15.31:0/4074047468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 msgr2=0x7fbdbc074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 -- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc107840 msgr2=0x7fbdbc075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc107840 0x7fbdbc075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 -- 172.21.15.31:0/4074047468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc1a70b0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbbe00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:08.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.604+0000 7fbdbb400700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbda800e9a0 tx=0x7fbda800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.605+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda800ca10 con 0x7fbdbc1030f0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.605+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda800cbb0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.605+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc1a73a0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.605+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8018680 con 0x7fbdbc1030f0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.605+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc1a7930 con 0x7fbdbc1030f0 2024-06-02T22:32:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.606+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc069180 con 0x7fbdbc1030f0 2024-06-02T22:32:08.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.609+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbda8010430 con 0x7fbdbc1030f0 2024-06-02T22:32:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.610+0000 7fbdb8c00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 0x7fbda00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.610+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fbda80cf530 con 0x7fbdbc1030f0 2024-06-02T22:32:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.610+0000 7fbdbbe00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 0x7fbda00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.611+0000 7fbdbbe00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 0x7fbda00a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdac011490 tx=0x7fbdac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.614+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbda809c0d0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.910+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbdbc02dca0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.911+0000 7fbdb8c00700 1 -- 172.21.15.31:0/4074047468 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fbda809b9d0 con 0x7fbdbc1030f0 2024-06-02T22:32:08.911 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:32:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.915+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 msgr2=0x7fbda00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:08.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.915+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 0x7fbda00a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbdac011490 tx=0x7fbdac009260 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.915+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 msgr2=0x7fbdbc074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.915+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbda800e9a0 tx=0x7fbda800ecb0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 shutdown_connections 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbda00a2ca0 0x7fbda00a5160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdbc107840 0x7fbdbc075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdbc102740 0x7fbdbc074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 --2- 172.21.15.31:0/4074047468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbdbc1030f0 0x7fbdbc074cd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 >> 172.21.15.31:0/4074047468 conn(0x7fbdbc0795f0 msgr2=0x7fbdbc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 shutdown_connections 2024-06-02T22:32:08.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:08.916+0000 7fbdc2a00700 1 -- 172.21.15.31:0/4074047468 wait complete. 2024-06-02T22:32:09.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:32:09.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:09 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/4074047468' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:32:09.319 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:32:09.321 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:09 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/4074047468' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:32:09.336 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:32:09.336 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:09 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/4074047468' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:32:09.889 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T22:32:09.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:09.890 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-06-02T22:32:09.933 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:32:09.933 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-06-02T22:32:09.934 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41960sec preferred_lft 41960sec 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-06-02T22:32:09.935 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-06-02T22:32:09.936 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T22:32:09.936 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:32:10.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:32:10.095 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:10 smithi031 ceph-mon[31767]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 137 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:10 smithi178 ceph-mon[36614]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 137 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:10 smithi098 ceph-mon[36750]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 137 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T22:32:10.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:10.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:10.560 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:32:10.630 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-06-02T22:32:10.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:10.637 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-06-02T22:32:10.716 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-06-02T22:32:10.716 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:32:10.716 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T22:32:10.716 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T22:32:10.716 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:32:10.717 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:32:10.718 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:32:10.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T22:32:10.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T22:32:10.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T22:32:10.718 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:32:10.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:32:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:11 smithi031 ceph-mon[31767]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:11.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:11 smithi178 ceph-mon[36614]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:11.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:11.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:11 smithi098 ceph-mon[36750]: pgmap v365: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:11.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:11.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:11.542 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-06-02T22:32:11.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:11.587 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-06-02T22:32:11.673 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:32:11.673 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:32:11.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:11.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-02T22:32:11.673 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:32:11.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:32:11.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:11.881 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-02T22:32:11.881 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:32:11.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:32:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:12.193 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:32:12.193 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:32:12.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-06-02T22:32:12.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T22:32:12.193 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:32:12.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:32:12.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:12.394 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-02T22:32:12.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:32:12.394 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:12.439 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T22:32:12.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:32:12.439 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:12.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-06-02T22:32:12.615 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:32:12.666 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-06-02T22:32:12.666 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-06-02T22:32:12.666 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-06-02T22:32:12.666 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-06-02T22:32:12.667 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay 2024-06-02T22:32:12.668 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/0 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/merged 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-06-02T22:32:12.669 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:12.670 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:12.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:12.671 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-06-02T22:32:12.716 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T22:32:12.717 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-02T22:32:12.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-06-02T22:32:12.839 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:32:12.879 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-06-02T22:32:12.879 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-06-02T22:32:12.879 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-06-02T22:32:12.880 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/merged 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/merged 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/0 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/merged 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/merged 2024-06-02T22:32:12.881 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/merged 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:12.882 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:12.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:12.883 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-06-02T22:32:12.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:2024-06-02T22:32:12.997+0000 7fe89302f480 -1 init, newargv = 0x56542d0636d0 newargc=15 2024-06-02T22:32:12.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[77830]: starting ceph client 2024-06-02T22:32:13.009 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[77830]: starting fuse 2024-06-02T22:32:13.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:13 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:13 smithi031 ceph-mon[31767]: pgmap v366: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:13 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:13 smithi098 ceph-mon[36750]: pgmap v366: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:13.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:13 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:13.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:13 smithi178 ceph-mon[36614]: pgmap v366: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 134 B/s, 0 objects/s recovering 2024-06-02T22:32:14.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-06-02T22:32:14.167 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T22:32:14.221 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-06-02T22:32:14.221 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/selinux 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-06-02T22:32:14.222 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/merged 2024-06-02T22:32:14.223 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/merged 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/0 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/merged 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/merged 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/merged 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/merged 2024-06-02T22:32:14.225 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/merged 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/merged 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/merged 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/merged 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:32:14.226 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:14.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:14.227 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-06-02T22:32:14.278 INFO:teuthology.orchestra.run.smithi031.stdout:119 2024-06-02T22:32:14.278 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-06-02T22:32:14.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-06-02T22:32:14.279 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.admin")) 2024-06-02T22:32:14.280 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-06-02T22:32:14.447 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.admin.77830.asok 2024-06-02T22:32:14.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:14.462 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:32:14.463 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:32:14.463 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:14.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:32:14.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:32:14.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:14.466 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.77830.asok 2024-06-02T22:32:14.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:14.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.77830.asok status 2024-06-02T22:32:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:32:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:32:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:32:14.710 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "admin", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "77830", 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14526, 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-06-02T22:32:14.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 14526 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3202507396 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "192.168.0.1:0", 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3202507396 2024-06-02T22:32:14.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.14526 192.168.0.1:0/3202507396", 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "192.168.0.1:0/3202507396", 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 17, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 97, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-06-02T22:32:14.713 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:32:14.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:14.727 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-06-02T22:32:14.727 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:14.786 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-06-02T22:32:14.786 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:14.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:14.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:14.874 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-02T22:32:14.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T22:32:15.033 INFO:teuthology.orchestra.run.smithi031.stdout:# file: . 2024-06-02T22:32:15.033 INFO:teuthology.orchestra.run.smithi031.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-02T22:32:15.033 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:32:15.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:32:15.045 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:32:15.045 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:32:15.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-02T22:32:15.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:15 smithi098 ceph-mon[36750]: pgmap v367: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:15.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:15 smithi178 ceph-mon[36614]: pgmap v367: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:15.563 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:15.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:15 smithi031 ceph-mon[31767]: pgmap v367: 129 pgs: 129 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:17.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:17 smithi178 ceph-mon[36614]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:17.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:17 smithi031 ceph-mon[31767]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:17.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:17 smithi098 ceph-mon[36750]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:18.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.116+0000 7ff776000700 1 -- 172.21.15.31:0/223354116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77010eac0 msgr2=0x7ff77010eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:18.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.116+0000 7ff776000700 1 --2- 172.21.15.31:0/223354116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77010eac0 0x7ff77010eea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff760009990 tx=0x7ff760009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 -- 172.21.15.31:0/223354116 shutdown_connections 2024-06-02T22:32:18.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 --2- 172.21.15.31:0/223354116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff770115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 --2- 172.21.15.31:0/223354116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77010eac0 0x7ff77010eea0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 --2- 172.21.15.31:0/223354116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff770108ac0 0x7ff770108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 -- 172.21.15.31:0/223354116 >> 172.21.15.31:0/223354116 conn(0x7ff770075c60 msgr2=0x7ff7701072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 -- 172.21.15.31:0/223354116 shutdown_connections 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.117+0000 7ff776000700 1 -- 172.21.15.31:0/223354116 wait complete. 2024-06-02T22:32:18.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.118+0000 7ff776000700 1 Processor -- start 2024-06-02T22:32:18.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 -- start start 2024-06-02T22:32:18.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:18.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff77019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:18.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 0x7ff7701a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:18.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff770118df0 con 0x7ff770108ac0 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff770118c70 con 0x7ff770109480 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.119+0000 7ff776000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff770118f70 con 0x7ff77010eac0 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33710/0 (socket says 172.21.15.31:33710) 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76f400700 1 -- 172.21.15.31:0/2732793592 learned_addr learned my addr 172.21.15.31:0/2732793592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76fe00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 0x7ff7701a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:18.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff77019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 -- 172.21.15.31:0/2732793592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 msgr2=0x7ff7701a3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 0x7ff7701a3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 -- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 msgr2=0x7ff77019f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 -- 172.21.15.31:0/2732793592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7701a4290 con 0x7ff770109480 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76f400700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:18.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76fe00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 0x7ff7701a3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.120+0000 7ff76ea00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff77019f7c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.121+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00cbd0 con 0x7ff770109480 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.121+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c00cd70 con 0x7ff770109480 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.121+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c018710 con 0x7ff770109480 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.121+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7701a4580 con 0x7ff770109480 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.121+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701abe00 con 0x7ff770109480 2024-06-02T22:32:18.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.122+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff770111050 con 0x7ff770109480 2024-06-02T22:32:18.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.125+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff75c010430 con 0x7ff770109480 2024-06-02T22:32:18.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.126+0000 7ff767e00700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 0x7ff7540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:18.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.126+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7ff75c0cf620 con 0x7ff770109480 2024-06-02T22:32:18.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.127+0000 7ff76f400700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 0x7ff7540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:18.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.127+0000 7ff76f400700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 0x7ff7540a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff760006010 tx=0x7ff760009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:18.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.131+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff75c09c1c0 con 0x7ff770109480 2024-06-02T22:32:18.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.378+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7701a05e0 con 0x7ff770109480 2024-06-02T22:32:18.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.379+0000 7ff767e00700 1 -- 172.21.15.31:0/2732793592 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+591 (secure 0 0 0) 0x7ff75c09bac0 con 0x7ff770109480 2024-06-02T22:32:18.379 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1942203888 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:18.379 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:18.379 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:18.379 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1083714701 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/228016607 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1762120421 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2749889089 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2883761228 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:18.380 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 msgr2=0x7ff7540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 0x7ff7540a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff760006010 tx=0x7ff760009570 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 msgr2=0x7ff77019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff77019f7c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00ed00 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 shutdown_connections 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7540a2c20 0x7ff7540a50e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77010eac0 0x7ff7701a3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff770108ac0 0x7ff77019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 --2- 172.21.15.31:0/2732793592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770109480 0x7ff77019f7c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.382+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 >> 172.21.15.31:0/2732793592 conn(0x7ff770075c60 msgr2=0x7ff770076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:18.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.383+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 shutdown_connections 2024-06-02T22:32:18.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:18.383+0000 7ff776000700 1 -- 172.21.15.31:0/2732793592 wait complete. 2024-06-02T22:32:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:listed 10 entries 2024-06-02T22:32:19.248 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:32:19.248 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:32:19.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-02T22:32:19.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:19 smithi031 ceph-mon[31767]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:19.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:19 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2732793592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:19 smithi098 ceph-mon[36750]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:19.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:19 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2732793592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:19.790 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:19.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:19 smithi178 ceph-mon[36614]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:19.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:19 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2732793592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:21 smithi031 ceph-mon[31767]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:21 smithi098 ceph-mon[36750]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:21 smithi178 ceph-mon[36614]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 -- 172.21.15.31:0/4109156039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc10eac0 msgr2=0x7f08dc10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 --2- 172.21.15.31:0/4109156039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc10eac0 0x7f08dc10eea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08d0009990 tx=0x7f08d0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 -- 172.21.15.31:0/4109156039 shutdown_connections 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 --2- 172.21.15.31:0/4109156039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc109480 0x7f08dc115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 --2- 172.21.15.31:0/4109156039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc10eac0 0x7f08dc10eea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 --2- 172.21.15.31:0/4109156039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 -- 172.21.15.31:0/4109156039 >> 172.21.15.31:0/4109156039 conn(0x7f08dc075c60 msgr2=0x7f08dc1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 -- 172.21.15.31:0/4109156039 shutdown_connections 2024-06-02T22:32:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.185+0000 7f08e3400700 1 -- 172.21.15.31:0/4109156039 wait complete. 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.186+0000 7f08e3400700 1 Processor -- start 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 -- start start 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 0x7f08dc19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc10eac0 0x7f08dc1a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc118e40 con 0x7f08dc10eac0 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc118cc0 con 0x7f08dc109480 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e3400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc118fc0 con 0x7f08dc108ac0 2024-06-02T22:32:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e1400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc10eac0 0x7f08dc1a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e0a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e0a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50750/0 (socket says 172.21.15.31:50750) 2024-06-02T22:32:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08e0a00700 1 -- 172.21.15.31:0/568287728 learned_addr learned my addr 172.21.15.31:0/568287728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.187+0000 7f08dbe00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 0x7f08dc19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08e0a00700 1 -- 172.21.15.31:0/568287728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 msgr2=0x7f08dc19f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08e0a00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 0x7f08dc19f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08e0a00700 1 -- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc10eac0 msgr2=0x7f08dc1a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08e0a00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc10eac0 0x7f08dc1a3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08e0a00700 1 -- 172.21.15.31:0/568287728 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc1a4240 con 0x7f08dc108ac0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.188+0000 7f08dbe00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 0x7f08dc19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08e0a00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d0027070 con 0x7f08dc108ac0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08d0003d70 con 0x7f08dc108ac0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc1a44d0 con 0x7f08dc108ac0 2024-06-02T22:32:22.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08d000f460 con 0x7f08dc108ac0 2024-06-02T22:32:22.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.189+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc1abdb0 con 0x7f08dc108ac0 2024-06-02T22:32:22.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.190+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc069180 con 0x7f08dc108ac0 2024-06-02T22:32:22.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.193+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f08d002a070 con 0x7f08dc108ac0 2024-06-02T22:32:22.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.194+0000 7f08d9600700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 0x7f08c40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:22.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.194+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f08d00d0d30 con 0x7f08dc108ac0 2024-06-02T22:32:22.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.194+0000 7f08dbe00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 0x7f08c40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:22.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.195+0000 7f08dbe00700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 0x7f08c40a5160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08dc077b10 tx=0x7f08cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:22.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.196+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f08d0031070 con 0x7f08dc108ac0 2024-06-02T22:32:22.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.443+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f08dc1a0590 con 0x7f08dc108ac0 2024-06-02T22:32:22.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.444+0000 7f08d9600700 1 -- 172.21.15.31:0/568287728 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v97) ==== 81+0+591 (secure 0 0 0) 0x7f08d0013070 con 0x7f08dc108ac0 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1942203888 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1083714701 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/228016607 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1762120421 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:22.445 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2749889089 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:22.446 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:22.446 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2883761228 2024-06-03T22:22:54.073541+0000 2024-06-02T22:32:22.446 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:32:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.447+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 msgr2=0x7f08c40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.447+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 0x7f08c40a5160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08dc077b10 tx=0x7f08cc009260 comp rx=0 tx=0).stop 2024-06-02T22:32:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 msgr2=0x7f08dc19f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:22.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000c00 tx=0x7f08d000bab0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 shutdown_connections 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f08c40a2ca0 0x7f08c40a5160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08dc10eac0 0x7f08dc1a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08dc108ac0 0x7f08dc19f230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 --2- 172.21.15.31:0/568287728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08dc109480 0x7f08dc19f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 >> 172.21.15.31:0/568287728 conn(0x7f08dc075c60 msgr2=0x7f08dc0761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 shutdown_connections 2024-06-02T22:32:22.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:22.448+0000 7f08e3400700 1 -- 172.21.15.31:0/568287728 wait complete. 2024-06-02T22:32:22.450 INFO:teuthology.orchestra.run.smithi031.stderr:listed 10 entries 2024-06-02T22:32:23.474 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-06-02T22:32:23.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:23.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-02T22:32:23.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[77830]: fuse finished with error 0 and tester_r 0 2024-06-02T22:32:23.570 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T22:32:23.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:23 smithi031 ceph-mon[31767]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:23.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:23 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/568287728' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:23.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:23 smithi098 ceph-mon[36750]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:23.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:23 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/568287728' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:23 smithi178 ceph-mon[36614]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:23 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/568287728' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:32:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:25 smithi031 ceph-mon[31767]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:25 smithi098 ceph-mon[36750]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:25 smithi178 ceph-mon[36614]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-02T22:32:27.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:27 smithi031 ceph-mon[31767]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-02T22:32:27.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:27 smithi098 ceph-mon[36750]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-02T22:32:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:27 smithi178 ceph-mon[36614]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-02T22:32:29.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:29 smithi031 ceph-mon[31767]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:29.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:32:29.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:32:29.672 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-02T22:32:29.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:29 smithi098 ceph-mon[36750]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:29.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:32:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:29 smithi178 ceph-mon[36614]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:30.223 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:31.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:31 smithi031 ceph-mon[31767]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:31.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:31 smithi098 ceph-mon[36750]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:31.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:31 smithi178 ceph-mon[36614]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:32.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 -- 172.21.15.31:0/87178005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 msgr2=0x7f8b2010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:32.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 --2- 172.21.15.31:0/87178005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2010f3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b0d0 tx=0x7f8b1800b3e0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 -- 172.21.15.31:0/87178005 shutdown_connections 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 --2- 172.21.15.31:0/87178005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2010f3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 --2- 172.21.15.31:0/87178005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b20102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 --2- 172.21.15.31:0/87178005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 0x7f8b20107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 -- 172.21.15.31:0/87178005 >> 172.21.15.31:0/87178005 conn(0x7f8b200795f0 msgr2=0x7f8b20079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 -- 172.21.15.31:0/87178005 shutdown_connections 2024-06-02T22:32:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.675+0000 7f8b25e00700 1 -- 172.21.15.31:0/87178005 wait complete. 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 Processor -- start 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 -- start start 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 0x7f8b2019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:32.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8b201127b0 con 0x7f8b20102740 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20112630 con 0x7f8b20107840 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.676+0000 7f8b25e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b20112930 con 0x7f8b201030f0 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58574/0 (socket says 172.21.15.31:58574) 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 -- 172.21.15.31:0/3722611433 learned_addr learned my addr 172.21.15.31:0/3722611433 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1f400700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:32.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1e000700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 0x7f8b2019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 -- 172.21.15.31:0/3722611433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 msgr2=0x7f8b2019b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 0x7f8b2019b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 -- 172.21.15.31:0/3722611433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 msgr2=0x7f8b2019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2019f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.677+0000 7f8b1ea00700 1 -- 172.21.15.31:0/3722611433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2019fd80 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b1ea00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000e9a0 tx=0x7f8b1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000ca10 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1000cbb0 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b201a0070 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10018680 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.678+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b201a78f0 con 0x7f8b20102740 2024-06-02T22:32:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.679+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b20069180 con 0x7f8b20102740 2024-06-02T22:32:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.681+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8b10010430 con 0x7f8b20102740 2024-06-02T22:32:32.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.683+0000 7f8b24a00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 0x7f8b040a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:32.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.683+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f8b100cf640 con 0x7f8b20102740 2024-06-02T22:32:32.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.684+0000 7f8b1e000700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 0x7f8b040a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:32.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.684+0000 7f8b1e000700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 0x7f8b040a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8b20108ef0 tx=0x7f8b0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:32.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.688+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8b1009c1e0 con 0x7f8b20102740 2024-06-02T22:32:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.930+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b201a7ac0 con 0x7f8b20102740 2024-06-02T22:32:32.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.935+0000 7f8b24a00700 1 -- 172.21.15.31:0/3722611433 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24621 (secure 0 0 0) 0x7f8b1009bae0 con 0x7f8b20102740 2024-06-02T22:32:32.936 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:32:32.937 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":97,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:31:55.962368+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:32:32.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 msgr2=0x7f8b040a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:32.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 0x7f8b040a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8b20108ef0 tx=0x7f8b0c009260 comp rx=0 tx=0).stop 2024-06-02T22:32:32.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 msgr2=0x7f8b2019ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:32.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000e9a0 tx=0x7f8b1000ecb0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 shutdown_connections 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b040a2c20 0x7f8b040a50e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b20107840 0x7f8b2019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b20102740 0x7f8b2019ad70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 --2- 172.21.15.31:0/3722611433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b201030f0 0x7f8b2019b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.938+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 >> 172.21.15.31:0/3722611433 conn(0x7f8b200795f0 msgr2=0x7f8b20100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.939+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 shutdown_connections 2024-06-02T22:32:32.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:32.939+0000 7f8b25e00700 1 -- 172.21.15.31:0/3722611433 wait complete. 2024-06-02T22:32:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:33 smithi031 ceph-mon[31767]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:33 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3722611433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:33 smithi098 ceph-mon[36750]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:33.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:33 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3722611433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:33.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:32:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:33 smithi178 ceph-mon[36614]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:33.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:33 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3722611433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:35.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:35 smithi031 ceph-mon[31767]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:35 smithi098 ceph-mon[36750]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:35.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:35 smithi178 ceph-mon[36614]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.670+0000 7f4d48600700 1 -- 172.21.15.31:0/746269363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 msgr2=0x7f4d4010aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.670+0000 7f4d48600700 1 --2- 172.21.15.31:0/746269363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4010aa90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009990 tx=0x7f4d34009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.670+0000 7f4d48600700 1 -- 172.21.15.31:0/746269363 shutdown_connections 2024-06-02T22:32:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.670+0000 7f4d48600700 1 --2- 172.21.15.31:0/746269363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 0x7f4d40111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.670+0000 7f4d48600700 1 --2- 172.21.15.31:0/746269363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4010aa90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.671+0000 7f4d48600700 1 --2- 172.21.15.31:0/746269363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d40104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.671+0000 7f4d48600700 1 -- 172.21.15.31:0/746269363 >> 172.21.15.31:0/746269363 conn(0x7f4d401001a0 msgr2=0x7f4d401025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.671+0000 7f4d48600700 1 -- 172.21.15.31:0/746269363 shutdown_connections 2024-06-02T22:32:36.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.671+0000 7f4d48600700 1 -- 172.21.15.31:0/746269363 wait complete. 2024-06-02T22:32:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 Processor -- start 2024-06-02T22:32:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 -- start start 2024-06-02T22:32:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 0x7f4d4019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40114a40 con 0x7f4d40105070 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401148c0 con 0x7f4d401046b0 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.672+0000 7f4d48600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40114bc0 con 0x7f4d4010a6b0 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d46600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 0x7f4d4019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:35302/0 (socket says 172.21.15.31:35302) 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 -- 172.21.15.31:0/2019204305 learned_addr learned my addr 172.21.15.31:0/2019204305 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d46600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59642/0 (socket says 172.21.15.31:59642) 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 -- 172.21.15.31:0/2019204305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 msgr2=0x7f4d4019f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 -- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 msgr2=0x7f4d4019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 0x7f4d4019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 -- 172.21.15.31:0/2019204305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4019fe60 con 0x7f4d401046b0 2024-06-02T22:32:36.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d46600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.673+0000 7f4d45c00700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d3400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.674+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34027070 con 0x7f4d401046b0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.674+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d401a00f0 con 0x7f4d401046b0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.674+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d340056d0 con 0x7f4d401046b0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.674+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34022e10 con 0x7f4d401046b0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.674+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d401a79d0 con 0x7f4d401046b0 2024-06-02T22:32:36.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.675+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4010cc40 con 0x7f4d401046b0 2024-06-02T22:32:36.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.677+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f4d3402a070 con 0x7f4d401046b0 2024-06-02T22:32:36.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.679+0000 7f4d3e000700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 0x7f4d280a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:36.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.679+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f4d340d0b00 con 0x7f4d401046b0 2024-06-02T22:32:36.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.679+0000 7f4d45200700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 0x7f4d280a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:36.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.680+0000 7f4d45200700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 0x7f4d280a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d401027b0 tx=0x7f4d2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:36.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.682+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4d34013070 con 0x7f4d401046b0 2024-06-02T22:32:36.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.911+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d4019c1b0 con 0x7f4d401046b0 2024-06-02T22:32:36.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.914+0000 7f4d3e000700 1 -- 172.21.15.31:0/2019204305 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24621 (secure 0 0 0) 0x7f4d3409d730 con 0x7f4d401046b0 2024-06-02T22:32:36.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:32:36.915 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":97,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:31:55.962368+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:32:36.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 msgr2=0x7f4d280a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:36.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 0x7f4d280a50e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d401027b0 tx=0x7f4d2c009260 comp rx=0 tx=0).stop 2024-06-02T22:32:36.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 msgr2=0x7f4d4019ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:36.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d34000c00 tx=0x7f4d3400bab0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 shutdown_connections 2024-06-02T22:32:36.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d280a2c20 0x7f4d280a50e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d4010a6b0 0x7f4d4019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.917+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d401046b0 0x7f4d4019ae50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.918+0000 7f4d48600700 1 --2- 172.21.15.31:0/2019204305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40105070 0x7f4d4019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.918+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 >> 172.21.15.31:0/2019204305 conn(0x7f4d401001a0 msgr2=0x7f4d40100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.918+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 shutdown_connections 2024-06-02T22:32:36.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:36.918+0000 7f4d48600700 1 -- 172.21.15.31:0/2019204305 wait complete. 2024-06-02T22:32:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:37 smithi031 ceph-mon[31767]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:37.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:37 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2019204305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:37 smithi098 ceph-mon[36750]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:37 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2019204305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:37.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:37 smithi178 ceph-mon[36614]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-02T22:32:37.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:37 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2019204305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:32:37.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-02T22:32:38.477 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:39 smithi031 ceph-mon[31767]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:39 smithi098 ceph-mon[36750]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:39.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:39 smithi178 ceph-mon[36614]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:40.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 -- 172.21.15.31:0/162275901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc104f80 msgr2=0x7f5cbc111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:40.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 --2- 172.21.15.31:0/162275901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc104f80 0x7f5cbc111490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5cb400b0a0 tx=0x7f5cb400b3b0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 -- 172.21.15.31:0/162275901 shutdown_connections 2024-06-02T22:32:40.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 --2- 172.21.15.31:0/162275901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc104f80 0x7f5cbc111490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 --2- 172.21.15.31:0/162275901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc10a650 0x7f5cbc10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 --2- 172.21.15.31:0/162275901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 0x7f5cbc104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 -- 172.21.15.31:0/162275901 >> 172.21.15.31:0/162275901 conn(0x7f5cbc1000b0 msgr2=0x7f5cbc1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:40.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 -- 172.21.15.31:0/162275901 shutdown_connections 2024-06-02T22:32:40.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.848+0000 7f5cc1800700 1 -- 172.21.15.31:0/162275901 wait complete. 2024-06-02T22:32:40.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.849+0000 7f5cc1800700 1 Processor -- start 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 -- start start 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 0x7f5cbc1a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc10a650 0x7f5cbc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc114960 con 0x7f5cbc10a650 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc1147e0 con 0x7f5cbc1045c0 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.850+0000 7f5cc1800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc114ae0 con 0x7f5cbc104f80 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48512/0 (socket says 172.21.15.31:48512) 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 -- 172.21.15.31:0/3514840449 learned_addr learned my addr 172.21.15.31:0/3514840449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbbe00700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 0x7f5cbc1a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cc0e00700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc10a650 0x7f5cbc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 -- 172.21.15.31:0/3514840449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 msgr2=0x7f5cbc1a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 0x7f5cbc1a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 -- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc10a650 msgr2=0x7f5cbc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc10a650 0x7f5cbc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 -- 172.21.15.31:0/3514840449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc19b260 con 0x7f5cbc104f80 2024-06-02T22:32:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.851+0000 7f5cbb400700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800e9a0 tx=0x7f5ca800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.852+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800ca10 con 0x7f5cbc104f80 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.852+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ca800cbb0 con 0x7f5cbc104f80 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.852+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8018680 con 0x7f5cbc104f80 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.852+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc19b550 con 0x7f5cbc104f80 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.852+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc1a77c0 con 0x7f5cbc104f80 2024-06-02T22:32:40.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.853+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc069180 con 0x7f5cbc104f80 2024-06-02T22:32:40.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.855+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5ca8010430 con 0x7f5cbc104f80 2024-06-02T22:32:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.857+0000 7f5cb8c00700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 0x7f5ca00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.857+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7f5ca80cf580 con 0x7f5cbc104f80 2024-06-02T22:32:40.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.857+0000 7f5cbbe00700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 0x7f5ca00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:40.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.858+0000 7f5cbbe00700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 0x7f5ca00a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc109660 tx=0x7f5cac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:40.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:40.861+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5ca809c120 con 0x7f5cbc104f80 2024-06-02T22:32:41.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.145+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5cbc02dca0 con 0x7f5cbc104f80 2024-06-02T22:32:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.373+0000 7f5cb8c00700 1 -- 172.21.15.31:0/3514840449 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f5ca809ba20 con 0x7f5cbc104f80 2024-06-02T22:32:41.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 msgr2=0x7f5ca00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:41.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 0x7f5ca00a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc109660 tx=0x7f5cac009260 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 msgr2=0x7f5cbc1a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800e9a0 tx=0x7f5ca800ecb0 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 shutdown_connections 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5ca00a2ca0 0x7f5ca00a5160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cbc10a650 0x7f5cbc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cbc1045c0 0x7f5cbc1a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 --2- 172.21.15.31:0/3514840449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cbc104f80 0x7f5cbc1a0e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 >> 172.21.15.31:0/3514840449 conn(0x7f5cbc1000b0 msgr2=0x7f5cbc101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 shutdown_connections 2024-06-02T22:32:41.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:41.377+0000 7f5cc1800700 1 -- 172.21.15.31:0/3514840449 wait complete. 2024-06-02T22:32:41.399 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:41 smithi031 ceph-mon[31767]: pgmap v380: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:41.399 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3514840449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:41.399 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:41 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:41 smithi098 ceph-mon[36750]: pgmap v380: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3514840449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:41 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:41 smithi178 ceph-mon[36614]: pgmap v380: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3514840449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:41 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T22:32:42.379 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-06-02T22:32:42.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-06-02T22:32:42.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:42 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T22:32:42.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:42 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:42.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:42 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T22:32:42.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:42 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:42.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:42 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T22:32:42.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:42 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:42.851 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:43.527 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:43 smithi031 ceph-mon[31767]: pgmap v381: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:43 smithi098 ceph-mon[36750]: pgmap v381: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:43.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:43 smithi178 ceph-mon[36614]: pgmap v381: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.333+0000 7efdeba00700 1 -- 172.21.15.31:0/658573439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 msgr2=0x7efde410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.333+0000 7efdeba00700 1 --2- 172.21.15.31:0/658573439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde410e950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098f0 tx=0x7efdd0009c00 comp rx=0 tx=0).stop 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 -- 172.21.15.31:0/658573439 shutdown_connections 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 --2- 172.21.15.31:0/658573439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde410ee90 0x7efde4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 --2- 172.21.15.31:0/658573439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde40746c0 0x7efde4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 --2- 172.21.15.31:0/658573439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde410e950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 -- 172.21.15.31:0/658573439 >> 172.21.15.31:0/658573439 conn(0x7efde40795f0 msgr2=0x7efde4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 -- 172.21.15.31:0/658573439 shutdown_connections 2024-06-02T22:32:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.334+0000 7efdeba00700 1 -- 172.21.15.31:0/658573439 wait complete. 2024-06-02T22:32:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.335+0000 7efdeba00700 1 Processor -- start 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.335+0000 7efdeba00700 1 -- start start 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.335+0000 7efdeba00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.335+0000 7efdeba00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efdeba00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efdeba00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efde41149c0 con 0x7efde410ee90 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efdeba00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efde4114840 con 0x7efde4074fe0 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efdeba00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efde4114b40 con 0x7efde40746c0 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde3e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59246/0 (socket says 172.21.15.31:59246) 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 -- 172.21.15.31:0/66688245 learned_addr learned my addr 172.21.15.31:0/66688245 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9000700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 -- 172.21.15.31:0/66688245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 msgr2=0x7efde419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 -- 172.21.15.31:0/66688245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 msgr2=0x7efde419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9a00700 1 -- 172.21.15.31:0/66688245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde419fe10 con 0x7efde410ee90 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.336+0000 7efde9000700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efde9a00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efddc00ef90 tx=0x7efddc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0092e0 con 0x7efde410ee90 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41a00a0 con 0x7efde410ee90 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efddc004bb0 con 0x7efde410ee90 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc004280 con 0x7efde410ee90 2024-06-02T22:32:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.337+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41a7980 con 0x7efde410ee90 2024-06-02T22:32:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.339+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde4069180 con 0x7efde410ee90 2024-06-02T22:32:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.341+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efddc01b030 con 0x7efde410ee90 2024-06-02T22:32:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.342+0000 7efde1600700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 0x7efdcc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.342+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7efddc0ceea0 con 0x7efde410ee90 2024-06-02T22:32:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.343+0000 7efde9000700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 0x7efdcc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.343+0000 7efde9000700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 0x7efdcc0a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdd8005fd0 tx=0x7efdd8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:45.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.347+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efddc022020 con 0x7efde410ee90 2024-06-02T22:32:45.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:45 smithi031 ceph-mon[31767]: pgmap v382: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:45.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:45.630+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7efde402dca0 con 0x7efde410ee90 2024-06-02T22:32:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:45 smithi098 ceph-mon[36750]: pgmap v382: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:45.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:45 smithi178 ceph-mon[36614]: pgmap v382: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:46.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.413+0000 7efde1600700 1 -- 172.21.15.31:0/66688245 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7efddc010040 con 0x7efde410ee90 2024-06-02T22:32:46.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 msgr2=0x7efdcc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:46.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 0x7efdcc0a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdd8005fd0 tx=0x7efdd8009310 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 msgr2=0x7efde419f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efddc00ef90 tx=0x7efddc00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 shutdown_connections 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efdcc0a2ca0 0x7efdcc0a5160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde410ee90 0x7efde419f6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde40746c0 0x7efde419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 --2- 172.21.15.31:0/66688245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efde4074fe0 0x7efde419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.419+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 >> 172.21.15.31:0/66688245 conn(0x7efde40795f0 msgr2=0x7efde40ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:46.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.420+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 shutdown_connections 2024-06-02T22:32:46.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:46.420+0000 7efdeba00700 1 -- 172.21.15.31:0/66688245 wait complete. 2024-06-02T22:32:46.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:46 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T22:32:46.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:46 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T22:32:46.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:46 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T22:32:47.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: pgmap v383: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: fsmap cephfs:2 {0=a=up:active,1=g=up:creating} 10 up:standby 2024-06-02T22:32:47.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:47 smithi031 ceph-mon[31767]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-02T22:32:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: pgmap v383: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T22:32:47.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T22:32:47.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T22:32:47.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:47.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: fsmap cephfs:2 {0=a=up:active,1=g=up:creating} 10 up:standby 2024-06-02T22:32:47.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:47 smithi098 ceph-mon[36750]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-02T22:32:47.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: pgmap v383: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/66688245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: fsmap cephfs:1 {0=a=up:active} 11 up:standby 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: fsmap cephfs:2 {0=a=up:active,1=g=up:creating} 10 up:standby 2024-06-02T22:32:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:47 smithi178 ceph-mon[36614]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-02T22:32:47.840 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:48.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:48 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:active 2024-06-02T22:32:48.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:48 smithi031 ceph-mon[31767]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T22:32:48.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:48 smithi031 ceph-mon[31767]: fsmap cephfs:2 {0=a=up:active,1=g=up:active} 10 up:standby 2024-06-02T22:32:48.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:48 smithi031 ceph-mon[31767]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:creating} 9 up:standby 2024-06-02T22:32:48.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:48 smithi031 ceph-mon[31767]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-02T22:32:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:48 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:active 2024-06-02T22:32:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:48 smithi098 ceph-mon[36750]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T22:32:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:48 smithi098 ceph-mon[36750]: fsmap cephfs:2 {0=a=up:active,1=g=up:active} 10 up:standby 2024-06-02T22:32:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:48 smithi098 ceph-mon[36750]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:creating} 9 up:standby 2024-06-02T22:32:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:48 smithi098 ceph-mon[36750]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-02T22:32:48.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:48 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] up:active 2024-06-02T22:32:48.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:48 smithi178 ceph-mon[36614]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T22:32:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:48 smithi178 ceph-mon[36614]: fsmap cephfs:2 {0=a=up:active,1=g=up:active} 10 up:standby 2024-06-02T22:32:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:48 smithi178 ceph-mon[36614]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:creating} 9 up:standby 2024-06-02T22:32:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:48 smithi178 ceph-mon[36614]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-02T22:32:49.598 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-06-02T22:32:49.598 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:active 2024-06-02T22:32:49.598 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T22:32:49.598 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:active} 9 up:standby 2024-06-02T22:32:49.599 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:creating} 8 up:standby 2024-06-02T22:32:49.599 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:49 smithi031 ceph-mon[31767]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-06-02T22:32:49.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-06-02T22:32:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:active 2024-06-02T22:32:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T22:32:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:active} 9 up:standby 2024-06-02T22:32:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:creating} 8 up:standby 2024-06-02T22:32:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:49 smithi098 ceph-mon[36750]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-06-02T22:32:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: pgmap v384: 129 pgs: 129 active+clean; 581 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-06-02T22:32:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] up:active 2024-06-02T22:32:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T22:32:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: fsmap cephfs:3 {0=a=up:active,1=g=up:active,2=b=up:active} 9 up:standby 2024-06-02T22:32:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:creating} 8 up:standby 2024-06-02T22:32:49.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:49 smithi178 ceph-mon[36614]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 -- 172.21.15.31:0/4007468997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 msgr2=0x7fbe88074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 --2- 172.21.15.31:0/4007468997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe88074aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098f0 tx=0x7fbe7c009c00 comp rx=0 tx=0).stop 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 -- 172.21.15.31:0/4007468997 shutdown_connections 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 --2- 172.21.15.31:0/4007468997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe88115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 --2- 172.21.15.31:0/4007468997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe88074aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 --2- 172.21.15.31:0/4007468997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe88113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 -- 172.21.15.31:0/4007468997 >> 172.21.15.31:0/4007468997 conn(0x7fbe880795f0 msgr2=0x7fbe88079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 -- 172.21.15.31:0/4007468997 shutdown_connections 2024-06-02T22:32:50.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.145+0000 7fbe90000700 1 -- 172.21.15.31:0/4007468997 wait complete. 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.146+0000 7fbe90000700 1 Processor -- start 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.146+0000 7fbe90000700 1 -- start start 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe8819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe881a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88118de0 con 0x7fbe880746c0 2024-06-02T22:32:50.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88118c60 con 0x7fbe88113660 2024-06-02T22:32:50.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe90000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbe88118f60 con 0x7fbe88074fe0 2024-06-02T22:32:50.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe8d600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe8d600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59266/0 (socket says 172.21.15.31:59266) 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe8d600700 1 -- 172.21.15.31:0/3430664787 learned_addr learned my addr 172.21.15.31:0/3430664787 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe8cc00700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe8819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.147+0000 7fbe8e000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe881a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 -- 172.21.15.31:0/3430664787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 msgr2=0x7fbe8819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe8819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 -- 172.21.15.31:0/3430664787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 msgr2=0x7fbe881a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe881a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 -- 172.21.15.31:0/3430664787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881a4300 con 0x7fbe880746c0 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8cc00700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe8819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8e000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe881a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe8d600700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c005950 tx=0x7fbe7c00fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:50.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.148+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0051f0 con 0x7fbe880746c0 2024-06-02T22:32:50.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.149+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe7c00b560 con 0x7fbe880746c0 2024-06-02T22:32:50.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.149+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881a4590 con 0x7fbe880746c0 2024-06-02T22:32:50.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.149+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c003a40 con 0x7fbe880746c0 2024-06-02T22:32:50.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.149+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe881abe70 con 0x7fbe880746c0 2024-06-02T22:32:50.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.150+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe88069180 con 0x7fbe880746c0 2024-06-02T22:32:50.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.152+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbe7c00ba80 con 0x7fbe880746c0 2024-06-02T22:32:50.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.154+0000 7fbe86000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 0x7fbe700a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:50.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.154+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fbe7c0d02f0 con 0x7fbe880746c0 2024-06-02T22:32:50.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.154+0000 7fbe8cc00700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 0x7fbe700a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:50.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.155+0000 7fbe8cc00700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 0x7fbe700a5160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe8810ffc0 tx=0x7fbe74009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:50.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.159+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbe7c013030 con 0x7fbe880746c0 2024-06-02T22:32:50.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.441+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fbe881a0650 con 0x7fbe880746c0 2024-06-02T22:32:50.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.458+0000 7fbe86000700 1 -- 172.21.15.31:0/3430664787 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fbe7c021380 con 0x7fbe880746c0 2024-06-02T22:32:50.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.463+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 msgr2=0x7fbe700a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:50.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.463+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 0x7fbe700a5160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbe8810ffc0 tx=0x7fbe74009310 comp rx=0 tx=0).stop 2024-06-02T22:32:50.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.463+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 msgr2=0x7fbe8819f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:50.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.463+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c005950 tx=0x7fbe7c00fb20 comp rx=0 tx=0).stop 2024-06-02T22:32:50.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 shutdown_connections 2024-06-02T22:32:50.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbe700a2ca0 0x7fbe700a5160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbe88113660 0x7fbe881a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe880746c0 0x7fbe8819f2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 --2- 172.21.15.31:0/3430664787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe88074fe0 0x7fbe8819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 >> 172.21.15.31:0/3430664787 conn(0x7fbe880795f0 msgr2=0x7fbe88112500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 shutdown_connections 2024-06-02T22:32:50.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:50.464+0000 7fbe90000700 1 -- 172.21.15.31:0/3430664787 wait complete. 2024-06-02T22:32:50.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:active 2024-06-02T22:32:50.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T22:32:50.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T22:32:50.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: Cluster is now healthy 2024-06-02T22:32:50.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:active} 8 up:standby 2024-06-02T22:32:50.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T22:32:50.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-02T22:32:50.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:50 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:active 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: Cluster is now healthy 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:active} 8 up:standby 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-02T22:32:50.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:50 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] up:active 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: Cluster is now healthy 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: fsmap cephfs:4 {0=a=up:active,1=g=up:active,2=b=up:active,3=i=up:active} 8 up:standby 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-06-02T22:32:50.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:50 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T22:32:51.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-02T22:32:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-mon[31767]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-06-02T22:32:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T22:32:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:active 2024-06-02T22:32:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-mon[31767]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-02T22:32:51.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-mon[31767]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:51 smithi098 ceph-mon[36750]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-06-02T22:32:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:51 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T22:32:51.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:51 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:active 2024-06-02T22:32:51.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:51 smithi098 ceph-mon[36750]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-02T22:32:51.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:51 smithi098 ceph-mon[36750]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:51.784 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:51.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:51 smithi178 ceph-mon[36614]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 5 op/s 2024-06-02T22:32:51.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:51 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3430664787' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T22:32:51.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:51 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] up:active 2024-06-02T22:32:51.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:51 smithi178 ceph-mon[36614]: fsmap cephfs:5 7 up:standby 5 up:active 2024-06-02T22:32:51.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:51 smithi178 ceph-mon[36614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:52.121 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:32:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: 2024-06-02T22:32:51.798+0000 7f4165200700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-06-02T22:32:53.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:53 smithi031 ceph-mon[31767]: pgmap v386: 129 pgs: 129 active+clean; 586 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-02T22:32:53.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:53 smithi178 ceph-mon[36614]: pgmap v386: 129 pgs: 129 active+clean; 586 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-02T22:32:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:53 smithi098 ceph-mon[36750]: pgmap v386: 129 pgs: 129 active+clean; 586 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 -- 172.21.15.31:0/557968684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd01046d0 msgr2=0x7febd0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 --2- 172.21.15.31:0/557968684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd01046d0 0x7febd0104b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febbc009990 tx=0x7febbc009ca0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 -- 172.21.15.31:0/557968684 shutdown_connections 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 --2- 172.21.15.31:0/557968684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd0105090 0x7febd01115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 --2- 172.21.15.31:0/557968684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd010a6d0 0x7febd010aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 --2- 172.21.15.31:0/557968684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd01046d0 0x7febd0104b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 -- 172.21.15.31:0/557968684 >> 172.21.15.31:0/557968684 conn(0x7febd01001c0 msgr2=0x7febd01025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 -- 172.21.15.31:0/557968684 shutdown_connections 2024-06-02T22:32:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.256+0000 7febd5a00700 1 -- 172.21.15.31:0/557968684 wait complete. 2024-06-02T22:32:54.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.257+0000 7febd5a00700 1 Processor -- start 2024-06-02T22:32:54.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.257+0000 7febd5a00700 1 -- start start 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 0x7febd019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 0x7febd019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 0x7febd019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7febd0114a60 con 0x7febd01046d0 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7febd01148e0 con 0x7febd0105090 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febd5a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7febd0114be0 con 0x7febd010a6d0 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febcea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 0x7febd019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febcf400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 0x7febd019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febcf400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 0x7febd019f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45834/0 (socket says 172.21.15.31:45834) 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febcf400700 1 -- 172.21.15.31:0/375982167 learned_addr learned my addr 172.21.15.31:0/375982167 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.258+0000 7febce000700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 0x7febd019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:54.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 -- 172.21.15.31:0/375982167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 msgr2=0x7febd019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:54.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 0x7febd019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 -- 172.21.15.31:0/375982167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 msgr2=0x7febd019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 0x7febd019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 -- 172.21.15.31:0/375982167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd019fe10 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febce000700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 0x7febd019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.259+0000 7febcea00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 0x7febd019ae50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc000e9f0 tx=0x7febc000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.260+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc000cb70 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.260+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febc000ee90 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.260+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd01a0100 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.260+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0003dc0 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.260+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd01a7980 con 0x7febd01046d0 2024-06-02T22:32:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.261+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd0069180 con 0x7febd01046d0 2024-06-02T22:32:54.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.263+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7febc0004000 con 0x7febd01046d0 2024-06-02T22:32:54.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.265+0000 7febc7400700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 0x7febb40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:54.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.265+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7febc00cf450 con 0x7febd01046d0 2024-06-02T22:32:54.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.265+0000 7febce000700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 0x7febb40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:54.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.266+0000 7febce000700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 0x7febb40a5160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febbc0098e0 tx=0x7febbc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:54.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.269+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7febc009bff0 con 0x7febd01046d0 2024-06-02T22:32:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:54.554+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7febd002dca0 con 0x7febd01046d0 2024-06-02T22:32:55.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.483+0000 7febc7400700 1 -- 172.21.15.31:0/375982167 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7febc009b8f0 con 0x7febd01046d0 2024-06-02T22:32:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.492+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 msgr2=0x7febb40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.492+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 0x7febb40a5160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7febbc0098e0 tx=0x7febbc005960 comp rx=0 tx=0).stop 2024-06-02T22:32:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.492+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 msgr2=0x7febd019ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:55.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.492+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 0x7febd019ae50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc000e9f0 tx=0x7febc000ed00 comp rx=0 tx=0).stop 2024-06-02T22:32:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 shutdown_connections 2024-06-02T22:32:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7febb40a2ca0 0x7febb40a5160 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:55.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febd010a6d0 0x7febd019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febd01046d0 0x7febd019ae50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 --2- 172.21.15.31:0/375982167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febd0105090 0x7febd019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.493+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 >> 172.21.15.31:0/375982167 conn(0x7febd01001c0 msgr2=0x7febd01006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.494+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 shutdown_connections 2024-06-02T22:32:55.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:55.494+0000 7febd5a00700 1 -- 172.21.15.31:0/375982167 wait complete. 2024-06-02T22:32:55.773 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:55 smithi031 ceph-mon[31767]: pgmap v387: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-06-02T22:32:55.774 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:55 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T22:32:55.774 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2024-06-02T22:32:55.774 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:55 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-06-02T22:32:55.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:55 smithi178 ceph-mon[36614]: pgmap v387: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-06-02T22:32:55.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:55 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T22:32:55.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2024-06-02T22:32:55.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:55 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-06-02T22:32:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:55 smithi098 ceph-mon[36750]: pgmap v387: 129 pgs: 129 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-06-02T22:32:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:55 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T22:32:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]: dispatch 2024-06-02T22:32:55.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:55 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-06-02T22:32:56.371 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-06-02T22:32:56.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-02T22:32:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:56 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T22:32:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2024-06-02T22:32:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-06-02T22:32:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:56 smithi031 ceph-mon[31767]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:56 smithi031 ceph-mon[31767]: osdmap e98: 12 total, 12 up, 12 in 2024-06-02T22:32:56.815 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:56 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T22:32:56.815 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2024-06-02T22:32:56.815 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-06-02T22:32:56.815 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:56 smithi178 ceph-mon[36614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:56.815 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:56 smithi178 ceph-mon[36614]: osdmap e98: 12 total, 12 up, 12 in 2024-06-02T22:32:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:32:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:56 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/375982167' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T22:32:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [3, 9]}]': finished 2024-06-02T22:32:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-06-02T22:32:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:56 smithi098 ceph-mon[36750]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:32:56.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:56 smithi098 ceph-mon[36750]: osdmap e98: 12 total, 12 up, 12 in 2024-06-02T22:32:57.544 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:57 smithi031 ceph-mon[31767]: pgmap v389: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 KiB/s wr, 23 op/s 2024-06-02T22:32:57.544 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:57 smithi031 ceph-mon[31767]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T22:32:57.544 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:57 smithi031 ceph-mon[31767]: osdmap e99: 12 total, 12 up, 12 in 2024-06-02T22:32:57.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:57 smithi178 ceph-mon[36614]: pgmap v389: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 KiB/s wr, 23 op/s 2024-06-02T22:32:57.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:57 smithi178 ceph-mon[36614]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T22:32:57.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:57 smithi178 ceph-mon[36614]: osdmap e99: 12 total, 12 up, 12 in 2024-06-02T22:32:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:57 smithi098 ceph-mon[36750]: pgmap v389: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.8 KiB/s wr, 23 op/s 2024-06-02T22:32:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:57 smithi098 ceph-mon[36750]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-06-02T22:32:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:57 smithi098 ceph-mon[36750]: osdmap e99: 12 total, 12 up, 12 in 2024-06-02T22:32:59.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 -- 172.21.15.31:0/397575604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594105050 msgr2=0x7ff594111560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:59.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 --2- 172.21.15.31:0/397575604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594105050 0x7ff594111560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00b0a0 tx=0x7ff58c00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 -- 172.21.15.31:0/397575604 shutdown_connections 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 --2- 172.21.15.31:0/397575604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594105050 0x7ff594111560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 --2- 172.21.15.31:0/397575604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff59410a690 0x7ff59410aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 --2- 172.21.15.31:0/397575604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff594104690 0x7ff594104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 -- 172.21.15.31:0/397575604 >> 172.21.15.31:0/397575604 conn(0x7ff5941001a0 msgr2=0x7ff5941025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 -- 172.21.15.31:0/397575604 shutdown_connections 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.275+0000 7ff59b000700 1 -- 172.21.15.31:0/397575604 wait complete. 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.276+0000 7ff59b000700 1 Processor -- start 2024-06-02T22:32:59.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.276+0000 7ff59b000700 1 -- start start 2024-06-02T22:32:59.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:59.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff594105050 0x7ff59419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff59410a690 0x7ff59419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff594114a20 con 0x7ff594104690 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff5941148a0 con 0x7ff59410a690 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff59b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff594114ba0 con 0x7ff594105050 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41734/0 (socket says 172.21.15.31:41734) 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 -- 172.21.15.31:0/3295175693 learned_addr learned my addr 172.21.15.31:0/3295175693 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593400700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff594105050 0x7ff59419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff599000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff59410a690 0x7ff59419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 -- 172.21.15.31:0/3295175693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff594105050 msgr2=0x7ff59419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:59.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff594105050 0x7ff59419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 -- 172.21.15.31:0/3295175693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff59410a690 msgr2=0x7ff59419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff59410a690 0x7ff59419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.277+0000 7ff593e00700 1 -- 172.21.15.31:0/3295175693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59419fdc0 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff593e00700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff58400d980 tx=0x7ff58400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584016070 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff584004d10 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5941a00b0 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584005670 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.278+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5941a7930 con 0x7ff594104690 2024-06-02T22:32:59.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.279+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff594069180 con 0x7ff594104690 2024-06-02T22:32:59.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.281+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff584004750 con 0x7ff594104690 2024-06-02T22:32:59.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.283+0000 7ff590c00700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 0x7ff5780a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:32:59.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.284+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff5840cf1a0 con 0x7ff594104690 2024-06-02T22:32:59.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.284+0000 7ff593400700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 0x7ff5780a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:32:59.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.284+0000 7ff593400700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 0x7ff5780a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff594109c50 tx=0x7ff58000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:32:59.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.288+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff58401f020 con 0x7ff594104690 2024-06-02T22:32:59.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.554+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff594100d90 con 0x7ff5780a2c20 2024-06-02T22:32:59.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.602+0000 7ff590c00700 1 -- 172.21.15.31:0/3295175693 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff594100d90 con 0x7ff5780a2c20 2024-06-02T22:32:59.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 msgr2=0x7ff5780a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:59.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 0x7ff5780a50e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff594109c50 tx=0x7ff58000b410 comp rx=0 tx=0).stop 2024-06-02T22:32:59.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 msgr2=0x7ff59419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff58400d980 tx=0x7ff58400dc90 comp rx=0 tx=0).stop 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 shutdown_connections 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff5780a2c20 0x7ff5780a50e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff59410a690 0x7ff59419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff594104690 0x7ff59419adb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 --2- 172.21.15.31:0/3295175693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff594105050 0x7ff59419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 >> 172.21.15.31:0/3295175693 conn(0x7ff5941001a0 msgr2=0x7ff594100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 shutdown_connections 2024-06-02T22:32:59.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:32:59.605+0000 7ff59b000700 1 -- 172.21.15.31:0/3295175693 wait complete. 2024-06-02T22:32:59.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:32:59 smithi178 ceph-mon[36614]: pgmap v391: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.1 KiB/s wr, 22 op/s 2024-06-02T22:32:59.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-mon[31767]: pgmap v391: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.1 KiB/s wr, 22 op/s 2024-06-02T22:32:59.872 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:32:59.566+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:32:59.872 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:32:59.566+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:32:59.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:32:59.566+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:32:59.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:32:59.566+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:32:59.873 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:32:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:32:59.566+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:32:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:32:59 smithi098 ceph-mon[36750]: pgmap v391: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.1 KiB/s wr, 22 op/s 2024-06-02T22:33:00.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-02T22:33:00.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:00 smithi178 ceph-mon[36614]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:00 smithi031 ceph-mon[31767]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:00.933 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:00.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:00 smithi098 ceph-mon[36750]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:01.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:01 smithi031 ceph-mon[31767]: pgmap v392: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 14 op/s 2024-06-02T22:33:01.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:01 smithi031 ceph-mon[31767]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-06-02T22:33:01.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:01 smithi178 ceph-mon[36614]: pgmap v392: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 14 op/s 2024-06-02T22:33:01.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:01 smithi178 ceph-mon[36614]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-06-02T22:33:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:01 smithi098 ceph-mon[36750]: pgmap v392: 129 pgs: 1 peering, 128 active+clean; 587 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 14 op/s 2024-06-02T22:33:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:01 smithi098 ceph-mon[36750]: mgrmap e17: x(active, since 10m), standbys: z, y 2024-06-02T22:33:02.807 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:02 smithi031 ceph-mon[31767]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T22:33:02.807 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:02 smithi031 ceph-mon[31767]: Cluster is now healthy 2024-06-02T22:33:02.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:02 smithi098 ceph-mon[36750]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T22:33:02.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:02 smithi098 ceph-mon[36750]: Cluster is now healthy 2024-06-02T22:33:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:02 smithi178 ceph-mon[36614]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-06-02T22:33:03.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:02 smithi178 ceph-mon[36614]: Cluster is now healthy 2024-06-02T22:33:03.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 -- 172.21.15.31:0/1425195559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543410ed80 msgr2=0x7f5434111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:03.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 --2- 172.21.15.31:0/1425195559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543410ed80 0x7f5434111170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f542c009f90 tx=0x7f542c00b330 comp rx=0 tx=0).stop 2024-06-02T22:33:03.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 -- 172.21.15.31:0/1425195559 shutdown_connections 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 --2- 172.21.15.31:0/1425195559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f543410ed80 0x7f5434111170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 --2- 172.21.15.31:0/1425195559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f5434074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 --2- 172.21.15.31:0/1425195559 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5434075350 0x7f543410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 -- 172.21.15.31:0/1425195559 >> 172.21.15.31:0/1425195559 conn(0x7f54340fde80 msgr2=0x7f54341002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 -- 172.21.15.31:0/1425195559 shutdown_connections 2024-06-02T22:33:03.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.361+0000 7f543a400700 1 -- 172.21.15.31:0/1425195559 wait complete. 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.362+0000 7f543a400700 1 Processor -- start 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 -- start start 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f543419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 0x7f543419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 0x7f543419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:03.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f54341149a0 con 0x7f5434074a30 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5434114820 con 0x7f543410ed80 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.363+0000 7f543a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5434114b20 con 0x7f5434075350 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f543419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5433e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 0x7f543419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f543419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56786/0 (socket says 172.21.15.31:56786) 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439000700 1 -- 172.21.15.31:0/2705589379 learned_addr learned my addr 172.21.15.31:0/2705589379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 0x7f543419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 -- 172.21.15.31:0/2705589379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 msgr2=0x7f543419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 0x7f543419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 -- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 msgr2=0x7f543419ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f543419ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 -- 172.21.15.31:0/2705589379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543419fe20 con 0x7f543410ed80 2024-06-02T22:33:03.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5433e00700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 0x7f543419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.364+0000 7f5439a00700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 0x7f543419f6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f543406ab80 tx=0x7f542c004f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:03.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.365+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c021070 con 0x7f543410ed80 2024-06-02T22:33:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.365+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f542c006020 con 0x7f543410ed80 2024-06-02T22:33:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.365+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54341a00b0 con 0x7f543410ed80 2024-06-02T22:33:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.365+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c005040 con 0x7f543410ed80 2024-06-02T22:33:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.365+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54341a7990 con 0x7f543410ed80 2024-06-02T22:33:03.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.366+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5434069180 con 0x7f543410ed80 2024-06-02T22:33:03.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.368+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f542c024070 con 0x7f543410ed80 2024-06-02T22:33:03.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.369+0000 7f5431600700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 0x7f541c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:03.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.370+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f542c00f020 con 0x7f543410ed80 2024-06-02T22:33:03.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.370+0000 7f5439000700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 0x7f541c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:03.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.371+0000 7f5439000700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 0x7f541c0a5170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5428005950 tx=0x7f5428009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:03.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.374+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f542c02b020 con 0x7f543410ed80 2024-06-02T22:33:03.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.645+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f543419c170 con 0x7f541c0a2cb0 2024-06-02T22:33:03.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.701+0000 7f5431600700 1 -- 172.21.15.31:0/2705589379 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f543419c170 con 0x7f541c0a2cb0 2024-06-02T22:33:03.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 msgr2=0x7f541c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:03.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 0x7f541c0a5170 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5428005950 tx=0x7f5428009310 comp rx=0 tx=0).stop 2024-06-02T22:33:03.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 msgr2=0x7f543419f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:03.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 0x7f543419f6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f543406ab80 tx=0x7f542c004f00 comp rx=0 tx=0).stop 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 shutdown_connections 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f541c0a2cb0 0x7f541c0a5170 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f543410ed80 0x7f543419f6e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5434074a30 0x7f543419ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 --2- 172.21.15.31:0/2705589379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5434075350 0x7f543419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 >> 172.21.15.31:0/2705589379 conn(0x7f54340fde80 msgr2=0x7f54340feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 shutdown_connections 2024-06-02T22:33:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:03.705+0000 7f543a400700 1 -- 172.21.15.31:0/2705589379 wait complete. 2024-06-02T22:33:03.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:03 smithi031 ceph-mon[31767]: pgmap v393: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-06-02T22:33:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:03 smithi098 ceph-mon[36750]: pgmap v393: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-06-02T22:33:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:03 smithi178 ceph-mon[36614]: pgmap v393: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 14 op/s 2024-06-02T22:33:04.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-02T22:33:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:04 smithi031 ceph-mon[31767]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:04.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:04 smithi098 ceph-mon[36750]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:05.034 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:05.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:04 smithi178 ceph-mon[36614]: from='client.24683 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:05 smithi031 ceph-mon[31767]: pgmap v394: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-02T22:33:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:05 smithi098 ceph-mon[36750]: pgmap v394: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-02T22:33:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:05 smithi178 ceph-mon[36614]: pgmap v394: 129 pgs: 129 active+clean; 594 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 -- 172.21.15.31:0/3810442228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c1045c0 msgr2=0x7f4f6c104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 --2- 172.21.15.31:0/3810442228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c104a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009990 tx=0x7f4f58009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 -- 172.21.15.31:0/3810442228 shutdown_connections 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 --2- 172.21.15.31:0/3810442228 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c104f80 0x7f4f6c111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 --2- 172.21.15.31:0/3810442228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c10a650 0x7f4f6c10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 --2- 172.21.15.31:0/3810442228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c104a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 -- 172.21.15.31:0/3810442228 >> 172.21.15.31:0/3810442228 conn(0x7f4f6c1000b0 msgr2=0x7f4f6c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 -- 172.21.15.31:0/3810442228 shutdown_connections 2024-06-02T22:33:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.477+0000 7f4f71400700 1 -- 172.21.15.31:0/3810442228 wait complete. 2024-06-02T22:33:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.479+0000 7f4f71400700 1 Processor -- start 2024-06-02T22:33:07.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.479+0000 7f4f71400700 1 -- start start 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c104f80 0x7f4f6c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c10a650 0x7f4f6c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c114960 con 0x7f4f6c10a650 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c1147e0 con 0x7f4f6c1045c0 2024-06-02T22:33:07.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f71400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c114ae0 con 0x7f4f6c104f80 2024-06-02T22:33:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:54756/0 (socket says 172.21.15.31:54756) 2024-06-02T22:33:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 -- 172.21.15.31:0/2371386757 learned_addr learned my addr 172.21.15.31:0/2371386757 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:07.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f70a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c10a650 0x7f4f6c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6b400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c104f80 0x7f4f6c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 -- 172.21.15.31:0/2371386757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c104f80 msgr2=0x7f4f6c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c104f80 0x7f4f6c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 -- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c10a650 msgr2=0x7f4f6c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c10a650 0x7f4f6c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.480+0000 7f4f6be00700 1 -- 172.21.15.31:0/2371386757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c19fd30 con 0x7f4f6c1045c0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f6be00700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e950 tx=0x7f4f5c00ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c004230 con 0x7f4f6c1045c0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c1a0020 con 0x7f4f6c1045c0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f5c0043d0 con 0x7f4f6c1045c0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c003dd0 con 0x7f4f6c1045c0 2024-06-02T22:33:07.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.481+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c1a78a0 con 0x7f4f6c1045c0 2024-06-02T22:33:07.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.483+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c069180 con 0x7f4f6c1045c0 2024-06-02T22:33:07.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.485+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4f5c044b60 con 0x7f4f6c1045c0 2024-06-02T22:33:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.486+0000 7f4f68c00700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 0x7f4f500a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.486+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4f5c0cf780 con 0x7f4f6c1045c0 2024-06-02T22:33:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.486+0000 7f4f6b400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 0x7f4f500a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:07.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.487+0000 7f4f6b400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 0x7f4f500a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c109cb0 tx=0x7f4f5800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:07.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.488+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4f5c09c190 con 0x7f4f6c1045c0 2024-06-02T22:33:07.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.760+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4f6c0628d0 con 0x7f4f500a2d30 2024-06-02T22:33:07.762 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:07 smithi031 ceph-mon[31767]: pgmap v395: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-02T22:33:07.769 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/qa/sv_0/38a66518-73ad-4f4a-8b8e-f3859629198c 2024-06-02T22:33:07.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.769+0000 7f4f68c00700 1 -- 172.21.15.31:0/2371386757 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4f6c0628d0 con 0x7f4f500a2d30 2024-06-02T22:33:07.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 msgr2=0x7f4f500a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:07.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 0x7f4f500a51f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c109cb0 tx=0x7f4f5800b260 comp rx=0 tx=0).stop 2024-06-02T22:33:07.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 msgr2=0x7f4f6c19ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:07.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e950 tx=0x7f4f5c00ec60 comp rx=0 tx=0).stop 2024-06-02T22:33:07.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 shutdown_connections 2024-06-02T22:33:07.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f500a2d30 0x7f4f500a51f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f6c10a650 0x7f4f6c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f6c1045c0 0x7f4f6c19ad70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 --2- 172.21.15.31:0/2371386757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c104f80 0x7f4f6c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:07.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 >> 172.21.15.31:0/2371386757 conn(0x7f4f6c1000b0 msgr2=0x7f4f6c101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:07.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 shutdown_connections 2024-06-02T22:33:07.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:07.772+0000 7f4f71400700 1 -- 172.21.15.31:0/2371386757 wait complete. 2024-06-02T22:33:07.864 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:07 smithi178 ceph-mon[36614]: pgmap v395: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-02T22:33:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:07 smithi098 ceph-mon[36750]: pgmap v395: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-06-02T22:33:08.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-02T22:33:08.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:08 smithi031 ceph-mon[31767]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:08.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:08 smithi098 ceph-mon[36750]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:09.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:08 smithi178 ceph-mon[36614]: from='client.24689 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:09.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:09 smithi031 ceph-mon[31767]: pgmap v396: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-02T22:33:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:09 smithi098 ceph-mon[36750]: pgmap v396: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-02T22:33:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:09 smithi178 ceph-mon[36614]: pgmap v396: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-06-02T22:33:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 -- 172.21.15.31:0/1342054751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc94104690 msgr2=0x7fdc94104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1342054751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc94104690 0x7fdc94104b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009990 tx=0x7fdc80009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 -- 172.21.15.31:0/1342054751 shutdown_connections 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1342054751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94105050 0x7fdc94111560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1342054751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc9410a690 0x7fdc9410aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1342054751 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc94104690 0x7fdc94104b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.547+0000 7fdc9c000700 1 -- 172.21.15.31:0/1342054751 >> 172.21.15.31:0/1342054751 conn(0x7fdc941001a0 msgr2=0x7fdc941025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.548+0000 7fdc9c000700 1 -- 172.21.15.31:0/1342054751 shutdown_connections 2024-06-02T22:33:11.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.548+0000 7fdc9c000700 1 -- 172.21.15.31:0/1342054751 wait complete. 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.549+0000 7fdc9c000700 1 Processor -- start 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.549+0000 7fdc9c000700 1 -- start start 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.549+0000 7fdc9c000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 0x7fdc9419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.549+0000 7fdc9c000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 0x7fdc9419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9c000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9c000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94114a70 con 0x7fdc94104690 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9c000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc941148f0 con 0x7fdc9410a690 2024-06-02T22:33:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9c000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94114bf0 con 0x7fdc94105050 2024-06-02T22:33:11.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc99600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 0x7fdc9419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:11.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:11.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:37350/0 (socket says 172.21.15.31:37350) 2024-06-02T22:33:11.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc98c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 0x7fdc9419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 -- 172.21.15.31:0/1668862739 learned_addr learned my addr 172.21.15.31:0/1668862739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 -- 172.21.15.31:0/1668862739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 msgr2=0x7fdc9419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 0x7fdc9419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 -- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 msgr2=0x7fdc9419ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 0x7fdc9419ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc9a000700 1 -- 172.21.15.31:0/1668862739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9419fe20 con 0x7fdc9410a690 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc98c00700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 0x7fdc9419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.550+0000 7fdc99600700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 0x7fdc9419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc9a000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00ef30 tx=0x7fdc8c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0092e0 con 0x7fdc9410a690 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc8c004bb0 con 0x7fdc9410a690 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c004280 con 0x7fdc9410a690 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc941a00b0 con 0x7fdc9410a690 2024-06-02T22:33:11.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.551+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc941a7990 con 0x7fdc9410a690 2024-06-02T22:33:11.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.552+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc94069180 con 0x7fdc9410a690 2024-06-02T22:33:11.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.555+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdc8c01b030 con 0x7fdc9410a690 2024-06-02T22:33:11.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.556+0000 7fdc92000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 0x7fdc7c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.556+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdc8c0cf3f0 con 0x7fdc9410a690 2024-06-02T22:33:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.556+0000 7fdc99600700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 0x7fdc7c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.557+0000 7fdc99600700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 0x7fdc7c0a51f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009fd0 tx=0x7fdc88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:11.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.558+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc8c022020 con 0x7fdc9410a690 2024-06-02T22:33:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.832+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdc940628d0 con 0x7fdc7c0a2d30 2024-06-02T22:33:11.833 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:11 smithi031 ceph-mon[31767]: pgmap v397: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-06-02T22:33:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.883+0000 7fdc92000700 1 -- 172.21.15.31:0/1668862739 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdc940628d0 con 0x7fdc7c0a2d30 2024-06-02T22:33:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 msgr2=0x7fdc7c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 0x7fdc7c0a51f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009fd0 tx=0x7fdc88009260 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 msgr2=0x7fdc9419f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00ef30 tx=0x7fdc8c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 shutdown_connections 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc7c0a2d30 0x7fdc7c0a51f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc9410a690 0x7fdc9419f6e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc94104690 0x7fdc9419ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 --2- 172.21.15.31:0/1668862739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc94105050 0x7fdc9419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 >> 172.21.15.31:0/1668862739 conn(0x7fdc941001a0 msgr2=0x7fdc94100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 shutdown_connections 2024-06-02T22:33:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:11.887+0000 7fdc9c000700 1 -- 172.21.15.31:0/1668862739 wait complete. 2024-06-02T22:33:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:11 smithi098 ceph-mon[36750]: pgmap v397: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-06-02T22:33:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:11 smithi178 ceph-mon[36614]: pgmap v397: 129 pgs: 129 active+clean; 608 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-06-02T22:33:12.762 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-02T22:33:12.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:12 smithi031 ceph-mon[31767]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:12.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:12 smithi098 ceph-mon[36750]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:13.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:12 smithi178 ceph-mon[36614]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:13.659 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:13 smithi031 ceph-mon[31767]: pgmap v398: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-06-02T22:33:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:13 smithi098 ceph-mon[36750]: pgmap v398: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-06-02T22:33:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:13 smithi178 ceph-mon[36614]: pgmap v398: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 13 op/s 2024-06-02T22:33:14.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:14 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:33:14.963 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:14 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:33:15.031 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:14 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:33:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.637+0000 7f095d000700 1 -- 172.21.15.31:0/4262348762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0958104f80 msgr2=0x7f0958111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.637+0000 7f095d000700 1 --2- 172.21.15.31:0/4262348762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0958104f80 0x7f0958111490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f095000b0a0 tx=0x7f095000b3b0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 -- 172.21.15.31:0/4262348762 shutdown_connections 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 --2- 172.21.15.31:0/4262348762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0958104f80 0x7f0958111490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 --2- 172.21.15.31:0/4262348762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f095810a650 0x7f095810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 --2- 172.21.15.31:0/4262348762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09581045c0 0x7f0958104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 -- 172.21.15.31:0/4262348762 >> 172.21.15.31:0/4262348762 conn(0x7f09581000b0 msgr2=0x7f09581024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 -- 172.21.15.31:0/4262348762 shutdown_connections 2024-06-02T22:33:15.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.638+0000 7f095d000700 1 -- 172.21.15.31:0/4262348762 wait complete. 2024-06-02T22:33:15.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.640+0000 7f095d000700 1 Processor -- start 2024-06-02T22:33:15.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.641+0000 7f095d000700 1 -- start start 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 0x7f095819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f095810a650 0x7f095819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f09581149a0 con 0x7f09581045c0 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0958114820 con 0x7f095810a650 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f095d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0958114b20 con 0x7f0958104f80 2024-06-02T22:33:15.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f0956a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:15.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f0956a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:47010/0 (socket says 172.21.15.31:47010) 2024-06-02T22:33:15.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f0956a00700 1 -- 172.21.15.31:0/611026035 learned_addr learned my addr 172.21.15.31:0/611026035 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:15.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f0957400700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 0x7f095819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:15.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.642+0000 7f0957e00700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f095810a650 0x7f095819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 -- 172.21.15.31:0/611026035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f095810a650 msgr2=0x7f095819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f095810a650 0x7f095819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 -- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 msgr2=0x7f095819ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 0x7f095819ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 -- 172.21.15.31:0/611026035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095819fd20 con 0x7f0958104f80 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0957400700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 0x7f095819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.643+0000 7f0956a00700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f094400b530 tx=0x7f094400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.644+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944015020 con 0x7f0958104f80 2024-06-02T22:33:15.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.644+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0944011d10 con 0x7f0958104f80 2024-06-02T22:33:15.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.644+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094400f2e0 con 0x7f0958104f80 2024-06-02T22:33:15.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.644+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09581a0010 con 0x7f0958104f80 2024-06-02T22:33:15.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.644+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09581a7890 con 0x7f0958104f80 2024-06-02T22:33:15.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.645+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0958069180 con 0x7f0958104f80 2024-06-02T22:33:15.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.650+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0944018020 con 0x7f0958104f80 2024-06-02T22:33:15.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.652+0000 7f094fe00700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 0x7f093c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:15.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.652+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f09440ceba0 con 0x7f0958104f80 2024-06-02T22:33:15.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.652+0000 7f0957400700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 0x7f093c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:15.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.653+0000 7f0957400700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 0x7f093c0a51f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0958105700 tx=0x7f0948009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:15.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.657+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f094401f020 con 0x7f0958104f80 2024-06-02T22:33:15.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.962+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0958101d60 con 0x7f093c0a2d30 2024-06-02T22:33:15.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.969+0000 7f094fe00700 1 -- 172.21.15.31:0/611026035 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0958101d60 con 0x7f093c0a2d30 2024-06-02T22:33:15.969 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/qa/sv_1/b0cabd1e-a4c8-49e8-8144-5366b656c495 2024-06-02T22:33:15.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 msgr2=0x7f093c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:15.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 0x7f093c0a51f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0958105700 tx=0x7f0948009260 comp rx=0 tx=0).stop 2024-06-02T22:33:15.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 msgr2=0x7f095819b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f094400b530 tx=0x7f094400b840 comp rx=0 tx=0).stop 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 shutdown_connections 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f093c0a2d30 0x7f093c0a51f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f095810a650 0x7f095819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f09581045c0 0x7f095819ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 --2- 172.21.15.31:0/611026035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0958104f80 0x7f095819b250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 >> 172.21.15.31:0/611026035 conn(0x7f09581000b0 msgr2=0x7f0958101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 shutdown_connections 2024-06-02T22:33:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:15.973+0000 7f095d000700 1 -- 172.21.15.31:0/611026035 wait complete. 2024-06-02T22:33:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: pgmap v399: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-06-02T22:33:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:15 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: pgmap v399: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-06-02T22:33:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:15 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: pgmap v399: 129 pgs: 129 active+clean; 614 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-06-02T22:33:16.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:15 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:16.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:33:17.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:16 smithi031 ceph-mon[31767]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:17.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:16 smithi098 ceph-mon[36750]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:17.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:16 smithi178 ceph-mon[36614]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:33:17.770 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:18.193 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:17 smithi031 ceph-mon[31767]: pgmap v400: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-06-02T22:33:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:17 smithi178 ceph-mon[36614]: pgmap v400: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-06-02T22:33:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:17 smithi098 ceph-mon[36750]: pgmap v400: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 13 op/s 2024-06-02T22:33:20.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.064+0000 7f4f88a00700 1 -- 172.21.15.31:0/3684952421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f840746c0 msgr2=0x7f4f84074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.064+0000 7f4f88a00700 1 --2- 172.21.15.31:0/3684952421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f840746c0 0x7f4f84074aa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009990 tx=0x7f4f74009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 -- 172.21.15.31:0/3684952421 shutdown_connections 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 --2- 172.21.15.31:0/3684952421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f84113690 0x7f4f84115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 --2- 172.21.15.31:0/3684952421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f840746c0 0x7f4f84074aa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 --2- 172.21.15.31:0/3684952421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f84113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 -- 172.21.15.31:0/3684952421 >> 172.21.15.31:0/3684952421 conn(0x7f4f84079640 msgr2=0x7f4f84079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 -- 172.21.15.31:0/3684952421 shutdown_connections 2024-06-02T22:33:20.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.065+0000 7f4f88a00700 1 -- 172.21.15.31:0/3684952421 wait complete. 2024-06-02T22:33:20.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.066+0000 7f4f88a00700 1 Processor -- start 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.066+0000 7f4f88a00700 1 -- start start 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f8419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f84113690 0x7f4f841a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84118eb0 con 0x7f4f840746c0 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84118d30 con 0x7f4f84074fe0 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f88a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84119030 con 0x7f4f84113690 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f81e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f81e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36224/0 (socket says 172.21.15.31:36224) 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f81e00700 1 -- 172.21.15.31:0/67461449 learned_addr learned my addr 172.21.15.31:0/67461449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f81400700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f8419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:20.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.067+0000 7f4f82800700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f84113690 0x7f4f841a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 -- 172.21.15.31:0/67461449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f84113690 msgr2=0x7f4f841a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f84113690 0x7f4f841a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 -- 172.21.15.31:0/67461449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 msgr2=0x7f4f8419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f8419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 -- 172.21.15.31:0/67461449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f841a4330 con 0x7f4f840746c0 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81400700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f8419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f81e00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f74005910 tx=0x7f4f7400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:20.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74027070 con 0x7f4f840746c0 2024-06-02T22:33:20.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f74004650 con 0x7f4f840746c0 2024-06-02T22:33:20.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.068+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f841a45c0 con 0x7f4f840746c0 2024-06-02T22:33:20.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.069+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400f460 con 0x7f4f840746c0 2024-06-02T22:33:20.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.069+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f841abea0 con 0x7f4f840746c0 2024-06-02T22:33:20.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.070+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64005330 con 0x7f4f840746c0 2024-06-02T22:33:20.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.072+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4f7402a070 con 0x7f4f840746c0 2024-06-02T22:33:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.074+0000 7f4f7aa00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 0x7f4f680a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.074+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4f740d03d0 con 0x7f4f840746c0 2024-06-02T22:33:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.075+0000 7f4f81400700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 0x7f4f680a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:20.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.076+0000 7f4f81400700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 0x7f4f680a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f84112a60 tx=0x7f4f70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:20.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.081+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4f7405e850 con 0x7f4f840746c0 2024-06-02T22:33:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:19 smithi178 ceph-mon[36614]: pgmap v401: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:20.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:19 smithi031 ceph-mon[31767]: pgmap v401: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:20.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.403+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f640058f0 con 0x7f4f840746c0 2024-06-02T22:33:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.404+0000 7f4f7aa00700 1 -- 172.21.15.31:0/67461449 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f4f74013070 con 0x7f4f840746c0 2024-06-02T22:33:20.404 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:20.404 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:33:20.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 msgr2=0x7f4f680a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 0x7f4f680a5170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f84112a60 tx=0x7f4f70009260 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 msgr2=0x7f4f8419f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4f74005910 tx=0x7f4f7400bab0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 shutdown_connections 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f680a2cb0 0x7f4f680a5170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f84113690 0x7f4f841a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f840746c0 0x7f4f8419f320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 --2- 172.21.15.31:0/67461449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f84074fe0 0x7f4f8419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 >> 172.21.15.31:0/67461449 conn(0x7f4f84079640 msgr2=0x7f4f8410f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 shutdown_connections 2024-06-02T22:33:20.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:20.407+0000 7f4f88a00700 1 -- 172.21.15.31:0/67461449 wait complete. 2024-06-02T22:33:20.409 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:33:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:19 smithi098 ceph-mon[36750]: pgmap v401: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:21.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:33:21.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:21 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:21 smithi178 ceph-mon[36614]: pgmap v402: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-06-02T22:33:21.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:21 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/67461449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:33:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:21 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:21 smithi031 ceph-mon[31767]: pgmap v402: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-06-02T22:33:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:21 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/67461449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:33:21.686 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:21 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:21 smithi098 ceph-mon[36750]: pgmap v402: 129 pgs: 129 active+clean; 631 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-06-02T22:33:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:21 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/67461449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:33:22.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:33:22.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:33:22.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:33:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:33:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:33:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:33:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:33:23.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:23 smithi031 ceph-mon[31767]: pgmap v403: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-02T22:33:23.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:23 smithi178 ceph-mon[36614]: pgmap v403: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-02T22:33:23.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:23 smithi098 ceph-mon[36750]: pgmap v403: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 KiB/s wr, 13 op/s 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 -- 172.21.15.31:0/1889195321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 msgr2=0x7f8194104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 --2- 172.21.15.31:0/1889195321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f8194104b00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f81800098f0 tx=0x7f8180009c00 comp rx=0 tx=0).stop 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 -- 172.21.15.31:0/1889195321 shutdown_connections 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 --2- 172.21.15.31:0/1889195321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f8194111550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 --2- 172.21.15.31:0/1889195321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 0x7f819410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 --2- 172.21.15.31:0/1889195321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f8194104b00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 -- 172.21.15.31:0/1889195321 >> 172.21.15.31:0/1889195321 conn(0x7f8194100150 msgr2=0x7f8194102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 -- 172.21.15.31:0/1889195321 shutdown_connections 2024-06-02T22:33:24.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.037+0000 7f8199200700 1 -- 172.21.15.31:0/1889195321 wait complete. 2024-06-02T22:33:24.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.038+0000 7f8199200700 1 Processor -- start 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 -- start start 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f819419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 0x7f819419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8194114a00 con 0x7f819410a680 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8194114880 con 0x7f8194104680 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8199200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8194114b80 con 0x7f8194105040 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8191400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8191e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f819419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8191400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59340/0 (socket says 172.21.15.31:59340) 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8191400700 1 -- 172.21.15.31:0/1411972649 learned_addr learned my addr 172.21.15.31:0/1411972649 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:24.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8191e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f819419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60880/0 (socket says 172.21.15.31:60880) 2024-06-02T22:33:24.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.039+0000 7f8192800700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 0x7f819419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:24.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 -- 172.21.15.31:0/1411972649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 msgr2=0x7f819419ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f819419ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 -- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 msgr2=0x7f819419f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 0x7f819419f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 -- 172.21.15.31:0/1411972649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819419fe80 con 0x7f8194105040 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.040+0000 7f8191400700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8180005950 tx=0x7f818000fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.041+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180005140 con 0x7f8194105040 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.041+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f818000b560 con 0x7f8194105040 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.041+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81941a0110 con 0x7f8194105040 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.041+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180003ae0 con 0x7f8194105040 2024-06-02T22:33:24.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.041+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81941a79f0 con 0x7f8194105040 2024-06-02T22:33:24.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.042+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8194105dc0 con 0x7f8194105040 2024-06-02T22:33:24.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.044+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f818000ba80 con 0x7f8194105040 2024-06-02T22:33:24.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.046+0000 7f818aa00700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 0x7f81780a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:24.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.046+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f81800d06a0 con 0x7f8194105040 2024-06-02T22:33:24.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.046+0000 7f8191e00700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 0x7f81780a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:24.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.047+0000 7f8191e00700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 0x7f81780a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8184009750 tx=0x7f8184009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:24.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.048+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f818005e850 con 0x7f8194105040 2024-06-02T22:33:24.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.278+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f819402dca0 con 0x7f8194105040 2024-06-02T22:33:24.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.280+0000 7f818aa00700 1 -- 172.21.15.31:0/1411972649 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7f8180013030 con 0x7f8194105040 2024-06-02T22:33:24.281 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:24.281 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:33:24.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 msgr2=0x7f81780a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:24.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 0x7f81780a5170 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8184009750 tx=0x7f8184009310 comp rx=0 tx=0).stop 2024-06-02T22:33:24.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 msgr2=0x7f819419b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:24.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8180005950 tx=0x7f818000fb20 comp rx=0 tx=0).stop 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 shutdown_connections 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f81780a2cb0 0x7f81780a5170 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f819410a680 0x7f819419f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8194104680 0x7f819419ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 --2- 172.21.15.31:0/1411972649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8194105040 0x7f819419b3b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 >> 172.21.15.31:0/1411972649 conn(0x7f8194100150 msgr2=0x7f8194100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 shutdown_connections 2024-06-02T22:33:24.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:24.284+0000 7f8199200700 1 -- 172.21.15.31:0/1411972649 wait complete. 2024-06-02T22:33:24.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:24 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1411972649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:24.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:24 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1411972649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:24.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:24 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1411972649' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:25.195 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T22:33:25.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T22:33:25.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:25 smithi031 ceph-mon[31767]: pgmap v404: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:25.662 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:25.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:25 smithi098 ceph-mon[36750]: pgmap v404: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:25 smithi178 ceph-mon[36614]: pgmap v404: 129 pgs: 129 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-02T22:33:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:27 smithi031 ceph-mon[31767]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-06-02T22:33:27.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:27 smithi098 ceph-mon[36750]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-06-02T22:33:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:27 smithi178 ceph-mon[36614]: pgmap v405: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-06-02T22:33:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 -- 172.21.15.31:0/3766534869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94881089d0 msgr2=0x7f9488108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 --2- 172.21.15.31:0/3766534869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94881089d0 0x7f9488108e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9470009990 tx=0x7f9470009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 -- 172.21.15.31:0/3766534869 shutdown_connections 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 --2- 172.21.15.31:0/3766534869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9488109390 0x7f9488115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 --2- 172.21.15.31:0/3766534869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f948810d8a0 0x7f948810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 --2- 172.21.15.31:0/3766534869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94881089d0 0x7f9488108e50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 -- 172.21.15.31:0/3766534869 >> 172.21.15.31:0/3766534869 conn(0x7f9488078220 msgr2=0x7f94881072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 -- 172.21.15.31:0/3766534869 shutdown_connections 2024-06-02T22:33:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.972+0000 7f948d600700 1 -- 172.21.15.31:0/3766534869 wait complete. 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.974+0000 7f948d600700 1 Processor -- start 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.974+0000 7f948d600700 1 -- start start 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 0x7f948819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948810d8a0 0x7f94881a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9488118cd0 con 0x7f948810d8a0 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9488118b50 con 0x7f9488109390 2024-06-02T22:33:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9488118e50 con 0x7f94881089d0 2024-06-02T22:33:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f9487e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f948cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948810d8a0 0x7f94881a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f947f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 0x7f948819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f9487e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59358/0 (socket says 172.21.15.31:59358) 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f947f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 0x7f948819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60892/0 (socket says 172.21.15.31:60892) 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.975+0000 7f9487e00700 1 -- 172.21.15.31:0/4161638041 learned_addr learned my addr 172.21.15.31:0/4161638041 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 -- 172.21.15.31:0/4161638041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 msgr2=0x7f948819f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 0x7f948819f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 -- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948810d8a0 msgr2=0x7f94881a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948810d8a0 0x7f94881a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 -- 172.21.15.31:0/4161638041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94881a41d0 con 0x7f94881089d0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9487e00700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f947800eb30 tx=0x7f947800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947800cbd0 con 0x7f94881089d0 2024-06-02T22:33:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9478004500 con 0x7f94881089d0 2024-06-02T22:33:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94881a44c0 con 0x7f94881089d0 2024-06-02T22:33:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478010430 con 0x7f94881089d0 2024-06-02T22:33:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.976+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94881abd40 con 0x7f94881089d0 2024-06-02T22:33:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.978+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488069180 con 0x7f94881089d0 2024-06-02T22:33:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.979+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9478003f00 con 0x7f94881089d0 2024-06-02T22:33:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.981+0000 7f9485600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 0x7f946c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.981+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f94780cf840 con 0x7f94881089d0 2024-06-02T22:33:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.981+0000 7f947f400700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 0x7f946c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.982+0000 7f947f400700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 0x7f946c0a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f947000b2e0 tx=0x7f9470005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:27.985+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f947809c250 con 0x7f94881089d0 2024-06-02T22:33:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.208+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94881a0520 con 0x7f946c0a2d30 2024-06-02T22:33:28.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.226+0000 7f9485600700 1 -- 172.21.15.31:0/4161638041 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340698 (secure 0 0 0) 0x7f94881a0520 con 0x7f946c0a2d30 2024-06-02T22:33:28.233 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:28.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.233+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 msgr2=0x7f946c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:28.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.233+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 0x7f946c0a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f947000b2e0 tx=0x7f9470005960 comp rx=0 tx=0).stop 2024-06-02T22:33:28.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.233+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 msgr2=0x7f948819f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:28.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.233+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f947800eb30 tx=0x7f947800ee40 comp rx=0 tx=0).stop 2024-06-02T22:33:28.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 shutdown_connections 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f946c0a2d30 0x7f946c0a51f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f948810d8a0 0x7f94881a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94881089d0 0x7f948819f1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 --2- 172.21.15.31:0/4161638041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9488109390 0x7f948819f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 >> 172.21.15.31:0/4161638041 conn(0x7f9488078220 msgr2=0x7f94880788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 shutdown_connections 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:28.234+0000 7f948d600700 1 -- 172.21.15.31:0/4161638041 wait complete. 2024-06-02T22:33:28.238 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-06-02T22:33:29.018 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-06-02T22:33:26.290477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659309,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":515,"num_read_kb":379,"num_write":434,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182382,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379244,"kb_used_data":13444,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562580,"statfs":{"total":1151940427776,"available":1151552081920,"internally_reserved":0,"allocated":13766656,"data_stored":8786589,"data_compressed":496710,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30889,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":97,"num_write":20,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678506+0000","last_change":"2024-06-02T22:31:20.770673+0000","last_active":"2024-06-02T22:32:56.678506+0000","last_peered":"2024-06-02T22:32:56.678506+0000","last_clean":"2024-06-02T22:32:56.678506+0000","last_became_active":"2024-06-02T22:31:20.770000+0000","last_became_peered":"2024-06-02T22:31:20.770000+0000","last_unstale":"2024-06-02T22:32:56.678506+0000","last_undegraded":"2024-06-02T22:32:56.678506+0000","last_fullsized":"2024-06-02T22:32:56.678506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:52.632084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679506+0000","last_change":"2024-06-02T22:31:20.766311+0000","last_active":"2024-06-02T22:32:56.679506+0000","last_peered":"2024-06-02T22:32:56.679506+0000","last_clean":"2024-06-02T22:32:56.679506+0000","last_became_active":"2024-06-02T22:31:20.765960+0000","last_became_peered":"2024-06-02T22:31:20.765960+0000","last_unstale":"2024-06-02T22:32:56.679506+0000","last_undegraded":"2024-06-02T22:32:56.679506+0000","last_fullsized":"2024-06-02T22:32:56.679506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:30.500082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679279+0000","last_change":"2024-06-02T22:31:20.766005+0000","last_active":"2024-06-02T22:32:56.679279+0000","last_peered":"2024-06-02T22:32:56.679279+0000","last_clean":"2024-06-02T22:32:56.679279+0000","last_became_active":"2024-06-02T22:31:20.762135+0000","last_became_peered":"2024-06-02T22:31:20.762135+0000","last_unstale":"2024-06-02T22:32:56.679279+0000","last_undegraded":"2024-06-02T22:32:56.679279+0000","last_fullsized":"2024-06-02T22:32:56.679279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:44:10.201470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677591+0000","last_change":"2024-06-02T22:31:20.754293+0000","last_active":"2024-06-02T22:32:56.677591+0000","last_peered":"2024-06-02T22:32:56.677591+0000","last_clean":"2024-06-02T22:32:56.677591+0000","last_became_active":"2024-06-02T22:31:20.753996+0000","last_became_peered":"2024-06-02T22:31:20.753996+0000","last_unstale":"2024-06-02T22:32:56.677591+0000","last_undegraded":"2024-06-02T22:32:56.677591+0000","last_fullsized":"2024-06-02T22:32:56.677591+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:25.050471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496991+0000","last_change":"2024-06-02T22:31:20.776227+0000","last_active":"2024-06-02T22:32:56.496991+0000","last_peered":"2024-06-02T22:32:56.496991+0000","last_clean":"2024-06-02T22:32:56.496991+0000","last_became_active":"2024-06-02T22:31:20.775922+0000","last_became_peered":"2024-06-02T22:31:20.775922+0000","last_unstale":"2024-06-02T22:32:56.496991+0000","last_undegraded":"2024-06-02T22:32:56.496991+0000","last_fullsized":"2024-06-02T22:32:56.496991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:54:49.228748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684643+0000","last_change":"2024-06-02T22:32:56.684643+0000","last_active":"2024-06-02T22:32:56.684643+0000","last_peered":"2024-06-02T22:32:56.684643+0000","last_clean":"2024-06-02T22:32:56.684643+0000","last_became_active":"2024-06-02T22:32:56.684253+0000","last_became_peered":"2024-06-02T22:32:56.684253+0000","last_unstale":"2024-06-02T22:32:56.684643+0000","last_undegraded":"2024-06-02T22:32:56.684643+0000","last_fullsized":"2024-06-02T22:32:56.684643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:40:57.474007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510721+0000","last_change":"2024-06-02T22:31:20.748702+0000","last_active":"2024-06-02T22:32:56.510721+0000","last_peered":"2024-06-02T22:32:56.510721+0000","last_clean":"2024-06-02T22:32:56.510721+0000","last_became_active":"2024-06-02T22:31:20.748361+0000","last_became_peered":"2024-06-02T22:31:20.748361+0000","last_unstale":"2024-06-02T22:32:56.510721+0000","last_undegraded":"2024-06-02T22:32:56.510721+0000","last_fullsized":"2024-06-02T22:32:56.510721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:00.065043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681534+0000","last_change":"2024-06-02T22:31:20.761647+0000","last_active":"2024-06-02T22:32:56.681534+0000","last_peered":"2024-06-02T22:32:56.681534+0000","last_clean":"2024-06-02T22:32:56.681534+0000","last_became_active":"2024-06-02T22:31:20.758453+0000","last_became_peered":"2024-06-02T22:31:20.758453+0000","last_unstale":"2024-06-02T22:32:56.681534+0000","last_undegraded":"2024-06-02T22:32:56.681534+0000","last_fullsized":"2024-06-02T22:32:56.681534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:32.586129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.638091+0000","last_change":"2024-06-02T22:31:20.753972+0000","last_active":"2024-06-02T22:32:56.638091+0000","last_peered":"2024-06-02T22:32:56.638091+0000","last_clean":"2024-06-02T22:32:56.638091+0000","last_became_active":"2024-06-02T22:31:20.753667+0000","last_became_peered":"2024-06-02T22:31:20.753667+0000","last_unstale":"2024-06-02T22:32:56.638091+0000","last_undegraded":"2024-06-02T22:32:56.638091+0000","last_fullsized":"2024-06-02T22:32:56.638091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:32:59.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501495+0000","last_change":"2024-06-02T22:31:56.475364+0000","last_active":"2024-06-02T22:32:56.501495+0000","last_peered":"2024-06-02T22:32:56.501495+0000","last_clean":"2024-06-02T22:32:56.501495+0000","last_became_active":"2024-06-02T22:31:56.475086+0000","last_became_peered":"2024-06-02T22:31:56.475086+0000","last_unstale":"2024-06-02T22:32:56.501495+0000","last_undegraded":"2024-06-02T22:32:56.501495+0000","last_fullsized":"2024-06-02T22:32:56.501495+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:01:37.348839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511147+0000","last_change":"2024-06-02T22:31:20.748745+0000","last_active":"2024-06-02T22:32:56.511147+0000","last_peered":"2024-06-02T22:32:56.511147+0000","last_clean":"2024-06-02T22:32:56.511147+0000","last_became_active":"2024-06-02T22:31:20.747808+0000","last_became_peered":"2024-06-02T22:31:20.747808+0000","last_unstale":"2024-06-02T22:32:56.511147+0000","last_undegraded":"2024-06-02T22:32:56.511147+0000","last_fullsized":"2024-06-02T22:32:56.511147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:29.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677586+0000","last_change":"2024-06-02T22:31:20.754184+0000","last_active":"2024-06-02T22:32:56.677586+0000","last_peered":"2024-06-02T22:32:56.677586+0000","last_clean":"2024-06-02T22:32:56.677586+0000","last_became_active":"2024-06-02T22:31:20.753691+0000","last_became_peered":"2024-06-02T22:31:20.753691+0000","last_unstale":"2024-06-02T22:32:56.677586+0000","last_undegraded":"2024-06-02T22:32:56.677586+0000","last_fullsized":"2024-06-02T22:32:56.677586+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:43.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684006+0000","last_change":"2024-06-02T22:31:56.478669+0000","last_active":"2024-06-02T22:32:56.684006+0000","last_peered":"2024-06-02T22:32:56.684006+0000","last_clean":"2024-06-02T22:32:56.684006+0000","last_became_active":"2024-06-02T22:31:56.476440+0000","last_became_peered":"2024-06-02T22:31:56.476440+0000","last_unstale":"2024-06-02T22:32:56.684006+0000","last_undegraded":"2024-06-02T22:32:56.684006+0000","last_fullsized":"2024-06-02T22:32:56.684006+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:17:08.753386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678873+0000","last_change":"2024-06-02T22:31:20.756993+0000","last_active":"2024-06-02T22:32:56.678873+0000","last_peered":"2024-06-02T22:32:56.678873+0000","last_clean":"2024-06-02T22:32:56.678873+0000","last_became_active":"2024-06-02T22:31:20.756518+0000","last_became_peered":"2024-06-02T22:31:20.756518+0000","last_unstale":"2024-06-02T22:32:56.678873+0000","last_undegraded":"2024-06-02T22:32:56.678873+0000","last_fullsized":"2024-06-02T22:32:56.678873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:28.743386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678612+0000","last_change":"2024-06-02T22:31:20.760152+0000","last_active":"2024-06-02T22:32:56.678612+0000","last_peered":"2024-06-02T22:32:56.678612+0000","last_clean":"2024-06-02T22:32:56.678612+0000","last_became_active":"2024-06-02T22:31:20.759291+0000","last_became_peered":"2024-06-02T22:31:20.759291+0000","last_unstale":"2024-06-02T22:32:56.678612+0000","last_undegraded":"2024-06-02T22:32:56.678612+0000","last_fullsized":"2024-06-02T22:32:56.678612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:30.465537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637363+0000","last_change":"2024-06-02T22:31:20.766881+0000","last_active":"2024-06-02T22:32:56.637363+0000","last_peered":"2024-06-02T22:32:56.637363+0000","last_clean":"2024-06-02T22:32:56.637363+0000","last_became_active":"2024-06-02T22:31:20.766552+0000","last_became_peered":"2024-06-02T22:31:20.766552+0000","last_unstale":"2024-06-02T22:32:56.637363+0000","last_undegraded":"2024-06-02T22:32:56.637363+0000","last_fullsized":"2024-06-02T22:32:56.637363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:58.133220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678350+0000","last_change":"2024-06-02T22:31:20.770370+0000","last_active":"2024-06-02T22:32:56.678350+0000","last_peered":"2024-06-02T22:32:56.678350+0000","last_clean":"2024-06-02T22:32:56.678350+0000","last_became_active":"2024-06-02T22:31:20.769938+0000","last_became_peered":"2024-06-02T22:31:20.769938+0000","last_unstale":"2024-06-02T22:32:56.678350+0000","last_undegraded":"2024-06-02T22:32:56.678350+0000","last_fullsized":"2024-06-02T22:32:56.678350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:59.835221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507277+0000","last_change":"2024-06-02T22:31:20.762933+0000","last_active":"2024-06-02T22:32:56.507277+0000","last_peered":"2024-06-02T22:32:56.507277+0000","last_clean":"2024-06-02T22:32:56.507277+0000","last_became_active":"2024-06-02T22:31:20.761598+0000","last_became_peered":"2024-06-02T22:31:20.761598+0000","last_unstale":"2024-06-02T22:32:56.507277+0000","last_undegraded":"2024-06-02T22:32:56.507277+0000","last_fullsized":"2024-06-02T22:32:56.507277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:25:45.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677628+0000","last_change":"2024-06-02T22:31:20.758974+0000","last_active":"2024-06-02T22:32:56.677628+0000","last_peered":"2024-06-02T22:32:56.677628+0000","last_clean":"2024-06-02T22:32:56.677628+0000","last_became_active":"2024-06-02T22:31:20.758583+0000","last_became_peered":"2024-06-02T22:31:20.758583+0000","last_unstale":"2024-06-02T22:32:56.677628+0000","last_undegraded":"2024-06-02T22:32:56.677628+0000","last_fullsized":"2024-06-02T22:32:56.677628+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:00.333362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677020+0000","last_change":"2024-06-02T22:31:33.865290+0000","last_active":"2024-06-02T22:32:56.677020+0000","last_peered":"2024-06-02T22:32:56.677020+0000","last_clean":"2024-06-02T22:32:56.677020+0000","last_became_active":"2024-06-02T22:31:33.864721+0000","last_became_peered":"2024-06-02T22:31:33.864721+0000","last_unstale":"2024-06-02T22:32:56.677020+0000","last_undegraded":"2024-06-02T22:32:56.677020+0000","last_fullsized":"2024-06-02T22:32:56.677020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:45.344953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'13","reported_seq":93,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:23.581733+0000","last_change":"2024-06-02T22:31:15.645169+0000","last_active":"2024-06-02T22:33:23.581733+0000","last_peered":"2024-06-02T22:33:23.581733+0000","last_clean":"2024-06-02T22:33:23.581733+0000","last_became_active":"2024-06-02T22:31:15.643956+0000","last_became_peered":"2024-06-02T22:31:15.643956+0000","last_unstale":"2024-06-02T22:33:23.581733+0000","last_undegraded":"2024-06-02T22:33:23.581733+0000","last_fullsized":"2024-06-02T22:33:23.581733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:01.560086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681457+0000","last_change":"2024-06-02T22:31:20.759157+0000","last_active":"2024-06-02T22:32:56.681457+0000","last_peered":"2024-06-02T22:32:56.681457+0000","last_clean":"2024-06-02T22:32:56.681457+0000","last_became_active":"2024-06-02T22:31:20.758718+0000","last_became_peered":"2024-06-02T22:31:20.758718+0000","last_unstale":"2024-06-02T22:32:56.681457+0000","last_undegraded":"2024-06-02T22:32:56.681457+0000","last_fullsized":"2024-06-02T22:32:56.681457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:57.685311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677285+0000","last_change":"2024-06-02T22:31:55.989604+0000","last_active":"2024-06-02T22:32:56.677285+0000","last_peered":"2024-06-02T22:32:56.677285+0000","last_clean":"2024-06-02T22:32:56.677285+0000","last_became_active":"2024-06-02T22:31:55.989177+0000","last_became_peered":"2024-06-02T22:31:55.989177+0000","last_unstale":"2024-06-02T22:32:56.677285+0000","last_undegraded":"2024-06-02T22:32:56.677285+0000","last_fullsized":"2024-06-02T22:32:56.677285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:48:58.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681341+0000","last_change":"2024-06-02T22:31:15.845856+0000","last_active":"2024-06-02T22:32:56.681341+0000","last_peered":"2024-06-02T22:32:56.681341+0000","last_clean":"2024-06-02T22:32:56.681341+0000","last_became_active":"2024-06-02T22:31:15.845025+0000","last_became_peered":"2024-06-02T22:31:15.845025+0000","last_unstale":"2024-06-02T22:32:56.681341+0000","last_undegraded":"2024-06-02T22:32:56.681341+0000","last_fullsized":"2024-06-02T22:32:56.681341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:37.491987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679664+0000","last_change":"2024-06-02T22:31:20.767420+0000","last_active":"2024-06-02T22:32:56.679664+0000","last_peered":"2024-06-02T22:32:56.679664+0000","last_clean":"2024-06-02T22:32:56.679664+0000","last_became_active":"2024-06-02T22:31:20.766768+0000","last_became_peered":"2024-06-02T22:31:20.766768+0000","last_unstale":"2024-06-02T22:32:56.679664+0000","last_undegraded":"2024-06-02T22:32:56.679664+0000","last_fullsized":"2024-06-02T22:32:56.679664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:20.829696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677385+0000","last_change":"2024-06-02T22:31:33.865917+0000","last_active":"2024-06-02T22:32:56.677385+0000","last_peered":"2024-06-02T22:32:56.677385+0000","last_clean":"2024-06-02T22:32:56.677385+0000","last_became_active":"2024-06-02T22:31:33.865466+0000","last_became_peered":"2024-06-02T22:31:33.865466+0000","last_unstale":"2024-06-02T22:32:56.677385+0000","last_undegraded":"2024-06-02T22:32:56.677385+0000","last_fullsized":"2024-06-02T22:32:56.677385+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:37.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'12","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497174+0000","last_change":"2024-06-02T22:31:15.639522+0000","last_active":"2024-06-02T22:32:56.497174+0000","last_peered":"2024-06-02T22:32:56.497174+0000","last_clean":"2024-06-02T22:32:56.497174+0000","last_became_active":"2024-06-02T22:31:15.639029+0000","last_became_peered":"2024-06-02T22:31:15.639029+0000","last_unstale":"2024-06-02T22:32:56.497174+0000","last_undegraded":"2024-06-02T22:32:56.497174+0000","last_fullsized":"2024-06-02T22:32:56.497174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:29.388739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637653+0000","last_change":"2024-06-02T22:31:20.772370+0000","last_active":"2024-06-02T22:32:56.637653+0000","last_peered":"2024-06-02T22:32:56.637653+0000","last_clean":"2024-06-02T22:32:56.637653+0000","last_became_active":"2024-06-02T22:31:20.772041+0000","last_became_peered":"2024-06-02T22:31:20.772041+0000","last_unstale":"2024-06-02T22:32:56.637653+0000","last_undegraded":"2024-06-02T22:32:56.637653+0000","last_fullsized":"2024-06-02T22:32:56.637653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:27.518648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677355+0000","last_change":"2024-06-02T22:31:55.990609+0000","last_active":"2024-06-02T22:32:56.677355+0000","last_peered":"2024-06-02T22:32:56.677355+0000","last_clean":"2024-06-02T22:32:56.677355+0000","last_became_active":"2024-06-02T22:31:55.990075+0000","last_became_peered":"2024-06-02T22:31:55.990075+0000","last_unstale":"2024-06-02T22:32:56.677355+0000","last_undegraded":"2024-06-02T22:32:56.677355+0000","last_fullsized":"2024-06-02T22:32:56.677355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:55:52.836659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497203+0000","last_change":"2024-06-02T22:31:15.636472+0000","last_active":"2024-06-02T22:32:56.497203+0000","last_peered":"2024-06-02T22:32:56.497203+0000","last_clean":"2024-06-02T22:32:56.497203+0000","last_became_active":"2024-06-02T22:31:15.636078+0000","last_became_peered":"2024-06-02T22:31:15.636078+0000","last_unstale":"2024-06-02T22:32:56.497203+0000","last_undegraded":"2024-06-02T22:32:56.497203+0000","last_fullsized":"2024-06-02T22:32:56.497203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:18:35.318873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635374+0000","last_change":"2024-06-02T22:31:55.986887+0000","last_active":"2024-06-02T22:32:56.635374+0000","last_peered":"2024-06-02T22:32:56.635374+0000","last_clean":"2024-06-02T22:32:56.635374+0000","last_became_active":"2024-06-02T22:31:55.986468+0000","last_became_peered":"2024-06-02T22:31:55.986468+0000","last_unstale":"2024-06-02T22:32:56.635374+0000","last_undegraded":"2024-06-02T22:32:56.635374+0000","last_fullsized":"2024-06-02T22:32:56.635374+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:58:27.696250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677443+0000","last_change":"2024-06-02T22:31:33.847193+0000","last_active":"2024-06-02T22:32:56.677443+0000","last_peered":"2024-06-02T22:32:56.677443+0000","last_clean":"2024-06-02T22:32:56.677443+0000","last_became_active":"2024-06-02T22:31:33.845955+0000","last_became_peered":"2024-06-02T22:31:33.845955+0000","last_unstale":"2024-06-02T22:32:56.677443+0000","last_undegraded":"2024-06-02T22:32:56.677443+0000","last_fullsized":"2024-06-02T22:32:56.677443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:43.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'6","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:23.524442+0000","last_change":"2024-06-02T22:31:15.640589+0000","last_active":"2024-06-02T22:33:23.524442+0000","last_peered":"2024-06-02T22:33:23.524442+0000","last_clean":"2024-06-02T22:33:23.524442+0000","last_became_active":"2024-06-02T22:31:15.640216+0000","last_became_peered":"2024-06-02T22:31:15.640216+0000","last_unstale":"2024-06-02T22:33:23.524442+0000","last_undegraded":"2024-06-02T22:33:23.524442+0000","last_fullsized":"2024-06-02T22:33:23.524442+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:40:02.375914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497148+0000","last_change":"2024-06-02T22:31:20.753879+0000","last_active":"2024-06-02T22:32:56.497148+0000","last_peered":"2024-06-02T22:32:56.497148+0000","last_clean":"2024-06-02T22:32:56.497148+0000","last_became_active":"2024-06-02T22:31:20.753528+0000","last_became_peered":"2024-06-02T22:31:20.753528+0000","last_unstale":"2024-06-02T22:32:56.497148+0000","last_undegraded":"2024-06-02T22:32:56.497148+0000","last_fullsized":"2024-06-02T22:32:56.497148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:19.299178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677268+0000","last_change":"2024-06-02T22:31:33.858175+0000","last_active":"2024-06-02T22:32:56.677268+0000","last_peered":"2024-06-02T22:32:56.677268+0000","last_clean":"2024-06-02T22:32:56.677268+0000","last_became_active":"2024-06-02T22:31:33.857712+0000","last_became_peered":"2024-06-02T22:31:33.857712+0000","last_unstale":"2024-06-02T22:32:56.677268+0000","last_undegraded":"2024-06-02T22:32:56.677268+0000","last_fullsized":"2024-06-02T22:32:56.677268+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:30:01.632018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'7","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.500990+0000","last_change":"2024-06-02T22:31:15.639810+0000","last_active":"2024-06-02T22:32:56.500990+0000","last_peered":"2024-06-02T22:32:56.500990+0000","last_clean":"2024-06-02T22:32:56.500990+0000","last_became_active":"2024-06-02T22:31:15.639487+0000","last_became_peered":"2024-06-02T22:31:15.639487+0000","last_unstale":"2024-06-02T22:32:56.500990+0000","last_undegraded":"2024-06-02T22:32:56.500990+0000","last_fullsized":"2024-06-02T22:32:56.500990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:26:48.168636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635226+0000","last_change":"2024-06-02T22:31:20.771988+0000","last_active":"2024-06-02T22:32:56.635226+0000","last_peered":"2024-06-02T22:32:56.635226+0000","last_clean":"2024-06-02T22:32:56.635226+0000","last_became_active":"2024-06-02T22:31:20.771506+0000","last_became_peered":"2024-06-02T22:31:20.771506+0000","last_unstale":"2024-06-02T22:32:56.635226+0000","last_undegraded":"2024-06-02T22:32:56.635226+0000","last_fullsized":"2024-06-02T22:32:56.635226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:51:10.199149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678300+0000","last_change":"2024-06-02T22:31:33.861319+0000","last_active":"2024-06-02T22:32:56.678300+0000","last_peered":"2024-06-02T22:32:56.678300+0000","last_clean":"2024-06-02T22:32:56.678300+0000","last_became_active":"2024-06-02T22:31:33.860834+0000","last_became_peered":"2024-06-02T22:31:33.860834+0000","last_unstale":"2024-06-02T22:32:56.678300+0000","last_undegraded":"2024-06-02T22:32:56.678300+0000","last_fullsized":"2024-06-02T22:32:56.678300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:26.094118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681900+0000","last_change":"2024-06-02T22:31:15.645298+0000","last_active":"2024-06-02T22:32:56.681900+0000","last_peered":"2024-06-02T22:32:56.681900+0000","last_clean":"2024-06-02T22:32:56.681900+0000","last_became_active":"2024-06-02T22:31:15.643278+0000","last_became_peered":"2024-06-02T22:31:15.643278+0000","last_unstale":"2024-06-02T22:32:56.681900+0000","last_undegraded":"2024-06-02T22:32:56.681900+0000","last_fullsized":"2024-06-02T22:32:56.681900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:38:09.548519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681424+0000","last_change":"2024-06-02T22:31:20.769928+0000","last_active":"2024-06-02T22:32:56.681424+0000","last_peered":"2024-06-02T22:32:56.681424+0000","last_clean":"2024-06-02T22:32:56.681424+0000","last_became_active":"2024-06-02T22:31:20.769008+0000","last_became_peered":"2024-06-02T22:31:20.769008+0000","last_unstale":"2024-06-02T22:32:56.681424+0000","last_undegraded":"2024-06-02T22:32:56.681424+0000","last_fullsized":"2024-06-02T22:32:56.681424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:02.808992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679395+0000","last_change":"2024-06-02T22:31:33.869072+0000","last_active":"2024-06-02T22:32:56.679395+0000","last_peered":"2024-06-02T22:32:56.679395+0000","last_clean":"2024-06-02T22:32:56.679395+0000","last_became_active":"2024-06-02T22:31:33.868641+0000","last_became_peered":"2024-06-02T22:31:33.868641+0000","last_unstale":"2024-06-02T22:32:56.679395+0000","last_undegraded":"2024-06-02T22:32:56.679395+0000","last_fullsized":"2024-06-02T22:32:56.679395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:29.227798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634901+0000","last_change":"2024-06-02T22:31:15.637656+0000","last_active":"2024-06-02T22:32:56.634901+0000","last_peered":"2024-06-02T22:32:56.634901+0000","last_clean":"2024-06-02T22:32:56.634901+0000","last_became_active":"2024-06-02T22:31:15.637317+0000","last_became_peered":"2024-06-02T22:31:15.637317+0000","last_unstale":"2024-06-02T22:32:56.634901+0000","last_undegraded":"2024-06-02T22:32:56.634901+0000","last_fullsized":"2024-06-02T22:32:56.634901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:21.307766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.505055+0000","last_change":"2024-06-02T22:31:20.764811+0000","last_active":"2024-06-02T22:32:56.505055+0000","last_peered":"2024-06-02T22:32:56.505055+0000","last_clean":"2024-06-02T22:32:56.505055+0000","last_became_active":"2024-06-02T22:31:20.763605+0000","last_became_peered":"2024-06-02T22:31:20.763605+0000","last_unstale":"2024-06-02T22:32:56.505055+0000","last_undegraded":"2024-06-02T22:32:56.505055+0000","last_fullsized":"2024-06-02T22:32:56.505055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:57:24.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680062+0000","last_change":"2024-06-02T22:31:33.861450+0000","last_active":"2024-06-02T22:32:56.680062+0000","last_peered":"2024-06-02T22:32:56.680062+0000","last_clean":"2024-06-02T22:32:56.680062+0000","last_became_active":"2024-06-02T22:31:33.860933+0000","last_became_peered":"2024-06-02T22:31:33.860933+0000","last_unstale":"2024-06-02T22:32:56.680062+0000","last_undegraded":"2024-06-02T22:32:56.680062+0000","last_fullsized":"2024-06-02T22:32:56.680062+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:26.480320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'4","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:25.526862+0000","last_change":"2024-06-02T22:31:15.644469+0000","last_active":"2024-06-02T22:33:25.526862+0000","last_peered":"2024-06-02T22:33:25.526862+0000","last_clean":"2024-06-02T22:33:25.526862+0000","last_became_active":"2024-06-02T22:31:15.644115+0000","last_became_peered":"2024-06-02T22:31:15.644115+0000","last_unstale":"2024-06-02T22:33:25.526862+0000","last_undegraded":"2024-06-02T22:33:25.526862+0000","last_fullsized":"2024-06-02T22:33:25.526862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:44:49.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.638051+0000","last_change":"2024-06-02T22:31:20.752581+0000","last_active":"2024-06-02T22:32:56.638051+0000","last_peered":"2024-06-02T22:32:56.638051+0000","last_clean":"2024-06-02T22:32:56.638051+0000","last_became_active":"2024-06-02T22:31:20.752102+0000","last_became_peered":"2024-06-02T22:31:20.752102+0000","last_unstale":"2024-06-02T22:32:56.638051+0000","last_undegraded":"2024-06-02T22:32:56.638051+0000","last_fullsized":"2024-06-02T22:32:56.638051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:57.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.504523+0000","last_change":"2024-06-02T22:31:33.860102+0000","last_active":"2024-06-02T22:32:56.504523+0000","last_peered":"2024-06-02T22:32:56.504523+0000","last_clean":"2024-06-02T22:32:56.504523+0000","last_became_active":"2024-06-02T22:31:33.859689+0000","last_became_peered":"2024-06-02T22:31:33.859689+0000","last_unstale":"2024-06-02T22:32:56.504523+0000","last_undegraded":"2024-06-02T22:32:56.504523+0000","last_fullsized":"2024-06-02T22:32:56.504523+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:36.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511202+0000","last_change":"2024-06-02T22:31:15.636548+0000","last_active":"2024-06-02T22:32:56.511202+0000","last_peered":"2024-06-02T22:32:56.511202+0000","last_clean":"2024-06-02T22:32:56.511202+0000","last_became_active":"2024-06-02T22:31:15.636097+0000","last_became_peered":"2024-06-02T22:31:15.636097+0000","last_unstale":"2024-06-02T22:32:56.511202+0000","last_undegraded":"2024-06-02T22:32:56.511202+0000","last_fullsized":"2024-06-02T22:32:56.511202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:26:04.280465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679756+0000","last_change":"2024-06-02T22:31:20.760290+0000","last_active":"2024-06-02T22:32:56.679756+0000","last_peered":"2024-06-02T22:32:56.679756+0000","last_clean":"2024-06-02T22:32:56.679756+0000","last_became_active":"2024-06-02T22:31:20.759678+0000","last_became_peered":"2024-06-02T22:31:20.759678+0000","last_unstale":"2024-06-02T22:32:56.679756+0000","last_undegraded":"2024-06-02T22:32:56.679756+0000","last_fullsized":"2024-06-02T22:32:56.679756+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:46.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677580+0000","last_change":"2024-06-02T22:31:33.865919+0000","last_active":"2024-06-02T22:32:56.677580+0000","last_peered":"2024-06-02T22:32:56.677580+0000","last_clean":"2024-06-02T22:32:56.677580+0000","last_became_active":"2024-06-02T22:31:33.865396+0000","last_became_peered":"2024-06-02T22:31:33.865396+0000","last_unstale":"2024-06-02T22:32:56.677580+0000","last_undegraded":"2024-06-02T22:32:56.677580+0000","last_fullsized":"2024-06-02T22:32:56.677580+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:06:09.238985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635320+0000","last_change":"2024-06-02T22:31:15.847154+0000","last_active":"2024-06-02T22:32:56.635320+0000","last_peered":"2024-06-02T22:32:56.635320+0000","last_clean":"2024-06-02T22:32:56.635320+0000","last_became_active":"2024-06-02T22:31:15.846743+0000","last_became_peered":"2024-06-02T22:31:15.846743+0000","last_unstale":"2024-06-02T22:32:56.635320+0000","last_undegraded":"2024-06-02T22:32:56.635320+0000","last_fullsized":"2024-06-02T22:32:56.635320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:00.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637730+0000","last_change":"2024-06-02T22:31:20.748926+0000","last_active":"2024-06-02T22:32:56.637730+0000","last_peered":"2024-06-02T22:32:56.637730+0000","last_clean":"2024-06-02T22:32:56.637730+0000","last_became_active":"2024-06-02T22:31:20.748588+0000","last_became_peered":"2024-06-02T22:31:20.748588+0000","last_unstale":"2024-06-02T22:32:56.637730+0000","last_undegraded":"2024-06-02T22:32:56.637730+0000","last_fullsized":"2024-06-02T22:32:56.637730+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:26:09.876916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.505993+0000","last_change":"2024-06-02T22:31:33.859876+0000","last_active":"2024-06-02T22:32:56.505993+0000","last_peered":"2024-06-02T22:32:56.505993+0000","last_clean":"2024-06-02T22:32:56.505993+0000","last_became_active":"2024-06-02T22:31:33.856511+0000","last_became_peered":"2024-06-02T22:31:33.856511+0000","last_unstale":"2024-06-02T22:32:56.505993+0000","last_undegraded":"2024-06-02T22:32:56.505993+0000","last_fullsized":"2024-06-02T22:32:56.505993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:00.255066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'35","reported_seq":176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:25.528002+0000","last_change":"2024-06-02T22:31:55.992340+0000","last_active":"2024-06-02T22:33:25.528002+0000","last_peered":"2024-06-02T22:33:25.528002+0000","last_clean":"2024-06-02T22:33:25.528002+0000","last_became_active":"2024-06-02T22:31:55.984100+0000","last_became_peered":"2024-06-02T22:31:55.984100+0000","last_unstale":"2024-06-02T22:33:25.528002+0000","last_undegraded":"2024-06-02T22:33:25.528002+0000","last_fullsized":"2024-06-02T22:33:25.528002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:40.557506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":100,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497374+0000","last_change":"2024-06-02T22:31:20.755532+0000","last_active":"2024-06-02T22:32:56.497374+0000","last_peered":"2024-06-02T22:32:56.497374+0000","last_clean":"2024-06-02T22:32:56.497374+0000","last_became_active":"2024-06-02T22:31:20.755186+0000","last_became_peered":"2024-06-02T22:31:20.755186+0000","last_unstale":"2024-06-02T22:32:56.497374+0000","last_undegraded":"2024-06-02T22:32:56.497374+0000","last_fullsized":"2024-06-02T22:32:56.497374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:24.459712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635570+0000","last_change":"2024-06-02T22:31:33.864513+0000","last_active":"2024-06-02T22:32:56.635570+0000","last_peered":"2024-06-02T22:32:56.635570+0000","last_clean":"2024-06-02T22:32:56.635570+0000","last_became_active":"2024-06-02T22:31:33.864009+0000","last_became_peered":"2024-06-02T22:31:33.864009+0000","last_unstale":"2024-06-02T22:32:56.635570+0000","last_undegraded":"2024-06-02T22:32:56.635570+0000","last_fullsized":"2024-06-02T22:32:56.635570+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:36:14.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'9","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678047+0000","last_change":"2024-06-02T22:31:55.994602+0000","last_active":"2024-06-02T22:32:56.678047+0000","last_peered":"2024-06-02T22:32:56.678047+0000","last_clean":"2024-06-02T22:32:56.678047+0000","last_became_active":"2024-06-02T22:31:55.989825+0000","last_became_peered":"2024-06-02T22:31:55.989825+0000","last_unstale":"2024-06-02T22:32:56.678047+0000","last_undegraded":"2024-06-02T22:32:56.678047+0000","last_fullsized":"2024-06-02T22:32:56.678047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:20:50.155888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683366+0000","last_change":"2024-06-02T22:31:20.777927+0000","last_active":"2024-06-02T22:32:56.683366+0000","last_peered":"2024-06-02T22:32:56.683366+0000","last_clean":"2024-06-02T22:32:56.683366+0000","last_became_active":"2024-06-02T22:31:20.777609+0000","last_became_peered":"2024-06-02T22:31:20.777609+0000","last_unstale":"2024-06-02T22:32:56.683366+0000","last_undegraded":"2024-06-02T22:32:56.683366+0000","last_fullsized":"2024-06-02T22:32:56.683366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:07.396916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677770+0000","last_change":"2024-06-02T22:31:33.861447+0000","last_active":"2024-06-02T22:32:56.677770+0000","last_peered":"2024-06-02T22:32:56.677770+0000","last_clean":"2024-06-02T22:32:56.677770+0000","last_became_active":"2024-06-02T22:31:33.860836+0000","last_became_peered":"2024-06-02T22:31:33.860836+0000","last_unstale":"2024-06-02T22:32:56.677770+0000","last_undegraded":"2024-06-02T22:32:56.677770+0000","last_fullsized":"2024-06-02T22:32:56.677770+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:21.297872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635095+0000","last_change":"2024-06-02T22:31:15.644306+0000","last_active":"2024-06-02T22:32:56.635095+0000","last_peered":"2024-06-02T22:32:56.635095+0000","last_clean":"2024-06-02T22:32:56.635095+0000","last_became_active":"2024-06-02T22:31:15.643741+0000","last_became_peered":"2024-06-02T22:31:15.643741+0000","last_unstale":"2024-06-02T22:32:56.635095+0000","last_undegraded":"2024-06-02T22:32:56.635095+0000","last_fullsized":"2024-06-02T22:32:56.635095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:53.161633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510819+0000","last_change":"2024-06-02T22:31:20.751551+0000","last_active":"2024-06-02T22:32:56.510819+0000","last_peered":"2024-06-02T22:32:56.510819+0000","last_clean":"2024-06-02T22:32:56.510819+0000","last_became_active":"2024-06-02T22:31:20.751002+0000","last_became_peered":"2024-06-02T22:31:20.751002+0000","last_unstale":"2024-06-02T22:32:56.510819+0000","last_undegraded":"2024-06-02T22:32:56.510819+0000","last_fullsized":"2024-06-02T22:32:56.510819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:40:18.201325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507105+0000","last_change":"2024-06-02T22:31:33.871515+0000","last_active":"2024-06-02T22:32:56.507105+0000","last_peered":"2024-06-02T22:32:56.507105+0000","last_clean":"2024-06-02T22:32:56.507105+0000","last_became_active":"2024-06-02T22:31:33.870756+0000","last_became_peered":"2024-06-02T22:31:33.870756+0000","last_unstale":"2024-06-02T22:32:56.507105+0000","last_undegraded":"2024-06-02T22:32:56.507105+0000","last_fullsized":"2024-06-02T22:32:56.507105+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:12:31.109559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'5","reported_seq":87,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:24.537015+0000","last_change":"2024-06-02T22:31:15.638139+0000","last_active":"2024-06-02T22:33:24.537015+0000","last_peered":"2024-06-02T22:33:24.537015+0000","last_clean":"2024-06-02T22:33:24.537015+0000","last_became_active":"2024-06-02T22:31:15.636635+0000","last_became_peered":"2024-06-02T22:31:15.636635+0000","last_unstale":"2024-06-02T22:33:24.537015+0000","last_undegraded":"2024-06-02T22:33:24.537015+0000","last_fullsized":"2024-06-02T22:33:24.537015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:07.195137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510825+0000","last_change":"2024-06-02T22:31:20.745347+0000","last_active":"2024-06-02T22:32:56.510825+0000","last_peered":"2024-06-02T22:32:56.510825+0000","last_clean":"2024-06-02T22:32:56.510825+0000","last_became_active":"2024-06-02T22:31:20.744990+0000","last_became_peered":"2024-06-02T22:31:20.744990+0000","last_unstale":"2024-06-02T22:32:56.510825+0000","last_undegraded":"2024-06-02T22:32:56.510825+0000","last_fullsized":"2024-06-02T22:32:56.510825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:20.215740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684289+0000","last_change":"2024-06-02T22:31:33.866261+0000","last_active":"2024-06-02T22:32:56.684289+0000","last_peered":"2024-06-02T22:32:56.684289+0000","last_clean":"2024-06-02T22:32:56.684289+0000","last_became_active":"2024-06-02T22:31:33.865863+0000","last_became_peered":"2024-06-02T22:31:33.865863+0000","last_unstale":"2024-06-02T22:32:56.684289+0000","last_undegraded":"2024-06-02T22:32:56.684289+0000","last_fullsized":"2024-06-02T22:32:56.684289+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:00:41.670289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'17","reported_seq":62,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496774+0000","last_change":"2024-06-02T22:31:15.848282+0000","last_active":"2024-06-02T22:32:56.496774+0000","last_peered":"2024-06-02T22:32:56.496774+0000","last_clean":"2024-06-02T22:32:56.496774+0000","last_became_active":"2024-06-02T22:31:15.847846+0000","last_became_peered":"2024-06-02T22:31:15.847846+0000","last_unstale":"2024-06-02T22:32:56.496774+0000","last_undegraded":"2024-06-02T22:32:56.496774+0000","last_fullsized":"2024-06-02T22:32:56.496774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:09:12.971908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635018+0000","last_change":"2024-06-02T22:31:20.756682+0000","last_active":"2024-06-02T22:32:56.635018+0000","last_peered":"2024-06-02T22:32:56.635018+0000","last_clean":"2024-06-02T22:32:56.635018+0000","last_became_active":"2024-06-02T22:31:20.756357+0000","last_became_peered":"2024-06-02T22:31:20.756357+0000","last_unstale":"2024-06-02T22:32:56.635018+0000","last_undegraded":"2024-06-02T22:32:56.635018+0000","last_fullsized":"2024-06-02T22:32:56.635018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:39:53.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634928+0000","last_change":"2024-06-02T22:31:33.858267+0000","last_active":"2024-06-02T22:32:56.634928+0000","last_peered":"2024-06-02T22:32:56.634928+0000","last_clean":"2024-06-02T22:32:56.634928+0000","last_became_active":"2024-06-02T22:31:33.857784+0000","last_became_peered":"2024-06-02T22:31:33.857784+0000","last_unstale":"2024-06-02T22:32:56.634928+0000","last_undegraded":"2024-06-02T22:32:56.634928+0000","last_fullsized":"2024-06-02T22:32:56.634928+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:07:11.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497354+0000","last_change":"2024-06-02T22:31:15.637328+0000","last_active":"2024-06-02T22:32:56.497354+0000","last_peered":"2024-06-02T22:32:56.497354+0000","last_clean":"2024-06-02T22:32:56.497354+0000","last_became_active":"2024-06-02T22:31:15.636933+0000","last_became_peered":"2024-06-02T22:31:15.636933+0000","last_unstale":"2024-06-02T22:32:56.497354+0000","last_undegraded":"2024-06-02T22:32:56.497354+0000","last_fullsized":"2024-06-02T22:32:56.497354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:12:40.358884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678268+0000","last_change":"2024-06-02T22:31:20.752471+0000","last_active":"2024-06-02T22:32:56.678268+0000","last_peered":"2024-06-02T22:32:56.678268+0000","last_clean":"2024-06-02T22:32:56.678268+0000","last_became_active":"2024-06-02T22:31:20.750450+0000","last_became_peered":"2024-06-02T22:31:20.750450+0000","last_unstale":"2024-06-02T22:32:56.678268+0000","last_undegraded":"2024-06-02T22:32:56.678268+0000","last_fullsized":"2024-06-02T22:32:56.678268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:26:21.467156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497270+0000","last_change":"2024-06-02T22:31:55.984989+0000","last_active":"2024-06-02T22:32:56.497270+0000","last_peered":"2024-06-02T22:32:56.497270+0000","last_clean":"2024-06-02T22:32:56.497270+0000","last_became_active":"2024-06-02T22:31:55.984481+0000","last_became_peered":"2024-06-02T22:31:55.984481+0000","last_unstale":"2024-06-02T22:32:56.497270+0000","last_undegraded":"2024-06-02T22:32:56.497270+0000","last_fullsized":"2024-06-02T22:32:56.497270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:12.087792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506536+0000","last_change":"2024-06-02T22:31:15.849517+0000","last_active":"2024-06-02T22:32:56.506536+0000","last_peered":"2024-06-02T22:32:56.506536+0000","last_clean":"2024-06-02T22:32:56.506536+0000","last_became_active":"2024-06-02T22:31:15.849092+0000","last_became_peered":"2024-06-02T22:31:15.849092+0000","last_unstale":"2024-06-02T22:32:56.506536+0000","last_undegraded":"2024-06-02T22:32:56.506536+0000","last_fullsized":"2024-06-02T22:32:56.506536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:50.722007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501092+0000","last_change":"2024-06-02T22:31:20.768944+0000","last_active":"2024-06-02T22:32:56.501092+0000","last_peered":"2024-06-02T22:32:56.501092+0000","last_clean":"2024-06-02T22:32:56.501092+0000","last_became_active":"2024-06-02T22:31:20.768275+0000","last_became_peered":"2024-06-02T22:31:20.768275+0000","last_unstale":"2024-06-02T22:32:56.501092+0000","last_undegraded":"2024-06-02T22:32:56.501092+0000","last_fullsized":"2024-06-02T22:32:56.501092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:05.760188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684043+0000","last_change":"2024-06-02T22:31:33.860760+0000","last_active":"2024-06-02T22:32:56.684043+0000","last_peered":"2024-06-02T22:32:56.684043+0000","last_clean":"2024-06-02T22:32:56.684043+0000","last_became_active":"2024-06-02T22:31:33.860203+0000","last_became_peered":"2024-06-02T22:31:33.860203+0000","last_unstale":"2024-06-02T22:32:56.684043+0000","last_undegraded":"2024-06-02T22:32:56.684043+0000","last_fullsized":"2024-06-02T22:32:56.684043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:59:22.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"99'6","reported_seq":85,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:21.577951+0000","last_change":"2024-06-02T22:31:15.640274+0000","last_active":"2024-06-02T22:33:21.577951+0000","last_peered":"2024-06-02T22:33:21.577951+0000","last_clean":"2024-06-02T22:33:21.577951+0000","last_became_active":"2024-06-02T22:31:15.639879+0000","last_became_peered":"2024-06-02T22:31:15.639879+0000","last_unstale":"2024-06-02T22:33:21.577951+0000","last_undegraded":"2024-06-02T22:33:21.577951+0000","last_fullsized":"2024-06-02T22:33:21.577951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:51:37.947343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501029+0000","last_change":"2024-06-02T22:31:20.767645+0000","last_active":"2024-06-02T22:32:56.501029+0000","last_peered":"2024-06-02T22:32:56.501029+0000","last_clean":"2024-06-02T22:32:56.501029+0000","last_became_active":"2024-06-02T22:31:20.767290+0000","last_became_peered":"2024-06-02T22:31:20.767290+0000","last_unstale":"2024-06-02T22:32:56.501029+0000","last_undegraded":"2024-06-02T22:32:56.501029+0000","last_fullsized":"2024-06-02T22:32:56.501029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:48:10.989940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684361+0000","last_change":"2024-06-02T22:31:34.188667+0000","last_active":"2024-06-02T22:32:56.684361+0000","last_peered":"2024-06-02T22:32:56.684361+0000","last_clean":"2024-06-02T22:32:56.684361+0000","last_became_active":"2024-06-02T22:31:34.187865+0000","last_became_peered":"2024-06-02T22:31:34.187865+0000","last_unstale":"2024-06-02T22:32:56.684361+0000","last_undegraded":"2024-06-02T22:32:56.684361+0000","last_fullsized":"2024-06-02T22:32:56.684361+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:48.544150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635296+0000","last_change":"2024-06-02T22:31:20.755881+0000","last_active":"2024-06-02T22:32:56.635296+0000","last_peered":"2024-06-02T22:32:56.635296+0000","last_clean":"2024-06-02T22:32:56.635296+0000","last_became_active":"2024-06-02T22:31:20.755481+0000","last_became_peered":"2024-06-02T22:31:20.755481+0000","last_unstale":"2024-06-02T22:32:56.635296+0000","last_undegraded":"2024-06-02T22:32:56.635296+0000","last_fullsized":"2024-06-02T22:32:56.635296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:10:33.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'5","reported_seq":82,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:20.528672+0000","last_change":"2024-06-02T22:31:15.846057+0000","last_active":"2024-06-02T22:33:20.528672+0000","last_peered":"2024-06-02T22:33:20.528672+0000","last_clean":"2024-06-02T22:33:20.528672+0000","last_became_active":"2024-06-02T22:31:15.845097+0000","last_became_peered":"2024-06-02T22:31:15.845097+0000","last_unstale":"2024-06-02T22:33:20.528672+0000","last_undegraded":"2024-06-02T22:33:20.528672+0000","last_fullsized":"2024-06-02T22:33:20.528672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:22:23.481235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511084+0000","last_change":"2024-06-02T22:31:33.858499+0000","last_active":"2024-06-02T22:32:56.511084+0000","last_peered":"2024-06-02T22:32:56.511084+0000","last_clean":"2024-06-02T22:32:56.511084+0000","last_became_active":"2024-06-02T22:31:33.857914+0000","last_became_peered":"2024-06-02T22:31:33.857914+0000","last_unstale":"2024-06-02T22:32:56.511084+0000","last_undegraded":"2024-06-02T22:32:56.511084+0000","last_fullsized":"2024-06-02T22:32:56.511084+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:50:09.743015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680373+0000","last_change":"2024-06-02T22:31:20.763011+0000","last_active":"2024-06-02T22:32:56.680373+0000","last_peered":"2024-06-02T22:32:56.680373+0000","last_clean":"2024-06-02T22:32:56.680373+0000","last_became_active":"2024-06-02T22:31:20.759450+0000","last_became_peered":"2024-06-02T22:31:20.759450+0000","last_unstale":"2024-06-02T22:32:56.680373+0000","last_undegraded":"2024-06-02T22:32:56.680373+0000","last_fullsized":"2024-06-02T22:32:56.680373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:08:24.748321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'6","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:15.642691+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:15.642313+0000","last_became_peered":"2024-06-02T22:31:15.642313+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:34:32.329387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":367,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510569+0000","last_change":"2024-06-02T22:29:39.376514+0000","last_active":"2024-06-02T22:32:56.510569+0000","last_peered":"2024-06-02T22:32:56.510569+0000","last_clean":"2024-06-02T22:32:56.510569+0000","last_became_active":"2024-06-02T22:29:39.376061+0000","last_became_peered":"2024-06-02T22:29:39.376061+0000","last_unstale":"2024-06-02T22:32:56.510569+0000","last_undegraded":"2024-06-02T22:32:56.510569+0000","last_fullsized":"2024-06-02T22:32:56.510569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_clean_scrub_stamp":"2024-06-02T22:25:41.060756+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:26:05.799761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635409+0000","last_change":"2024-06-02T22:31:34.189204+0000","last_active":"2024-06-02T22:32:56.635409+0000","last_peered":"2024-06-02T22:32:56.635409+0000","last_clean":"2024-06-02T22:32:56.635409+0000","last_became_active":"2024-06-02T22:31:34.188639+0000","last_became_peered":"2024-06-02T22:31:34.188639+0000","last_unstale":"2024-06-02T22:32:56.635409+0000","last_undegraded":"2024-06-02T22:32:56.635409+0000","last_fullsized":"2024-06-02T22:32:56.635409+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:03:37.983874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681727+0000","last_change":"2024-06-02T22:31:20.768724+0000","last_active":"2024-06-02T22:32:56.681727+0000","last_peered":"2024-06-02T22:32:56.681727+0000","last_clean":"2024-06-02T22:32:56.681727+0000","last_became_active":"2024-06-02T22:31:20.768328+0000","last_became_peered":"2024-06-02T22:31:20.768328+0000","last_unstale":"2024-06-02T22:32:56.681727+0000","last_undegraded":"2024-06-02T22:32:56.681727+0000","last_fullsized":"2024-06-02T22:32:56.681727+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:48.993951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510775+0000","last_change":"2024-06-02T22:31:15.637109+0000","last_active":"2024-06-02T22:32:56.510775+0000","last_peered":"2024-06-02T22:32:56.510775+0000","last_clean":"2024-06-02T22:32:56.510775+0000","last_became_active":"2024-06-02T22:31:15.636511+0000","last_became_peered":"2024-06-02T22:31:15.636511+0000","last_unstale":"2024-06-02T22:32:56.510775+0000","last_undegraded":"2024-06-02T22:32:56.510775+0000","last_fullsized":"2024-06-02T22:32:56.510775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:11:15.838242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678133+0000","last_change":"2024-06-02T22:31:33.861118+0000","last_active":"2024-06-02T22:32:56.678133+0000","last_peered":"2024-06-02T22:32:56.678133+0000","last_clean":"2024-06-02T22:32:56.678133+0000","last_became_active":"2024-06-02T22:31:33.860622+0000","last_became_peered":"2024-06-02T22:31:33.860622+0000","last_unstale":"2024-06-02T22:32:56.678133+0000","last_undegraded":"2024-06-02T22:32:56.678133+0000","last_fullsized":"2024-06-02T22:32:56.678133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:14.052151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'4","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678270+0000","last_change":"2024-06-02T22:31:56.477226+0000","last_active":"2024-06-02T22:32:56.678270+0000","last_peered":"2024-06-02T22:32:56.678270+0000","last_clean":"2024-06-02T22:32:56.678270+0000","last_became_active":"2024-06-02T22:31:56.476839+0000","last_became_peered":"2024-06-02T22:31:56.476839+0000","last_unstale":"2024-06-02T22:32:56.678270+0000","last_undegraded":"2024-06-02T22:32:56.678270+0000","last_fullsized":"2024-06-02T22:32:56.678270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:12.233878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684152+0000","last_change":"2024-06-02T22:31:20.771984+0000","last_active":"2024-06-02T22:32:56.684152+0000","last_peered":"2024-06-02T22:32:56.684152+0000","last_clean":"2024-06-02T22:32:56.684152+0000","last_became_active":"2024-06-02T22:31:20.771524+0000","last_became_peered":"2024-06-02T22:31:20.771524+0000","last_unstale":"2024-06-02T22:32:56.684152+0000","last_undegraded":"2024-06-02T22:32:56.684152+0000","last_fullsized":"2024-06-02T22:32:56.684152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:13:25.590377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681290+0000","last_change":"2024-06-02T22:31:34.188564+0000","last_active":"2024-06-02T22:32:56.681290+0000","last_peered":"2024-06-02T22:32:56.681290+0000","last_clean":"2024-06-02T22:32:56.681290+0000","last_became_active":"2024-06-02T22:31:34.187631+0000","last_became_peered":"2024-06-02T22:31:34.187631+0000","last_unstale":"2024-06-02T22:32:56.681290+0000","last_undegraded":"2024-06-02T22:32:56.681290+0000","last_fullsized":"2024-06-02T22:32:56.681290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:23:35.572300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'16","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:17.788860+0000","last_change":"2024-06-02T22:31:15.648073+0000","last_active":"2024-06-02T22:33:17.788860+0000","last_peered":"2024-06-02T22:33:17.788860+0000","last_clean":"2024-06-02T22:33:17.788860+0000","last_became_active":"2024-06-02T22:31:15.647573+0000","last_became_peered":"2024-06-02T22:31:15.647573+0000","last_unstale":"2024-06-02T22:33:17.788860+0000","last_undegraded":"2024-06-02T22:33:17.788860+0000","last_fullsized":"2024-06-02T22:33:17.788860+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:58.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681095+0000","last_change":"2024-06-02T22:31:20.764750+0000","last_active":"2024-06-02T22:32:56.681095+0000","last_peered":"2024-06-02T22:32:56.681095+0000","last_clean":"2024-06-02T22:32:56.681095+0000","last_became_active":"2024-06-02T22:31:20.763025+0000","last_became_peered":"2024-06-02T22:31:20.763025+0000","last_unstale":"2024-06-02T22:32:56.681095+0000","last_undegraded":"2024-06-02T22:32:56.681095+0000","last_fullsized":"2024-06-02T22:32:56.681095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677020+0000","last_change":"2024-06-02T22:31:33.845885+0000","last_active":"2024-06-02T22:32:56.677020+0000","last_peered":"2024-06-02T22:32:56.677020+0000","last_clean":"2024-06-02T22:32:56.677020+0000","last_became_active":"2024-06-02T22:31:33.845076+0000","last_became_peered":"2024-06-02T22:31:33.845076+0000","last_unstale":"2024-06-02T22:32:56.677020+0000","last_undegraded":"2024-06-02T22:32:56.677020+0000","last_fullsized":"2024-06-02T22:32:56.677020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:28:32.849389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'7","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677923+0000","last_change":"2024-06-02T22:31:16.009742+0000","last_active":"2024-06-02T22:32:56.677923+0000","last_peered":"2024-06-02T22:32:56.677923+0000","last_clean":"2024-06-02T22:32:56.677923+0000","last_became_active":"2024-06-02T22:31:16.009462+0000","last_became_peered":"2024-06-02T22:31:16.009462+0000","last_unstale":"2024-06-02T22:32:56.677923+0000","last_undegraded":"2024-06-02T22:32:56.677923+0000","last_fullsized":"2024-06-02T22:32:56.677923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:57.963782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679525+0000","last_change":"2024-06-02T22:31:20.779344+0000","last_active":"2024-06-02T22:32:56.679525+0000","last_peered":"2024-06-02T22:32:56.679525+0000","last_clean":"2024-06-02T22:32:56.679525+0000","last_became_active":"2024-06-02T22:31:20.778586+0000","last_became_peered":"2024-06-02T22:31:20.778586+0000","last_unstale":"2024-06-02T22:32:56.679525+0000","last_undegraded":"2024-06-02T22:32:56.679525+0000","last_fullsized":"2024-06-02T22:32:56.679525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:55:01.213401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677655+0000","last_change":"2024-06-02T22:31:55.986536+0000","last_active":"2024-06-02T22:32:56.677655+0000","last_peered":"2024-06-02T22:32:56.677655+0000","last_clean":"2024-06-02T22:32:56.677655+0000","last_became_active":"2024-06-02T22:31:55.985958+0000","last_became_peered":"2024-06-02T22:31:55.985958+0000","last_unstale":"2024-06-02T22:32:56.677655+0000","last_undegraded":"2024-06-02T22:32:56.677655+0000","last_fullsized":"2024-06-02T22:32:56.677655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:02:13.317010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637480+0000","last_change":"2024-06-02T22:31:15.844475+0000","last_active":"2024-06-02T22:32:56.637480+0000","last_peered":"2024-06-02T22:32:56.637480+0000","last_clean":"2024-06-02T22:32:56.637480+0000","last_became_active":"2024-06-02T22:31:15.844135+0000","last_became_peered":"2024-06-02T22:31:15.844135+0000","last_unstale":"2024-06-02T22:32:56.637480+0000","last_undegraded":"2024-06-02T22:32:56.637480+0000","last_fullsized":"2024-06-02T22:32:56.637480+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:44:29.127186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496808+0000","last_change":"2024-06-02T22:31:20.752005+0000","last_active":"2024-06-02T22:32:56.496808+0000","last_peered":"2024-06-02T22:32:56.496808+0000","last_clean":"2024-06-02T22:32:56.496808+0000","last_became_active":"2024-06-02T22:31:20.751525+0000","last_became_peered":"2024-06-02T22:31:20.751525+0000","last_unstale":"2024-06-02T22:32:56.496808+0000","last_undegraded":"2024-06-02T22:32:56.496808+0000","last_fullsized":"2024-06-02T22:32:56.496808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:08:35.477470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507177+0000","last_change":"2024-06-02T22:31:33.870374+0000","last_active":"2024-06-02T22:32:56.507177+0000","last_peered":"2024-06-02T22:32:56.507177+0000","last_clean":"2024-06-02T22:32:56.507177+0000","last_became_active":"2024-06-02T22:31:33.869931+0000","last_became_peered":"2024-06-02T22:31:33.869931+0000","last_unstale":"2024-06-02T22:32:56.507177+0000","last_undegraded":"2024-06-02T22:32:56.507177+0000","last_fullsized":"2024-06-02T22:32:56.507177+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:33:11.209183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'7","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680217+0000","last_change":"2024-06-02T22:31:15.645570+0000","last_active":"2024-06-02T22:32:56.680217+0000","last_peered":"2024-06-02T22:32:56.680217+0000","last_clean":"2024-06-02T22:32:56.680217+0000","last_became_active":"2024-06-02T22:31:15.645124+0000","last_became_peered":"2024-06-02T22:31:15.645124+0000","last_unstale":"2024-06-02T22:32:56.680217+0000","last_undegraded":"2024-06-02T22:32:56.680217+0000","last_fullsized":"2024-06-02T22:32:56.680217+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:11:56.956942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:20.758501+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:20.758097+0000","last_became_peered":"2024-06-02T22:31:20.758097+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:47.523600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677871+0000","last_change":"2024-06-02T22:31:33.858463+0000","last_active":"2024-06-02T22:32:56.677871+0000","last_peered":"2024-06-02T22:32:56.677871+0000","last_clean":"2024-06-02T22:32:56.677871+0000","last_became_active":"2024-06-02T22:31:33.858001+0000","last_became_peered":"2024-06-02T22:31:33.858001+0000","last_unstale":"2024-06-02T22:32:56.677871+0000","last_undegraded":"2024-06-02T22:32:56.677871+0000","last_fullsized":"2024-06-02T22:32:56.677871+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:50.797150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677176+0000","last_change":"2024-06-02T22:31:15.644144+0000","last_active":"2024-06-02T22:32:56.677176+0000","last_peered":"2024-06-02T22:32:56.677176+0000","last_clean":"2024-06-02T22:32:56.677176+0000","last_became_active":"2024-06-02T22:31:15.643629+0000","last_became_peered":"2024-06-02T22:31:15.643629+0000","last_unstale":"2024-06-02T22:32:56.677176+0000","last_undegraded":"2024-06-02T22:32:56.677176+0000","last_fullsized":"2024-06-02T22:32:56.677176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:45:36.491134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683235+0000","last_change":"2024-06-02T22:32:56.681729+0000","last_active":"2024-06-02T22:32:56.683235+0000","last_peered":"2024-06-02T22:32:56.683235+0000","last_clean":"2024-06-02T22:32:56.683235+0000","last_became_active":"2024-06-02T22:32:56.680934+0000","last_became_peered":"2024-06-02T22:32:56.680934+0000","last_unstale":"2024-06-02T22:32:56.683235+0000","last_undegraded":"2024-06-02T22:32:56.683235+0000","last_fullsized":"2024-06-02T22:32:56.683235+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:02.046940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677677+0000","last_change":"2024-06-02T22:31:34.187743+0000","last_active":"2024-06-02T22:32:56.677677+0000","last_peered":"2024-06-02T22:32:56.677677+0000","last_clean":"2024-06-02T22:32:56.677677+0000","last_became_active":"2024-06-02T22:31:34.187241+0000","last_became_peered":"2024-06-02T22:31:34.187241+0000","last_unstale":"2024-06-02T22:32:56.677677+0000","last_undegraded":"2024-06-02T22:32:56.677677+0000","last_fullsized":"2024-06-02T22:32:56.677677+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:00.980570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496995+0000","last_change":"2024-06-02T22:31:15.639499+0000","last_active":"2024-06-02T22:32:56.496995+0000","last_peered":"2024-06-02T22:32:56.496995+0000","last_clean":"2024-06-02T22:32:56.496995+0000","last_became_active":"2024-06-02T22:31:15.639078+0000","last_became_peered":"2024-06-02T22:31:15.639078+0000","last_unstale":"2024-06-02T22:32:56.496995+0000","last_undegraded":"2024-06-02T22:32:56.496995+0000","last_fullsized":"2024-06-02T22:32:56.496995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:29.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510815+0000","last_change":"2024-06-02T22:31:20.768079+0000","last_active":"2024-06-02T22:32:56.510815+0000","last_peered":"2024-06-02T22:32:56.510815+0000","last_clean":"2024-06-02T22:32:56.510815+0000","last_became_active":"2024-06-02T22:31:20.767762+0000","last_became_peered":"2024-06-02T22:31:20.767762+0000","last_unstale":"2024-06-02T22:32:56.510815+0000","last_undegraded":"2024-06-02T22:32:56.510815+0000","last_fullsized":"2024-06-02T22:32:56.510815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:50:05.247900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637534+0000","last_change":"2024-06-02T22:31:33.852366+0000","last_active":"2024-06-02T22:32:56.637534+0000","last_peered":"2024-06-02T22:32:56.637534+0000","last_clean":"2024-06-02T22:32:56.637534+0000","last_became_active":"2024-06-02T22:31:33.851836+0000","last_became_peered":"2024-06-02T22:31:33.851836+0000","last_unstale":"2024-06-02T22:32:56.637534+0000","last_undegraded":"2024-06-02T22:32:56.637534+0000","last_fullsized":"2024-06-02T22:32:56.637534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:53.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"99'6","reported_seq":88,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:23.524390+0000","last_change":"2024-06-02T22:31:16.009788+0000","last_active":"2024-06-02T22:33:23.524390+0000","last_peered":"2024-06-02T22:33:23.524390+0000","last_clean":"2024-06-02T22:33:23.524390+0000","last_became_active":"2024-06-02T22:31:16.009413+0000","last_became_peered":"2024-06-02T22:31:16.009413+0000","last_unstale":"2024-06-02T22:33:23.524390+0000","last_undegraded":"2024-06-02T22:33:23.524390+0000","last_fullsized":"2024-06-02T22:33:23.524390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:43:38.985017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511262+0000","last_change":"2024-06-02T22:31:20.751507+0000","last_active":"2024-06-02T22:32:56.511262+0000","last_peered":"2024-06-02T22:32:56.511262+0000","last_clean":"2024-06-02T22:32:56.511262+0000","last_became_active":"2024-06-02T22:31:20.751179+0000","last_became_peered":"2024-06-02T22:31:20.751179+0000","last_unstale":"2024-06-02T22:32:56.511262+0000","last_undegraded":"2024-06-02T22:32:56.511262+0000","last_fullsized":"2024-06-02T22:32:56.511262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:16.744759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678759+0000","last_change":"2024-06-02T22:31:33.862697+0000","last_active":"2024-06-02T22:32:56.678759+0000","last_peered":"2024-06-02T22:32:56.678759+0000","last_clean":"2024-06-02T22:32:56.678759+0000","last_became_active":"2024-06-02T22:31:33.862148+0000","last_became_peered":"2024-06-02T22:31:33.862148+0000","last_unstale":"2024-06-02T22:32:56.678759+0000","last_undegraded":"2024-06-02T22:32:56.678759+0000","last_fullsized":"2024-06-02T22:32:56.678759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:15.435992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635424+0000","last_change":"2024-06-02T22:31:15.644121+0000","last_active":"2024-06-02T22:32:56.635424+0000","last_peered":"2024-06-02T22:32:56.635424+0000","last_clean":"2024-06-02T22:32:56.635424+0000","last_became_active":"2024-06-02T22:31:15.643727+0000","last_became_peered":"2024-06-02T22:31:15.643727+0000","last_unstale":"2024-06-02T22:32:56.635424+0000","last_undegraded":"2024-06-02T22:32:56.635424+0000","last_fullsized":"2024-06-02T22:32:56.635424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:17:07.135824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511020+0000","last_change":"2024-06-02T22:31:20.748366+0000","last_active":"2024-06-02T22:32:56.511020+0000","last_peered":"2024-06-02T22:32:56.511020+0000","last_clean":"2024-06-02T22:32:56.511020+0000","last_became_active":"2024-06-02T22:31:20.748036+0000","last_became_peered":"2024-06-02T22:31:20.748036+0000","last_unstale":"2024-06-02T22:32:56.511020+0000","last_undegraded":"2024-06-02T22:32:56.511020+0000","last_fullsized":"2024-06-02T22:32:56.511020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:48.188964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634704+0000","last_change":"2024-06-02T22:31:33.847227+0000","last_active":"2024-06-02T22:32:56.634704+0000","last_peered":"2024-06-02T22:32:56.634704+0000","last_clean":"2024-06-02T22:32:56.634704+0000","last_became_active":"2024-06-02T22:31:33.846701+0000","last_became_peered":"2024-06-02T22:31:33.846701+0000","last_unstale":"2024-06-02T22:32:56.634704+0000","last_undegraded":"2024-06-02T22:32:56.634704+0000","last_fullsized":"2024-06-02T22:32:56.634704+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:19.436409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"97'5","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684220+0000","last_change":"2024-06-02T22:31:15.648048+0000","last_active":"2024-06-02T22:32:56.684220+0000","last_peered":"2024-06-02T22:32:56.684220+0000","last_clean":"2024-06-02T22:32:56.684220+0000","last_became_active":"2024-06-02T22:31:15.647400+0000","last_became_peered":"2024-06-02T22:31:15.647400+0000","last_unstale":"2024-06-02T22:32:56.684220+0000","last_undegraded":"2024-06-02T22:32:56.684220+0000","last_fullsized":"2024-06-02T22:32:56.684220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:29:23.458912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511286+0000","last_change":"2024-06-02T22:31:20.751545+0000","last_active":"2024-06-02T22:32:56.511286+0000","last_peered":"2024-06-02T22:32:56.511286+0000","last_clean":"2024-06-02T22:32:56.511286+0000","last_became_active":"2024-06-02T22:31:20.751202+0000","last_became_peered":"2024-06-02T22:31:20.751202+0000","last_unstale":"2024-06-02T22:32:56.511286+0000","last_undegraded":"2024-06-02T22:32:56.511286+0000","last_fullsized":"2024-06-02T22:32:56.511286+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:06:23.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677916+0000","last_change":"2024-06-02T22:31:20.752666+0000","last_active":"2024-06-02T22:32:56.677916+0000","last_peered":"2024-06-02T22:32:56.677916+0000","last_clean":"2024-06-02T22:32:56.677916+0000","last_became_active":"2024-06-02T22:31:20.750433+0000","last_became_peered":"2024-06-02T22:31:20.750433+0000","last_unstale":"2024-06-02T22:32:56.677916+0000","last_undegraded":"2024-06-02T22:32:56.677916+0000","last_fullsized":"2024-06-02T22:32:56.677916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:12.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677813+0000","last_change":"2024-06-02T22:31:20.747426+0000","last_active":"2024-06-02T22:32:56.677813+0000","last_peered":"2024-06-02T22:32:56.677813+0000","last_clean":"2024-06-02T22:32:56.677813+0000","last_became_active":"2024-06-02T22:31:20.746734+0000","last_became_peered":"2024-06-02T22:31:20.746734+0000","last_unstale":"2024-06-02T22:32:56.677813+0000","last_undegraded":"2024-06-02T22:32:56.677813+0000","last_fullsized":"2024-06-02T22:32:56.677813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:30.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677329+0000","last_change":"2024-06-02T22:31:20.771277+0000","last_active":"2024-06-02T22:32:56.677329+0000","last_peered":"2024-06-02T22:32:56.677329+0000","last_clean":"2024-06-02T22:32:56.677329+0000","last_became_active":"2024-06-02T22:31:20.770635+0000","last_became_peered":"2024-06-02T22:31:20.770635+0000","last_unstale":"2024-06-02T22:32:56.677329+0000","last_undegraded":"2024-06-02T22:32:56.677329+0000","last_fullsized":"2024-06-02T22:32:56.677329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:03.051044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679001+0000","last_change":"2024-06-02T22:31:20.774709+0000","last_active":"2024-06-02T22:32:56.679001+0000","last_peered":"2024-06-02T22:32:56.679001+0000","last_clean":"2024-06-02T22:32:56.679001+0000","last_became_active":"2024-06-02T22:31:20.774260+0000","last_became_peered":"2024-06-02T22:31:20.774260+0000","last_unstale":"2024-06-02T22:32:56.679001+0000","last_undegraded":"2024-06-02T22:32:56.679001+0000","last_fullsized":"2024-06-02T22:32:56.679001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:25.045695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684221+0000","last_change":"2024-06-02T22:31:20.774013+0000","last_active":"2024-06-02T22:32:56.684221+0000","last_peered":"2024-06-02T22:32:56.684221+0000","last_clean":"2024-06-02T22:32:56.684221+0000","last_became_active":"2024-06-02T22:31:20.773479+0000","last_became_peered":"2024-06-02T22:31:20.773479+0000","last_unstale":"2024-06-02T22:32:56.684221+0000","last_undegraded":"2024-06-02T22:32:56.684221+0000","last_fullsized":"2024-06-02T22:32:56.684221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:19.583665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678418+0000","last_change":"2024-06-02T22:31:20.752637+0000","last_active":"2024-06-02T22:32:56.678418+0000","last_peered":"2024-06-02T22:32:56.678418+0000","last_clean":"2024-06-02T22:32:56.678418+0000","last_became_active":"2024-06-02T22:31:20.752279+0000","last_became_peered":"2024-06-02T22:31:20.752279+0000","last_unstale":"2024-06-02T22:32:56.678418+0000","last_undegraded":"2024-06-02T22:32:56.678418+0000","last_fullsized":"2024-06-02T22:32:56.678418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:09:11.124952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677625+0000","last_change":"2024-06-02T22:31:20.752138+0000","last_active":"2024-06-02T22:32:56.677625+0000","last_peered":"2024-06-02T22:32:56.677625+0000","last_clean":"2024-06-02T22:32:56.677625+0000","last_became_active":"2024-06-02T22:31:20.751744+0000","last_became_peered":"2024-06-02T22:31:20.751744+0000","last_unstale":"2024-06-02T22:32:56.677625+0000","last_undegraded":"2024-06-02T22:32:56.677625+0000","last_fullsized":"2024-06-02T22:32:56.677625+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:51.702632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681260+0000","last_change":"2024-06-02T22:31:20.769725+0000","last_active":"2024-06-02T22:32:56.681260+0000","last_peered":"2024-06-02T22:32:56.681260+0000","last_clean":"2024-06-02T22:32:56.681260+0000","last_became_active":"2024-06-02T22:31:20.767668+0000","last_became_peered":"2024-06-02T22:31:20.767668+0000","last_unstale":"2024-06-02T22:32:56.681260+0000","last_undegraded":"2024-06-02T22:32:56.681260+0000","last_fullsized":"2024-06-02T22:32:56.681260+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:56:57.860195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634913+0000","last_change":"2024-06-02T22:31:20.771863+0000","last_active":"2024-06-02T22:32:56.634913+0000","last_peered":"2024-06-02T22:32:56.634913+0000","last_clean":"2024-06-02T22:32:56.634913+0000","last_became_active":"2024-06-02T22:31:20.771533+0000","last_became_peered":"2024-06-02T22:31:20.771533+0000","last_unstale":"2024-06-02T22:32:56.634913+0000","last_undegraded":"2024-06-02T22:32:56.634913+0000","last_fullsized":"2024-06-02T22:32:56.634913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:34.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680285+0000","last_change":"2024-06-02T22:31:20.761906+0000","last_active":"2024-06-02T22:32:56.680285+0000","last_peered":"2024-06-02T22:32:56.680285+0000","last_clean":"2024-06-02T22:32:56.680285+0000","last_became_active":"2024-06-02T22:31:20.761571+0000","last_became_peered":"2024-06-02T22:31:20.761571+0000","last_unstale":"2024-06-02T22:32:56.680285+0000","last_undegraded":"2024-06-02T22:32:56.680285+0000","last_fullsized":"2024-06-02T22:32:56.680285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:37.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637787+0000","last_change":"2024-06-02T22:31:20.764292+0000","last_active":"2024-06-02T22:32:56.637787+0000","last_peered":"2024-06-02T22:32:56.637787+0000","last_clean":"2024-06-02T22:32:56.637787+0000","last_became_active":"2024-06-02T22:31:20.763997+0000","last_became_peered":"2024-06-02T22:31:20.763997+0000","last_unstale":"2024-06-02T22:32:56.637787+0000","last_undegraded":"2024-06-02T22:32:56.637787+0000","last_fullsized":"2024-06-02T22:32:56.637787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:44.151687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683883+0000","last_change":"2024-06-02T22:31:20.773602+0000","last_active":"2024-06-02T22:32:56.683883+0000","last_peered":"2024-06-02T22:32:56.683883+0000","last_clean":"2024-06-02T22:32:56.683883+0000","last_became_active":"2024-06-02T22:31:20.773186+0000","last_became_peered":"2024-06-02T22:31:20.773186+0000","last_unstale":"2024-06-02T22:32:56.683883+0000","last_undegraded":"2024-06-02T22:32:56.683883+0000","last_fullsized":"2024-06-02T22:32:56.683883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:45.238636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677994+0000","last_change":"2024-06-02T22:31:20.750509+0000","last_active":"2024-06-02T22:32:56.677994+0000","last_peered":"2024-06-02T22:32:56.677994+0000","last_clean":"2024-06-02T22:32:56.677994+0000","last_became_active":"2024-06-02T22:31:20.750121+0000","last_became_peered":"2024-06-02T22:31:20.750121+0000","last_unstale":"2024-06-02T22:32:56.677994+0000","last_undegraded":"2024-06-02T22:32:56.677994+0000","last_fullsized":"2024-06-02T22:32:56.677994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:05:24.916621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282802,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68707,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":389,"num_read_kb":270,"num_write":251,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":570945,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645360,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32396,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712756,"statfs":{"total":95995035648,"available":95961862144,"internally_reserved":0,"allocated":1249280,"data_stored":1218306,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808886,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":574401,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070524,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":570571,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332160,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1167569,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495687,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":566199,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36472,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708680,"statfs":{"total":95995035648,"available":95957688320,"internally_reserved":0,"allocated":1163264,"data_stored":623896,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1126400,"data_stored":567655,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":567771,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182487,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1114112,"data_stored":565517,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32328,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712824,"statfs":{"total":95995035648,"available":95961931776,"internally_reserved":0,"allocated":1179648,"data_stored":630998,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757325,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":1162761,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:33:29.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T22:33:29.514 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:29.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:29 smithi031 ceph-mon[31767]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:29.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:29 smithi031 ceph-mon[31767]: pgmap v406: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:29.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:29 smithi098 ceph-mon[36750]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:29.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:29 smithi098 ceph-mon[36750]: pgmap v406: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:29 smithi178 ceph-mon[36614]: from='client.24739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:29 smithi178 ceph-mon[36614]: pgmap v406: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:31.615 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:31 smithi031 ceph-mon[31767]: pgmap v407: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:31.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:31 smithi098 ceph-mon[36750]: pgmap v407: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:31.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:31 smithi178 ceph-mon[36614]: pgmap v407: 129 pgs: 129 active+clean; 644 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T22:33:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 -- 172.21.15.31:0/1162263995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 msgr2=0x7f1488104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 --2- 172.21.15.31:0/1162263995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f1488104a40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1474009990 tx=0x7f1474009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 -- 172.21.15.31:0/1162263995 shutdown_connections 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 --2- 172.21.15.31:0/1162263995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1488104f80 0x7f1488111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 --2- 172.21.15.31:0/1162263995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f148810a650 0x7f148810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 --2- 172.21.15.31:0/1162263995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f1488104a40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 -- 172.21.15.31:0/1162263995 >> 172.21.15.31:0/1162263995 conn(0x7f14881000b0 msgr2=0x7f14881024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 -- 172.21.15.31:0/1162263995 shutdown_connections 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.900+0000 7f148ee00700 1 -- 172.21.15.31:0/1162263995 wait complete. 2024-06-02T22:33:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.901+0000 7f148ee00700 1 Processor -- start 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 -- start start 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 0x7f148819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148810a650 0x7f148819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1488114960 con 0x7f14881045c0 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14881147e0 con 0x7f148810a650 2024-06-02T22:33:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148ee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1488114ae0 con 0x7f1488104f80 2024-06-02T22:33:31.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148da00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:31.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 0x7f148819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:31.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 0x7f148819b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58012/0 (socket says 172.21.15.31:58012) 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148d000700 1 -- 172.21.15.31:0/1277306746 learned_addr learned my addr 172.21.15.31:0/1277306746 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.902+0000 7f148da00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52106/0 (socket says 172.21.15.31:52106) 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148e400700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148810a650 0x7f148819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 -- 172.21.15.31:0/1277306746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 msgr2=0x7f148819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 0x7f148819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 -- 172.21.15.31:0/1277306746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148810a650 msgr2=0x7f148819f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148810a650 0x7f148819f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 -- 172.21.15.31:0/1277306746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148819fd30 con 0x7f14881045c0 2024-06-02T22:33:31.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.903+0000 7f148da00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e9c0 tx=0x7f147c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.904+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c004230 con 0x7f14881045c0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.904+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14881a0020 con 0x7f14881045c0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.904+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f147c0043d0 con 0x7f14881045c0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.904+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c010430 con 0x7f14881045c0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.904+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a78a0 con 0x7f14881045c0 2024-06-02T22:33:31.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.905+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1488069180 con 0x7f14881045c0 2024-06-02T22:33:31.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.907+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f147c00c7c0 con 0x7f14881045c0 2024-06-02T22:33:31.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.908+0000 7f1486000700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 0x7f14700a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:31.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.909+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f147c0cf930 con 0x7f14881045c0 2024-06-02T22:33:31.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.909+0000 7f148d000700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 0x7f14700a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:31.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.909+0000 7f148d000700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 0x7f14700a51f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1474009750 tx=0x7f147400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:31.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:31.911+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f147c09c340 con 0x7f14881045c0 2024-06-02T22:33:32.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.137+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f148819c080 con 0x7f14700a2d30 2024-06-02T22:33:32.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.153+0000 7f1486000700 1 -- 172.21.15.31:0/1277306746 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340698 (secure 0 0 0) 0x7f148819c080 con 0x7f14700a2d30 2024-06-02T22:33:32.159 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:32.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 msgr2=0x7f14700a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:32.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 0x7f14700a51f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1474009750 tx=0x7f147400b280 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 msgr2=0x7f148819ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f147c00e9c0 tx=0x7f147c00ecd0 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 shutdown_connections 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f14700a2d30 0x7f14700a51f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148810a650 0x7f148819f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14881045c0 0x7f148819ad70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 --2- 172.21.15.31:0/1277306746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488104f80 0x7f148819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 >> 172.21.15.31:0/1277306746 conn(0x7f14881000b0 msgr2=0x7f1488101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.160+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 shutdown_connections 2024-06-02T22:33:32.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:32.161+0000 7f148ee00700 1 -- 172.21.15.31:0/1277306746 wait complete. 2024-06-02T22:33:32.163 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-06-02T22:33:33.131 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-06-02T22:33:30.292067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659309,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":540,"num_read_kb":389,"num_write":434,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182382,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379248,"kb_used_data":13448,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562576,"statfs":{"total":1151940427776,"available":1151552077824,"internally_reserved":0,"allocated":13770752,"data_stored":8791037,"data_compressed":496710,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":69,"num_write":13,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005285"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678536+0000","last_change":"2024-06-02T22:31:20.770673+0000","last_active":"2024-06-02T22:32:56.678536+0000","last_peered":"2024-06-02T22:32:56.678536+0000","last_clean":"2024-06-02T22:32:56.678536+0000","last_became_active":"2024-06-02T22:31:20.770000+0000","last_became_peered":"2024-06-02T22:31:20.770000+0000","last_unstale":"2024-06-02T22:32:56.678536+0000","last_undegraded":"2024-06-02T22:32:56.678536+0000","last_fullsized":"2024-06-02T22:32:56.678536+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:52.632084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679506+0000","last_change":"2024-06-02T22:31:20.766311+0000","last_active":"2024-06-02T22:32:56.679506+0000","last_peered":"2024-06-02T22:32:56.679506+0000","last_clean":"2024-06-02T22:32:56.679506+0000","last_became_active":"2024-06-02T22:31:20.765960+0000","last_became_peered":"2024-06-02T22:31:20.765960+0000","last_unstale":"2024-06-02T22:32:56.679506+0000","last_undegraded":"2024-06-02T22:32:56.679506+0000","last_fullsized":"2024-06-02T22:32:56.679506+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:30.500082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679279+0000","last_change":"2024-06-02T22:31:20.766005+0000","last_active":"2024-06-02T22:32:56.679279+0000","last_peered":"2024-06-02T22:32:56.679279+0000","last_clean":"2024-06-02T22:32:56.679279+0000","last_became_active":"2024-06-02T22:31:20.762135+0000","last_became_peered":"2024-06-02T22:31:20.762135+0000","last_unstale":"2024-06-02T22:32:56.679279+0000","last_undegraded":"2024-06-02T22:32:56.679279+0000","last_fullsized":"2024-06-02T22:32:56.679279+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:44:10.201470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677591+0000","last_change":"2024-06-02T22:31:20.754293+0000","last_active":"2024-06-02T22:32:56.677591+0000","last_peered":"2024-06-02T22:32:56.677591+0000","last_clean":"2024-06-02T22:32:56.677591+0000","last_became_active":"2024-06-02T22:31:20.753996+0000","last_became_peered":"2024-06-02T22:31:20.753996+0000","last_unstale":"2024-06-02T22:32:56.677591+0000","last_undegraded":"2024-06-02T22:32:56.677591+0000","last_fullsized":"2024-06-02T22:32:56.677591+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:25.050471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496991+0000","last_change":"2024-06-02T22:31:20.776227+0000","last_active":"2024-06-02T22:32:56.496991+0000","last_peered":"2024-06-02T22:32:56.496991+0000","last_clean":"2024-06-02T22:32:56.496991+0000","last_became_active":"2024-06-02T22:31:20.775922+0000","last_became_peered":"2024-06-02T22:31:20.775922+0000","last_unstale":"2024-06-02T22:32:56.496991+0000","last_undegraded":"2024-06-02T22:32:56.496991+0000","last_fullsized":"2024-06-02T22:32:56.496991+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:54:49.228748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684643+0000","last_change":"2024-06-02T22:32:56.684643+0000","last_active":"2024-06-02T22:32:56.684643+0000","last_peered":"2024-06-02T22:32:56.684643+0000","last_clean":"2024-06-02T22:32:56.684643+0000","last_became_active":"2024-06-02T22:32:56.684253+0000","last_became_peered":"2024-06-02T22:32:56.684253+0000","last_unstale":"2024-06-02T22:32:56.684643+0000","last_undegraded":"2024-06-02T22:32:56.684643+0000","last_fullsized":"2024-06-02T22:32:56.684643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:40:57.474007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510721+0000","last_change":"2024-06-02T22:31:20.748702+0000","last_active":"2024-06-02T22:32:56.510721+0000","last_peered":"2024-06-02T22:32:56.510721+0000","last_clean":"2024-06-02T22:32:56.510721+0000","last_became_active":"2024-06-02T22:31:20.748361+0000","last_became_peered":"2024-06-02T22:31:20.748361+0000","last_unstale":"2024-06-02T22:32:56.510721+0000","last_undegraded":"2024-06-02T22:32:56.510721+0000","last_fullsized":"2024-06-02T22:32:56.510721+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:00.065043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681534+0000","last_change":"2024-06-02T22:31:20.761647+0000","last_active":"2024-06-02T22:32:56.681534+0000","last_peered":"2024-06-02T22:32:56.681534+0000","last_clean":"2024-06-02T22:32:56.681534+0000","last_became_active":"2024-06-02T22:31:20.758453+0000","last_became_peered":"2024-06-02T22:31:20.758453+0000","last_unstale":"2024-06-02T22:32:56.681534+0000","last_undegraded":"2024-06-02T22:32:56.681534+0000","last_fullsized":"2024-06-02T22:32:56.681534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:32.586129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.638091+0000","last_change":"2024-06-02T22:31:20.753972+0000","last_active":"2024-06-02T22:32:56.638091+0000","last_peered":"2024-06-02T22:32:56.638091+0000","last_clean":"2024-06-02T22:32:56.638091+0000","last_became_active":"2024-06-02T22:31:20.753667+0000","last_became_peered":"2024-06-02T22:31:20.753667+0000","last_unstale":"2024-06-02T22:32:56.638091+0000","last_undegraded":"2024-06-02T22:32:56.638091+0000","last_fullsized":"2024-06-02T22:32:56.638091+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:32:59.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501495+0000","last_change":"2024-06-02T22:31:56.475364+0000","last_active":"2024-06-02T22:32:56.501495+0000","last_peered":"2024-06-02T22:32:56.501495+0000","last_clean":"2024-06-02T22:32:56.501495+0000","last_became_active":"2024-06-02T22:31:56.475086+0000","last_became_peered":"2024-06-02T22:31:56.475086+0000","last_unstale":"2024-06-02T22:32:56.501495+0000","last_undegraded":"2024-06-02T22:32:56.501495+0000","last_fullsized":"2024-06-02T22:32:56.501495+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:01:37.348839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511147+0000","last_change":"2024-06-02T22:31:20.748745+0000","last_active":"2024-06-02T22:32:56.511147+0000","last_peered":"2024-06-02T22:32:56.511147+0000","last_clean":"2024-06-02T22:32:56.511147+0000","last_became_active":"2024-06-02T22:31:20.747808+0000","last_became_peered":"2024-06-02T22:31:20.747808+0000","last_unstale":"2024-06-02T22:32:56.511147+0000","last_undegraded":"2024-06-02T22:32:56.511147+0000","last_fullsized":"2024-06-02T22:32:56.511147+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:29.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677586+0000","last_change":"2024-06-02T22:31:20.754184+0000","last_active":"2024-06-02T22:32:56.677586+0000","last_peered":"2024-06-02T22:32:56.677586+0000","last_clean":"2024-06-02T22:32:56.677586+0000","last_became_active":"2024-06-02T22:31:20.753691+0000","last_became_peered":"2024-06-02T22:31:20.753691+0000","last_unstale":"2024-06-02T22:32:56.677586+0000","last_undegraded":"2024-06-02T22:32:56.677586+0000","last_fullsized":"2024-06-02T22:32:56.677586+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:43.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684006+0000","last_change":"2024-06-02T22:31:56.478669+0000","last_active":"2024-06-02T22:32:56.684006+0000","last_peered":"2024-06-02T22:32:56.684006+0000","last_clean":"2024-06-02T22:32:56.684006+0000","last_became_active":"2024-06-02T22:31:56.476440+0000","last_became_peered":"2024-06-02T22:31:56.476440+0000","last_unstale":"2024-06-02T22:32:56.684006+0000","last_undegraded":"2024-06-02T22:32:56.684006+0000","last_fullsized":"2024-06-02T22:32:56.684006+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:17:08.753386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678873+0000","last_change":"2024-06-02T22:31:20.756993+0000","last_active":"2024-06-02T22:32:56.678873+0000","last_peered":"2024-06-02T22:32:56.678873+0000","last_clean":"2024-06-02T22:32:56.678873+0000","last_became_active":"2024-06-02T22:31:20.756518+0000","last_became_peered":"2024-06-02T22:31:20.756518+0000","last_unstale":"2024-06-02T22:32:56.678873+0000","last_undegraded":"2024-06-02T22:32:56.678873+0000","last_fullsized":"2024-06-02T22:32:56.678873+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:28.743386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678612+0000","last_change":"2024-06-02T22:31:20.760152+0000","last_active":"2024-06-02T22:32:56.678612+0000","last_peered":"2024-06-02T22:32:56.678612+0000","last_clean":"2024-06-02T22:32:56.678612+0000","last_became_active":"2024-06-02T22:31:20.759291+0000","last_became_peered":"2024-06-02T22:31:20.759291+0000","last_unstale":"2024-06-02T22:32:56.678612+0000","last_undegraded":"2024-06-02T22:32:56.678612+0000","last_fullsized":"2024-06-02T22:32:56.678612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:30.465537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637363+0000","last_change":"2024-06-02T22:31:20.766881+0000","last_active":"2024-06-02T22:32:56.637363+0000","last_peered":"2024-06-02T22:32:56.637363+0000","last_clean":"2024-06-02T22:32:56.637363+0000","last_became_active":"2024-06-02T22:31:20.766552+0000","last_became_peered":"2024-06-02T22:31:20.766552+0000","last_unstale":"2024-06-02T22:32:56.637363+0000","last_undegraded":"2024-06-02T22:32:56.637363+0000","last_fullsized":"2024-06-02T22:32:56.637363+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:58.133220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678350+0000","last_change":"2024-06-02T22:31:20.770370+0000","last_active":"2024-06-02T22:32:56.678350+0000","last_peered":"2024-06-02T22:32:56.678350+0000","last_clean":"2024-06-02T22:32:56.678350+0000","last_became_active":"2024-06-02T22:31:20.769938+0000","last_became_peered":"2024-06-02T22:31:20.769938+0000","last_unstale":"2024-06-02T22:32:56.678350+0000","last_undegraded":"2024-06-02T22:32:56.678350+0000","last_fullsized":"2024-06-02T22:32:56.678350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:59.835221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507277+0000","last_change":"2024-06-02T22:31:20.762933+0000","last_active":"2024-06-02T22:32:56.507277+0000","last_peered":"2024-06-02T22:32:56.507277+0000","last_clean":"2024-06-02T22:32:56.507277+0000","last_became_active":"2024-06-02T22:31:20.761598+0000","last_became_peered":"2024-06-02T22:31:20.761598+0000","last_unstale":"2024-06-02T22:32:56.507277+0000","last_undegraded":"2024-06-02T22:32:56.507277+0000","last_fullsized":"2024-06-02T22:32:56.507277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:25:45.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677628+0000","last_change":"2024-06-02T22:31:20.758974+0000","last_active":"2024-06-02T22:32:56.677628+0000","last_peered":"2024-06-02T22:32:56.677628+0000","last_clean":"2024-06-02T22:32:56.677628+0000","last_became_active":"2024-06-02T22:31:20.758583+0000","last_became_peered":"2024-06-02T22:31:20.758583+0000","last_unstale":"2024-06-02T22:32:56.677628+0000","last_undegraded":"2024-06-02T22:32:56.677628+0000","last_fullsized":"2024-06-02T22:32:56.677628+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:00.333362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677020+0000","last_change":"2024-06-02T22:31:33.865290+0000","last_active":"2024-06-02T22:32:56.677020+0000","last_peered":"2024-06-02T22:32:56.677020+0000","last_clean":"2024-06-02T22:32:56.677020+0000","last_became_active":"2024-06-02T22:31:33.864721+0000","last_became_peered":"2024-06-02T22:31:33.864721+0000","last_unstale":"2024-06-02T22:32:56.677020+0000","last_undegraded":"2024-06-02T22:32:56.677020+0000","last_fullsized":"2024-06-02T22:32:56.677020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:45.344953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"97'13","reported_seq":98,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:27.590028+0000","last_change":"2024-06-02T22:31:15.645169+0000","last_active":"2024-06-02T22:33:27.590028+0000","last_peered":"2024-06-02T22:33:27.590028+0000","last_clean":"2024-06-02T22:33:27.590028+0000","last_became_active":"2024-06-02T22:31:15.643956+0000","last_became_peered":"2024-06-02T22:31:15.643956+0000","last_unstale":"2024-06-02T22:33:27.590028+0000","last_undegraded":"2024-06-02T22:33:27.590028+0000","last_fullsized":"2024-06-02T22:33:27.590028+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:01.560086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681457+0000","last_change":"2024-06-02T22:31:20.759157+0000","last_active":"2024-06-02T22:32:56.681457+0000","last_peered":"2024-06-02T22:32:56.681457+0000","last_clean":"2024-06-02T22:32:56.681457+0000","last_became_active":"2024-06-02T22:31:20.758718+0000","last_became_peered":"2024-06-02T22:31:20.758718+0000","last_unstale":"2024-06-02T22:32:56.681457+0000","last_undegraded":"2024-06-02T22:32:56.681457+0000","last_fullsized":"2024-06-02T22:32:56.681457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:57.685311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677285+0000","last_change":"2024-06-02T22:31:55.989604+0000","last_active":"2024-06-02T22:32:56.677285+0000","last_peered":"2024-06-02T22:32:56.677285+0000","last_clean":"2024-06-02T22:32:56.677285+0000","last_became_active":"2024-06-02T22:31:55.989177+0000","last_became_peered":"2024-06-02T22:31:55.989177+0000","last_unstale":"2024-06-02T22:32:56.677285+0000","last_undegraded":"2024-06-02T22:32:56.677285+0000","last_fullsized":"2024-06-02T22:32:56.677285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:48:58.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681341+0000","last_change":"2024-06-02T22:31:15.845856+0000","last_active":"2024-06-02T22:32:56.681341+0000","last_peered":"2024-06-02T22:32:56.681341+0000","last_clean":"2024-06-02T22:32:56.681341+0000","last_became_active":"2024-06-02T22:31:15.845025+0000","last_became_peered":"2024-06-02T22:31:15.845025+0000","last_unstale":"2024-06-02T22:32:56.681341+0000","last_undegraded":"2024-06-02T22:32:56.681341+0000","last_fullsized":"2024-06-02T22:32:56.681341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:37.491987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679664+0000","last_change":"2024-06-02T22:31:20.767420+0000","last_active":"2024-06-02T22:32:56.679664+0000","last_peered":"2024-06-02T22:32:56.679664+0000","last_clean":"2024-06-02T22:32:56.679664+0000","last_became_active":"2024-06-02T22:31:20.766768+0000","last_became_peered":"2024-06-02T22:31:20.766768+0000","last_unstale":"2024-06-02T22:32:56.679664+0000","last_undegraded":"2024-06-02T22:32:56.679664+0000","last_fullsized":"2024-06-02T22:32:56.679664+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:20.829696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677385+0000","last_change":"2024-06-02T22:31:33.865917+0000","last_active":"2024-06-02T22:32:56.677385+0000","last_peered":"2024-06-02T22:32:56.677385+0000","last_clean":"2024-06-02T22:32:56.677385+0000","last_became_active":"2024-06-02T22:31:33.865466+0000","last_became_peered":"2024-06-02T22:31:33.865466+0000","last_unstale":"2024-06-02T22:32:56.677385+0000","last_undegraded":"2024-06-02T22:32:56.677385+0000","last_fullsized":"2024-06-02T22:32:56.677385+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:37.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'12","reported_seq":57,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497174+0000","last_change":"2024-06-02T22:31:15.639522+0000","last_active":"2024-06-02T22:32:56.497174+0000","last_peered":"2024-06-02T22:32:56.497174+0000","last_clean":"2024-06-02T22:32:56.497174+0000","last_became_active":"2024-06-02T22:31:15.639029+0000","last_became_peered":"2024-06-02T22:31:15.639029+0000","last_unstale":"2024-06-02T22:32:56.497174+0000","last_undegraded":"2024-06-02T22:32:56.497174+0000","last_fullsized":"2024-06-02T22:32:56.497174+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:29.388739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637653+0000","last_change":"2024-06-02T22:31:20.772370+0000","last_active":"2024-06-02T22:32:56.637653+0000","last_peered":"2024-06-02T22:32:56.637653+0000","last_clean":"2024-06-02T22:32:56.637653+0000","last_became_active":"2024-06-02T22:31:20.772041+0000","last_became_peered":"2024-06-02T22:31:20.772041+0000","last_unstale":"2024-06-02T22:32:56.637653+0000","last_undegraded":"2024-06-02T22:32:56.637653+0000","last_fullsized":"2024-06-02T22:32:56.637653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:27.518648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677355+0000","last_change":"2024-06-02T22:31:55.990609+0000","last_active":"2024-06-02T22:32:56.677355+0000","last_peered":"2024-06-02T22:32:56.677355+0000","last_clean":"2024-06-02T22:32:56.677355+0000","last_became_active":"2024-06-02T22:31:55.990075+0000","last_became_peered":"2024-06-02T22:31:55.990075+0000","last_unstale":"2024-06-02T22:32:56.677355+0000","last_undegraded":"2024-06-02T22:32:56.677355+0000","last_fullsized":"2024-06-02T22:32:56.677355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:55:52.836659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497203+0000","last_change":"2024-06-02T22:31:15.636472+0000","last_active":"2024-06-02T22:32:56.497203+0000","last_peered":"2024-06-02T22:32:56.497203+0000","last_clean":"2024-06-02T22:32:56.497203+0000","last_became_active":"2024-06-02T22:31:15.636078+0000","last_became_peered":"2024-06-02T22:31:15.636078+0000","last_unstale":"2024-06-02T22:32:56.497203+0000","last_undegraded":"2024-06-02T22:32:56.497203+0000","last_fullsized":"2024-06-02T22:32:56.497203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:18:35.318873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635374+0000","last_change":"2024-06-02T22:31:55.986887+0000","last_active":"2024-06-02T22:32:56.635374+0000","last_peered":"2024-06-02T22:32:56.635374+0000","last_clean":"2024-06-02T22:32:56.635374+0000","last_became_active":"2024-06-02T22:31:55.986468+0000","last_became_peered":"2024-06-02T22:31:55.986468+0000","last_unstale":"2024-06-02T22:32:56.635374+0000","last_undegraded":"2024-06-02T22:32:56.635374+0000","last_fullsized":"2024-06-02T22:32:56.635374+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:58:27.696250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677443+0000","last_change":"2024-06-02T22:31:33.847193+0000","last_active":"2024-06-02T22:32:56.677443+0000","last_peered":"2024-06-02T22:32:56.677443+0000","last_clean":"2024-06-02T22:32:56.677443+0000","last_became_active":"2024-06-02T22:31:33.845955+0000","last_became_peered":"2024-06-02T22:31:33.845955+0000","last_unstale":"2024-06-02T22:32:56.677443+0000","last_undegraded":"2024-06-02T22:32:56.677443+0000","last_fullsized":"2024-06-02T22:32:56.677443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:43.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'6","reported_seq":93,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:28.532264+0000","last_change":"2024-06-02T22:31:15.640589+0000","last_active":"2024-06-02T22:33:28.532264+0000","last_peered":"2024-06-02T22:33:28.532264+0000","last_clean":"2024-06-02T22:33:28.532264+0000","last_became_active":"2024-06-02T22:31:15.640216+0000","last_became_peered":"2024-06-02T22:31:15.640216+0000","last_unstale":"2024-06-02T22:33:28.532264+0000","last_undegraded":"2024-06-02T22:33:28.532264+0000","last_fullsized":"2024-06-02T22:33:28.532264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:40:02.375914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497148+0000","last_change":"2024-06-02T22:31:20.753879+0000","last_active":"2024-06-02T22:32:56.497148+0000","last_peered":"2024-06-02T22:32:56.497148+0000","last_clean":"2024-06-02T22:32:56.497148+0000","last_became_active":"2024-06-02T22:31:20.753528+0000","last_became_peered":"2024-06-02T22:31:20.753528+0000","last_unstale":"2024-06-02T22:32:56.497148+0000","last_undegraded":"2024-06-02T22:32:56.497148+0000","last_fullsized":"2024-06-02T22:32:56.497148+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:19.299178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677268+0000","last_change":"2024-06-02T22:31:33.858175+0000","last_active":"2024-06-02T22:32:56.677268+0000","last_peered":"2024-06-02T22:32:56.677268+0000","last_clean":"2024-06-02T22:32:56.677268+0000","last_became_active":"2024-06-02T22:31:33.857712+0000","last_became_peered":"2024-06-02T22:31:33.857712+0000","last_unstale":"2024-06-02T22:32:56.677268+0000","last_undegraded":"2024-06-02T22:32:56.677268+0000","last_fullsized":"2024-06-02T22:32:56.677268+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:30:01.632018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'7","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.500990+0000","last_change":"2024-06-02T22:31:15.639810+0000","last_active":"2024-06-02T22:32:56.500990+0000","last_peered":"2024-06-02T22:32:56.500990+0000","last_clean":"2024-06-02T22:32:56.500990+0000","last_became_active":"2024-06-02T22:31:15.639487+0000","last_became_peered":"2024-06-02T22:31:15.639487+0000","last_unstale":"2024-06-02T22:32:56.500990+0000","last_undegraded":"2024-06-02T22:32:56.500990+0000","last_fullsized":"2024-06-02T22:32:56.500990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:26:48.168636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635226+0000","last_change":"2024-06-02T22:31:20.771988+0000","last_active":"2024-06-02T22:32:56.635226+0000","last_peered":"2024-06-02T22:32:56.635226+0000","last_clean":"2024-06-02T22:32:56.635226+0000","last_became_active":"2024-06-02T22:31:20.771506+0000","last_became_peered":"2024-06-02T22:31:20.771506+0000","last_unstale":"2024-06-02T22:32:56.635226+0000","last_undegraded":"2024-06-02T22:32:56.635226+0000","last_fullsized":"2024-06-02T22:32:56.635226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:51:10.199149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678300+0000","last_change":"2024-06-02T22:31:33.861319+0000","last_active":"2024-06-02T22:32:56.678300+0000","last_peered":"2024-06-02T22:32:56.678300+0000","last_clean":"2024-06-02T22:32:56.678300+0000","last_became_active":"2024-06-02T22:31:33.860834+0000","last_became_peered":"2024-06-02T22:31:33.860834+0000","last_unstale":"2024-06-02T22:32:56.678300+0000","last_undegraded":"2024-06-02T22:32:56.678300+0000","last_fullsized":"2024-06-02T22:32:56.678300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:26.094118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'3","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681900+0000","last_change":"2024-06-02T22:31:15.645298+0000","last_active":"2024-06-02T22:32:56.681900+0000","last_peered":"2024-06-02T22:32:56.681900+0000","last_clean":"2024-06-02T22:32:56.681900+0000","last_became_active":"2024-06-02T22:31:15.643278+0000","last_became_peered":"2024-06-02T22:31:15.643278+0000","last_unstale":"2024-06-02T22:32:56.681900+0000","last_undegraded":"2024-06-02T22:32:56.681900+0000","last_fullsized":"2024-06-02T22:32:56.681900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:38:09.548519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681424+0000","last_change":"2024-06-02T22:31:20.769928+0000","last_active":"2024-06-02T22:32:56.681424+0000","last_peered":"2024-06-02T22:32:56.681424+0000","last_clean":"2024-06-02T22:32:56.681424+0000","last_became_active":"2024-06-02T22:31:20.769008+0000","last_became_peered":"2024-06-02T22:31:20.769008+0000","last_unstale":"2024-06-02T22:32:56.681424+0000","last_undegraded":"2024-06-02T22:32:56.681424+0000","last_fullsized":"2024-06-02T22:32:56.681424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:02.808992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679395+0000","last_change":"2024-06-02T22:31:33.869072+0000","last_active":"2024-06-02T22:32:56.679395+0000","last_peered":"2024-06-02T22:32:56.679395+0000","last_clean":"2024-06-02T22:32:56.679395+0000","last_became_active":"2024-06-02T22:31:33.868641+0000","last_became_peered":"2024-06-02T22:31:33.868641+0000","last_unstale":"2024-06-02T22:32:56.679395+0000","last_undegraded":"2024-06-02T22:32:56.679395+0000","last_fullsized":"2024-06-02T22:32:56.679395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:29.227798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634901+0000","last_change":"2024-06-02T22:31:15.637656+0000","last_active":"2024-06-02T22:32:56.634901+0000","last_peered":"2024-06-02T22:32:56.634901+0000","last_clean":"2024-06-02T22:32:56.634901+0000","last_became_active":"2024-06-02T22:31:15.637317+0000","last_became_peered":"2024-06-02T22:31:15.637317+0000","last_unstale":"2024-06-02T22:32:56.634901+0000","last_undegraded":"2024-06-02T22:32:56.634901+0000","last_fullsized":"2024-06-02T22:32:56.634901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:21.307766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.505055+0000","last_change":"2024-06-02T22:31:20.764811+0000","last_active":"2024-06-02T22:32:56.505055+0000","last_peered":"2024-06-02T22:32:56.505055+0000","last_clean":"2024-06-02T22:32:56.505055+0000","last_became_active":"2024-06-02T22:31:20.763605+0000","last_became_peered":"2024-06-02T22:31:20.763605+0000","last_unstale":"2024-06-02T22:32:56.505055+0000","last_undegraded":"2024-06-02T22:32:56.505055+0000","last_fullsized":"2024-06-02T22:32:56.505055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:57:24.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680062+0000","last_change":"2024-06-02T22:31:33.861450+0000","last_active":"2024-06-02T22:32:56.680062+0000","last_peered":"2024-06-02T22:32:56.680062+0000","last_clean":"2024-06-02T22:32:56.680062+0000","last_became_active":"2024-06-02T22:31:33.860933+0000","last_became_peered":"2024-06-02T22:31:33.860933+0000","last_unstale":"2024-06-02T22:32:56.680062+0000","last_undegraded":"2024-06-02T22:32:56.680062+0000","last_fullsized":"2024-06-02T22:32:56.680062+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:26.480320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"97'4","reported_seq":120,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:25.526862+0000","last_change":"2024-06-02T22:31:15.644469+0000","last_active":"2024-06-02T22:33:25.526862+0000","last_peered":"2024-06-02T22:33:25.526862+0000","last_clean":"2024-06-02T22:33:25.526862+0000","last_became_active":"2024-06-02T22:31:15.644115+0000","last_became_peered":"2024-06-02T22:31:15.644115+0000","last_unstale":"2024-06-02T22:33:25.526862+0000","last_undegraded":"2024-06-02T22:33:25.526862+0000","last_fullsized":"2024-06-02T22:33:25.526862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:44:49.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.638051+0000","last_change":"2024-06-02T22:31:20.752581+0000","last_active":"2024-06-02T22:32:56.638051+0000","last_peered":"2024-06-02T22:32:56.638051+0000","last_clean":"2024-06-02T22:32:56.638051+0000","last_became_active":"2024-06-02T22:31:20.752102+0000","last_became_peered":"2024-06-02T22:31:20.752102+0000","last_unstale":"2024-06-02T22:32:56.638051+0000","last_undegraded":"2024-06-02T22:32:56.638051+0000","last_fullsized":"2024-06-02T22:32:56.638051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:57.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.504523+0000","last_change":"2024-06-02T22:31:33.860102+0000","last_active":"2024-06-02T22:32:56.504523+0000","last_peered":"2024-06-02T22:32:56.504523+0000","last_clean":"2024-06-02T22:32:56.504523+0000","last_became_active":"2024-06-02T22:31:33.859689+0000","last_became_peered":"2024-06-02T22:31:33.859689+0000","last_unstale":"2024-06-02T22:32:56.504523+0000","last_undegraded":"2024-06-02T22:32:56.504523+0000","last_fullsized":"2024-06-02T22:32:56.504523+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:36.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'4","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511202+0000","last_change":"2024-06-02T22:31:15.636548+0000","last_active":"2024-06-02T22:32:56.511202+0000","last_peered":"2024-06-02T22:32:56.511202+0000","last_clean":"2024-06-02T22:32:56.511202+0000","last_became_active":"2024-06-02T22:31:15.636097+0000","last_became_peered":"2024-06-02T22:31:15.636097+0000","last_unstale":"2024-06-02T22:32:56.511202+0000","last_undegraded":"2024-06-02T22:32:56.511202+0000","last_fullsized":"2024-06-02T22:32:56.511202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:26:04.280465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679756+0000","last_change":"2024-06-02T22:31:20.760290+0000","last_active":"2024-06-02T22:32:56.679756+0000","last_peered":"2024-06-02T22:32:56.679756+0000","last_clean":"2024-06-02T22:32:56.679756+0000","last_became_active":"2024-06-02T22:31:20.759678+0000","last_became_peered":"2024-06-02T22:31:20.759678+0000","last_unstale":"2024-06-02T22:32:56.679756+0000","last_undegraded":"2024-06-02T22:32:56.679756+0000","last_fullsized":"2024-06-02T22:32:56.679756+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:46.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677580+0000","last_change":"2024-06-02T22:31:33.865919+0000","last_active":"2024-06-02T22:32:56.677580+0000","last_peered":"2024-06-02T22:32:56.677580+0000","last_clean":"2024-06-02T22:32:56.677580+0000","last_became_active":"2024-06-02T22:31:33.865396+0000","last_became_peered":"2024-06-02T22:31:33.865396+0000","last_unstale":"2024-06-02T22:32:56.677580+0000","last_undegraded":"2024-06-02T22:32:56.677580+0000","last_fullsized":"2024-06-02T22:32:56.677580+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:06:09.238985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635320+0000","last_change":"2024-06-02T22:31:15.847154+0000","last_active":"2024-06-02T22:32:56.635320+0000","last_peered":"2024-06-02T22:32:56.635320+0000","last_clean":"2024-06-02T22:32:56.635320+0000","last_became_active":"2024-06-02T22:31:15.846743+0000","last_became_peered":"2024-06-02T22:31:15.846743+0000","last_unstale":"2024-06-02T22:32:56.635320+0000","last_undegraded":"2024-06-02T22:32:56.635320+0000","last_fullsized":"2024-06-02T22:32:56.635320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:00.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637730+0000","last_change":"2024-06-02T22:31:20.748926+0000","last_active":"2024-06-02T22:32:56.637730+0000","last_peered":"2024-06-02T22:32:56.637730+0000","last_clean":"2024-06-02T22:32:56.637730+0000","last_became_active":"2024-06-02T22:31:20.748588+0000","last_became_peered":"2024-06-02T22:31:20.748588+0000","last_unstale":"2024-06-02T22:32:56.637730+0000","last_undegraded":"2024-06-02T22:32:56.637730+0000","last_fullsized":"2024-06-02T22:32:56.637730+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:26:09.876916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.505993+0000","last_change":"2024-06-02T22:31:33.859876+0000","last_active":"2024-06-02T22:32:56.505993+0000","last_peered":"2024-06-02T22:32:56.505993+0000","last_clean":"2024-06-02T22:32:56.505993+0000","last_became_active":"2024-06-02T22:31:33.856511+0000","last_became_peered":"2024-06-02T22:31:33.856511+0000","last_unstale":"2024-06-02T22:32:56.505993+0000","last_undegraded":"2024-06-02T22:32:56.505993+0000","last_fullsized":"2024-06-02T22:32:56.505993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:00.255066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'35","reported_seq":176,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:25.528002+0000","last_change":"2024-06-02T22:31:55.992340+0000","last_active":"2024-06-02T22:33:25.528002+0000","last_peered":"2024-06-02T22:33:25.528002+0000","last_clean":"2024-06-02T22:33:25.528002+0000","last_became_active":"2024-06-02T22:31:55.984100+0000","last_became_peered":"2024-06-02T22:31:55.984100+0000","last_unstale":"2024-06-02T22:33:25.528002+0000","last_undegraded":"2024-06-02T22:33:25.528002+0000","last_fullsized":"2024-06-02T22:33:25.528002+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:40.557506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":100,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497374+0000","last_change":"2024-06-02T22:31:20.755532+0000","last_active":"2024-06-02T22:32:56.497374+0000","last_peered":"2024-06-02T22:32:56.497374+0000","last_clean":"2024-06-02T22:32:56.497374+0000","last_became_active":"2024-06-02T22:31:20.755186+0000","last_became_peered":"2024-06-02T22:31:20.755186+0000","last_unstale":"2024-06-02T22:32:56.497374+0000","last_undegraded":"2024-06-02T22:32:56.497374+0000","last_fullsized":"2024-06-02T22:32:56.497374+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:24.459712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635570+0000","last_change":"2024-06-02T22:31:33.864513+0000","last_active":"2024-06-02T22:32:56.635570+0000","last_peered":"2024-06-02T22:32:56.635570+0000","last_clean":"2024-06-02T22:32:56.635570+0000","last_became_active":"2024-06-02T22:31:33.864009+0000","last_became_peered":"2024-06-02T22:31:33.864009+0000","last_unstale":"2024-06-02T22:32:56.635570+0000","last_undegraded":"2024-06-02T22:32:56.635570+0000","last_fullsized":"2024-06-02T22:32:56.635570+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:36:14.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'9","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678047+0000","last_change":"2024-06-02T22:31:55.994602+0000","last_active":"2024-06-02T22:32:56.678047+0000","last_peered":"2024-06-02T22:32:56.678047+0000","last_clean":"2024-06-02T22:32:56.678047+0000","last_became_active":"2024-06-02T22:31:55.989825+0000","last_became_peered":"2024-06-02T22:31:55.989825+0000","last_unstale":"2024-06-02T22:32:56.678047+0000","last_undegraded":"2024-06-02T22:32:56.678047+0000","last_fullsized":"2024-06-02T22:32:56.678047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:20:50.155888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683366+0000","last_change":"2024-06-02T22:31:20.777927+0000","last_active":"2024-06-02T22:32:56.683366+0000","last_peered":"2024-06-02T22:32:56.683366+0000","last_clean":"2024-06-02T22:32:56.683366+0000","last_became_active":"2024-06-02T22:31:20.777609+0000","last_became_peered":"2024-06-02T22:31:20.777609+0000","last_unstale":"2024-06-02T22:32:56.683366+0000","last_undegraded":"2024-06-02T22:32:56.683366+0000","last_fullsized":"2024-06-02T22:32:56.683366+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:07.396916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677770+0000","last_change":"2024-06-02T22:31:33.861447+0000","last_active":"2024-06-02T22:32:56.677770+0000","last_peered":"2024-06-02T22:32:56.677770+0000","last_clean":"2024-06-02T22:32:56.677770+0000","last_became_active":"2024-06-02T22:31:33.860836+0000","last_became_peered":"2024-06-02T22:31:33.860836+0000","last_unstale":"2024-06-02T22:32:56.677770+0000","last_undegraded":"2024-06-02T22:32:56.677770+0000","last_fullsized":"2024-06-02T22:32:56.677770+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:21.297872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635095+0000","last_change":"2024-06-02T22:31:15.644306+0000","last_active":"2024-06-02T22:32:56.635095+0000","last_peered":"2024-06-02T22:32:56.635095+0000","last_clean":"2024-06-02T22:32:56.635095+0000","last_became_active":"2024-06-02T22:31:15.643741+0000","last_became_peered":"2024-06-02T22:31:15.643741+0000","last_unstale":"2024-06-02T22:32:56.635095+0000","last_undegraded":"2024-06-02T22:32:56.635095+0000","last_fullsized":"2024-06-02T22:32:56.635095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:53.161633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510819+0000","last_change":"2024-06-02T22:31:20.751551+0000","last_active":"2024-06-02T22:32:56.510819+0000","last_peered":"2024-06-02T22:32:56.510819+0000","last_clean":"2024-06-02T22:32:56.510819+0000","last_became_active":"2024-06-02T22:31:20.751002+0000","last_became_peered":"2024-06-02T22:31:20.751002+0000","last_unstale":"2024-06-02T22:32:56.510819+0000","last_undegraded":"2024-06-02T22:32:56.510819+0000","last_fullsized":"2024-06-02T22:32:56.510819+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:40:18.201325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507105+0000","last_change":"2024-06-02T22:31:33.871515+0000","last_active":"2024-06-02T22:32:56.507105+0000","last_peered":"2024-06-02T22:32:56.507105+0000","last_clean":"2024-06-02T22:32:56.507105+0000","last_became_active":"2024-06-02T22:31:33.870756+0000","last_became_peered":"2024-06-02T22:31:33.870756+0000","last_unstale":"2024-06-02T22:32:56.507105+0000","last_undegraded":"2024-06-02T22:32:56.507105+0000","last_fullsized":"2024-06-02T22:32:56.507105+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:12:31.109559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'5","reported_seq":87,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:24.537015+0000","last_change":"2024-06-02T22:31:15.638139+0000","last_active":"2024-06-02T22:33:24.537015+0000","last_peered":"2024-06-02T22:33:24.537015+0000","last_clean":"2024-06-02T22:33:24.537015+0000","last_became_active":"2024-06-02T22:31:15.636635+0000","last_became_peered":"2024-06-02T22:31:15.636635+0000","last_unstale":"2024-06-02T22:33:24.537015+0000","last_undegraded":"2024-06-02T22:33:24.537015+0000","last_fullsized":"2024-06-02T22:33:24.537015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:07.195137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510825+0000","last_change":"2024-06-02T22:31:20.745347+0000","last_active":"2024-06-02T22:32:56.510825+0000","last_peered":"2024-06-02T22:32:56.510825+0000","last_clean":"2024-06-02T22:32:56.510825+0000","last_became_active":"2024-06-02T22:31:20.744990+0000","last_became_peered":"2024-06-02T22:31:20.744990+0000","last_unstale":"2024-06-02T22:32:56.510825+0000","last_undegraded":"2024-06-02T22:32:56.510825+0000","last_fullsized":"2024-06-02T22:32:56.510825+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:20.215740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684289+0000","last_change":"2024-06-02T22:31:33.866261+0000","last_active":"2024-06-02T22:32:56.684289+0000","last_peered":"2024-06-02T22:32:56.684289+0000","last_clean":"2024-06-02T22:32:56.684289+0000","last_became_active":"2024-06-02T22:31:33.865863+0000","last_became_peered":"2024-06-02T22:31:33.865863+0000","last_unstale":"2024-06-02T22:32:56.684289+0000","last_undegraded":"2024-06-02T22:32:56.684289+0000","last_fullsized":"2024-06-02T22:32:56.684289+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:00:41.670289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'17","reported_seq":62,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496774+0000","last_change":"2024-06-02T22:31:15.848282+0000","last_active":"2024-06-02T22:32:56.496774+0000","last_peered":"2024-06-02T22:32:56.496774+0000","last_clean":"2024-06-02T22:32:56.496774+0000","last_became_active":"2024-06-02T22:31:15.847846+0000","last_became_peered":"2024-06-02T22:31:15.847846+0000","last_unstale":"2024-06-02T22:32:56.496774+0000","last_undegraded":"2024-06-02T22:32:56.496774+0000","last_fullsized":"2024-06-02T22:32:56.496774+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:09:12.971908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635018+0000","last_change":"2024-06-02T22:31:20.756682+0000","last_active":"2024-06-02T22:32:56.635018+0000","last_peered":"2024-06-02T22:32:56.635018+0000","last_clean":"2024-06-02T22:32:56.635018+0000","last_became_active":"2024-06-02T22:31:20.756357+0000","last_became_peered":"2024-06-02T22:31:20.756357+0000","last_unstale":"2024-06-02T22:32:56.635018+0000","last_undegraded":"2024-06-02T22:32:56.635018+0000","last_fullsized":"2024-06-02T22:32:56.635018+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:39:53.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634928+0000","last_change":"2024-06-02T22:31:33.858267+0000","last_active":"2024-06-02T22:32:56.634928+0000","last_peered":"2024-06-02T22:32:56.634928+0000","last_clean":"2024-06-02T22:32:56.634928+0000","last_became_active":"2024-06-02T22:31:33.857784+0000","last_became_peered":"2024-06-02T22:31:33.857784+0000","last_unstale":"2024-06-02T22:32:56.634928+0000","last_undegraded":"2024-06-02T22:32:56.634928+0000","last_fullsized":"2024-06-02T22:32:56.634928+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:07:11.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497354+0000","last_change":"2024-06-02T22:31:15.637328+0000","last_active":"2024-06-02T22:32:56.497354+0000","last_peered":"2024-06-02T22:32:56.497354+0000","last_clean":"2024-06-02T22:32:56.497354+0000","last_became_active":"2024-06-02T22:31:15.636933+0000","last_became_peered":"2024-06-02T22:31:15.636933+0000","last_unstale":"2024-06-02T22:32:56.497354+0000","last_undegraded":"2024-06-02T22:32:56.497354+0000","last_fullsized":"2024-06-02T22:32:56.497354+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:12:40.358884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678268+0000","last_change":"2024-06-02T22:31:20.752471+0000","last_active":"2024-06-02T22:32:56.678268+0000","last_peered":"2024-06-02T22:32:56.678268+0000","last_clean":"2024-06-02T22:32:56.678268+0000","last_became_active":"2024-06-02T22:31:20.750450+0000","last_became_peered":"2024-06-02T22:31:20.750450+0000","last_unstale":"2024-06-02T22:32:56.678268+0000","last_undegraded":"2024-06-02T22:32:56.678268+0000","last_fullsized":"2024-06-02T22:32:56.678268+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:26:21.467156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497270+0000","last_change":"2024-06-02T22:31:55.984989+0000","last_active":"2024-06-02T22:32:56.497270+0000","last_peered":"2024-06-02T22:32:56.497270+0000","last_clean":"2024-06-02T22:32:56.497270+0000","last_became_active":"2024-06-02T22:31:55.984481+0000","last_became_peered":"2024-06-02T22:31:55.984481+0000","last_unstale":"2024-06-02T22:32:56.497270+0000","last_undegraded":"2024-06-02T22:32:56.497270+0000","last_fullsized":"2024-06-02T22:32:56.497270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:12.087792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506536+0000","last_change":"2024-06-02T22:31:15.849517+0000","last_active":"2024-06-02T22:32:56.506536+0000","last_peered":"2024-06-02T22:32:56.506536+0000","last_clean":"2024-06-02T22:32:56.506536+0000","last_became_active":"2024-06-02T22:31:15.849092+0000","last_became_peered":"2024-06-02T22:31:15.849092+0000","last_unstale":"2024-06-02T22:32:56.506536+0000","last_undegraded":"2024-06-02T22:32:56.506536+0000","last_fullsized":"2024-06-02T22:32:56.506536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:50.722007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501092+0000","last_change":"2024-06-02T22:31:20.768944+0000","last_active":"2024-06-02T22:32:56.501092+0000","last_peered":"2024-06-02T22:32:56.501092+0000","last_clean":"2024-06-02T22:32:56.501092+0000","last_became_active":"2024-06-02T22:31:20.768275+0000","last_became_peered":"2024-06-02T22:31:20.768275+0000","last_unstale":"2024-06-02T22:32:56.501092+0000","last_undegraded":"2024-06-02T22:32:56.501092+0000","last_fullsized":"2024-06-02T22:32:56.501092+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:05.760188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684043+0000","last_change":"2024-06-02T22:31:33.860760+0000","last_active":"2024-06-02T22:32:56.684043+0000","last_peered":"2024-06-02T22:32:56.684043+0000","last_clean":"2024-06-02T22:32:56.684043+0000","last_became_active":"2024-06-02T22:31:33.860203+0000","last_became_peered":"2024-06-02T22:31:33.860203+0000","last_unstale":"2024-06-02T22:32:56.684043+0000","last_undegraded":"2024-06-02T22:32:56.684043+0000","last_fullsized":"2024-06-02T22:32:56.684043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:59:22.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"99'6","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:25.587202+0000","last_change":"2024-06-02T22:31:15.640274+0000","last_active":"2024-06-02T22:33:25.587202+0000","last_peered":"2024-06-02T22:33:25.587202+0000","last_clean":"2024-06-02T22:33:25.587202+0000","last_became_active":"2024-06-02T22:31:15.639879+0000","last_became_peered":"2024-06-02T22:31:15.639879+0000","last_unstale":"2024-06-02T22:33:25.587202+0000","last_undegraded":"2024-06-02T22:33:25.587202+0000","last_fullsized":"2024-06-02T22:33:25.587202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:51:37.947343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501029+0000","last_change":"2024-06-02T22:31:20.767645+0000","last_active":"2024-06-02T22:32:56.501029+0000","last_peered":"2024-06-02T22:32:56.501029+0000","last_clean":"2024-06-02T22:32:56.501029+0000","last_became_active":"2024-06-02T22:31:20.767290+0000","last_became_peered":"2024-06-02T22:31:20.767290+0000","last_unstale":"2024-06-02T22:32:56.501029+0000","last_undegraded":"2024-06-02T22:32:56.501029+0000","last_fullsized":"2024-06-02T22:32:56.501029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:48:10.989940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684361+0000","last_change":"2024-06-02T22:31:34.188667+0000","last_active":"2024-06-02T22:32:56.684361+0000","last_peered":"2024-06-02T22:32:56.684361+0000","last_clean":"2024-06-02T22:32:56.684361+0000","last_became_active":"2024-06-02T22:31:34.187865+0000","last_became_peered":"2024-06-02T22:31:34.187865+0000","last_unstale":"2024-06-02T22:32:56.684361+0000","last_undegraded":"2024-06-02T22:32:56.684361+0000","last_fullsized":"2024-06-02T22:32:56.684361+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:48.544150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635296+0000","last_change":"2024-06-02T22:31:20.755881+0000","last_active":"2024-06-02T22:32:56.635296+0000","last_peered":"2024-06-02T22:32:56.635296+0000","last_clean":"2024-06-02T22:32:56.635296+0000","last_became_active":"2024-06-02T22:31:20.755481+0000","last_became_peered":"2024-06-02T22:31:20.755481+0000","last_unstale":"2024-06-02T22:32:56.635296+0000","last_undegraded":"2024-06-02T22:32:56.635296+0000","last_fullsized":"2024-06-02T22:32:56.635296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:10:33.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'5","reported_seq":87,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:24.536226+0000","last_change":"2024-06-02T22:31:15.846057+0000","last_active":"2024-06-02T22:33:24.536226+0000","last_peered":"2024-06-02T22:33:24.536226+0000","last_clean":"2024-06-02T22:33:24.536226+0000","last_became_active":"2024-06-02T22:31:15.845097+0000","last_became_peered":"2024-06-02T22:31:15.845097+0000","last_unstale":"2024-06-02T22:33:24.536226+0000","last_undegraded":"2024-06-02T22:33:24.536226+0000","last_fullsized":"2024-06-02T22:33:24.536226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:22:23.481235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511084+0000","last_change":"2024-06-02T22:31:33.858499+0000","last_active":"2024-06-02T22:32:56.511084+0000","last_peered":"2024-06-02T22:32:56.511084+0000","last_clean":"2024-06-02T22:32:56.511084+0000","last_became_active":"2024-06-02T22:31:33.857914+0000","last_became_peered":"2024-06-02T22:31:33.857914+0000","last_unstale":"2024-06-02T22:32:56.511084+0000","last_undegraded":"2024-06-02T22:32:56.511084+0000","last_fullsized":"2024-06-02T22:32:56.511084+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:50:09.743015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680445+0000","last_change":"2024-06-02T22:31:20.763011+0000","last_active":"2024-06-02T22:32:56.680445+0000","last_peered":"2024-06-02T22:32:56.680445+0000","last_clean":"2024-06-02T22:32:56.680445+0000","last_became_active":"2024-06-02T22:31:20.759450+0000","last_became_peered":"2024-06-02T22:31:20.759450+0000","last_unstale":"2024-06-02T22:32:56.680445+0000","last_undegraded":"2024-06-02T22:32:56.680445+0000","last_fullsized":"2024-06-02T22:32:56.680445+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:08:24.748321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'6","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:15.642691+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:15.642313+0000","last_became_peered":"2024-06-02T22:31:15.642313+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:34:32.329387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":367,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510569+0000","last_change":"2024-06-02T22:29:39.376514+0000","last_active":"2024-06-02T22:32:56.510569+0000","last_peered":"2024-06-02T22:32:56.510569+0000","last_clean":"2024-06-02T22:32:56.510569+0000","last_became_active":"2024-06-02T22:29:39.376061+0000","last_became_peered":"2024-06-02T22:29:39.376061+0000","last_unstale":"2024-06-02T22:32:56.510569+0000","last_undegraded":"2024-06-02T22:32:56.510569+0000","last_fullsized":"2024-06-02T22:32:56.510569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_clean_scrub_stamp":"2024-06-02T22:25:41.060756+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:26:05.799761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635409+0000","last_change":"2024-06-02T22:31:34.189204+0000","last_active":"2024-06-02T22:32:56.635409+0000","last_peered":"2024-06-02T22:32:56.635409+0000","last_clean":"2024-06-02T22:32:56.635409+0000","last_became_active":"2024-06-02T22:31:34.188639+0000","last_became_peered":"2024-06-02T22:31:34.188639+0000","last_unstale":"2024-06-02T22:32:56.635409+0000","last_undegraded":"2024-06-02T22:32:56.635409+0000","last_fullsized":"2024-06-02T22:32:56.635409+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:03:37.983874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681771+0000","last_change":"2024-06-02T22:31:20.768724+0000","last_active":"2024-06-02T22:32:56.681771+0000","last_peered":"2024-06-02T22:32:56.681771+0000","last_clean":"2024-06-02T22:32:56.681771+0000","last_became_active":"2024-06-02T22:31:20.768328+0000","last_became_peered":"2024-06-02T22:31:20.768328+0000","last_unstale":"2024-06-02T22:32:56.681771+0000","last_undegraded":"2024-06-02T22:32:56.681771+0000","last_fullsized":"2024-06-02T22:32:56.681771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:48.993951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510775+0000","last_change":"2024-06-02T22:31:15.637109+0000","last_active":"2024-06-02T22:32:56.510775+0000","last_peered":"2024-06-02T22:32:56.510775+0000","last_clean":"2024-06-02T22:32:56.510775+0000","last_became_active":"2024-06-02T22:31:15.636511+0000","last_became_peered":"2024-06-02T22:31:15.636511+0000","last_unstale":"2024-06-02T22:32:56.510775+0000","last_undegraded":"2024-06-02T22:32:56.510775+0000","last_fullsized":"2024-06-02T22:32:56.510775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:11:15.838242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678133+0000","last_change":"2024-06-02T22:31:33.861118+0000","last_active":"2024-06-02T22:32:56.678133+0000","last_peered":"2024-06-02T22:32:56.678133+0000","last_clean":"2024-06-02T22:32:56.678133+0000","last_became_active":"2024-06-02T22:31:33.860622+0000","last_became_peered":"2024-06-02T22:31:33.860622+0000","last_unstale":"2024-06-02T22:32:56.678133+0000","last_undegraded":"2024-06-02T22:32:56.678133+0000","last_fullsized":"2024-06-02T22:32:56.678133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:14.052151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'4","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678270+0000","last_change":"2024-06-02T22:31:56.477226+0000","last_active":"2024-06-02T22:32:56.678270+0000","last_peered":"2024-06-02T22:32:56.678270+0000","last_clean":"2024-06-02T22:32:56.678270+0000","last_became_active":"2024-06-02T22:31:56.476839+0000","last_became_peered":"2024-06-02T22:31:56.476839+0000","last_unstale":"2024-06-02T22:32:56.678270+0000","last_undegraded":"2024-06-02T22:32:56.678270+0000","last_fullsized":"2024-06-02T22:32:56.678270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:12.233878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684199+0000","last_change":"2024-06-02T22:31:20.771984+0000","last_active":"2024-06-02T22:32:56.684199+0000","last_peered":"2024-06-02T22:32:56.684199+0000","last_clean":"2024-06-02T22:32:56.684199+0000","last_became_active":"2024-06-02T22:31:20.771524+0000","last_became_peered":"2024-06-02T22:31:20.771524+0000","last_unstale":"2024-06-02T22:32:56.684199+0000","last_undegraded":"2024-06-02T22:32:56.684199+0000","last_fullsized":"2024-06-02T22:32:56.684199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:13:25.590377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681290+0000","last_change":"2024-06-02T22:31:34.188564+0000","last_active":"2024-06-02T22:32:56.681290+0000","last_peered":"2024-06-02T22:32:56.681290+0000","last_clean":"2024-06-02T22:32:56.681290+0000","last_became_active":"2024-06-02T22:31:34.187631+0000","last_became_peered":"2024-06-02T22:31:34.187631+0000","last_unstale":"2024-06-02T22:32:56.681290+0000","last_undegraded":"2024-06-02T22:32:56.681290+0000","last_fullsized":"2024-06-02T22:32:56.681290+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:23:35.572300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:21.789279+0000","last_change":"2024-06-02T22:31:15.648073+0000","last_active":"2024-06-02T22:33:21.789279+0000","last_peered":"2024-06-02T22:33:21.789279+0000","last_clean":"2024-06-02T22:33:21.789279+0000","last_became_active":"2024-06-02T22:31:15.647573+0000","last_became_peered":"2024-06-02T22:31:15.647573+0000","last_unstale":"2024-06-02T22:33:21.789279+0000","last_undegraded":"2024-06-02T22:33:21.789279+0000","last_fullsized":"2024-06-02T22:33:21.789279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:58.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681095+0000","last_change":"2024-06-02T22:31:20.764750+0000","last_active":"2024-06-02T22:32:56.681095+0000","last_peered":"2024-06-02T22:32:56.681095+0000","last_clean":"2024-06-02T22:32:56.681095+0000","last_became_active":"2024-06-02T22:31:20.763025+0000","last_became_peered":"2024-06-02T22:31:20.763025+0000","last_unstale":"2024-06-02T22:32:56.681095+0000","last_undegraded":"2024-06-02T22:32:56.681095+0000","last_fullsized":"2024-06-02T22:32:56.681095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677020+0000","last_change":"2024-06-02T22:31:33.845885+0000","last_active":"2024-06-02T22:32:56.677020+0000","last_peered":"2024-06-02T22:32:56.677020+0000","last_clean":"2024-06-02T22:32:56.677020+0000","last_became_active":"2024-06-02T22:31:33.845076+0000","last_became_peered":"2024-06-02T22:31:33.845076+0000","last_unstale":"2024-06-02T22:32:56.677020+0000","last_undegraded":"2024-06-02T22:32:56.677020+0000","last_fullsized":"2024-06-02T22:32:56.677020+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:28:32.849389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'7","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677923+0000","last_change":"2024-06-02T22:31:16.009742+0000","last_active":"2024-06-02T22:32:56.677923+0000","last_peered":"2024-06-02T22:32:56.677923+0000","last_clean":"2024-06-02T22:32:56.677923+0000","last_became_active":"2024-06-02T22:31:16.009462+0000","last_became_peered":"2024-06-02T22:31:16.009462+0000","last_unstale":"2024-06-02T22:32:56.677923+0000","last_undegraded":"2024-06-02T22:32:56.677923+0000","last_fullsized":"2024-06-02T22:32:56.677923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:57.963782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679525+0000","last_change":"2024-06-02T22:31:20.779344+0000","last_active":"2024-06-02T22:32:56.679525+0000","last_peered":"2024-06-02T22:32:56.679525+0000","last_clean":"2024-06-02T22:32:56.679525+0000","last_became_active":"2024-06-02T22:31:20.778586+0000","last_became_peered":"2024-06-02T22:31:20.778586+0000","last_unstale":"2024-06-02T22:32:56.679525+0000","last_undegraded":"2024-06-02T22:32:56.679525+0000","last_fullsized":"2024-06-02T22:32:56.679525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:55:01.213401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677655+0000","last_change":"2024-06-02T22:31:55.986536+0000","last_active":"2024-06-02T22:32:56.677655+0000","last_peered":"2024-06-02T22:32:56.677655+0000","last_clean":"2024-06-02T22:32:56.677655+0000","last_became_active":"2024-06-02T22:31:55.985958+0000","last_became_peered":"2024-06-02T22:31:55.985958+0000","last_unstale":"2024-06-02T22:32:56.677655+0000","last_undegraded":"2024-06-02T22:32:56.677655+0000","last_fullsized":"2024-06-02T22:32:56.677655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:02:13.317010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637545+0000","last_change":"2024-06-02T22:31:15.844475+0000","last_active":"2024-06-02T22:32:56.637545+0000","last_peered":"2024-06-02T22:32:56.637545+0000","last_clean":"2024-06-02T22:32:56.637545+0000","last_became_active":"2024-06-02T22:31:15.844135+0000","last_became_peered":"2024-06-02T22:31:15.844135+0000","last_unstale":"2024-06-02T22:32:56.637545+0000","last_undegraded":"2024-06-02T22:32:56.637545+0000","last_fullsized":"2024-06-02T22:32:56.637545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:44:29.127186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496808+0000","last_change":"2024-06-02T22:31:20.752005+0000","last_active":"2024-06-02T22:32:56.496808+0000","last_peered":"2024-06-02T22:32:56.496808+0000","last_clean":"2024-06-02T22:32:56.496808+0000","last_became_active":"2024-06-02T22:31:20.751525+0000","last_became_peered":"2024-06-02T22:31:20.751525+0000","last_unstale":"2024-06-02T22:32:56.496808+0000","last_undegraded":"2024-06-02T22:32:56.496808+0000","last_fullsized":"2024-06-02T22:32:56.496808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:08:35.477470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507177+0000","last_change":"2024-06-02T22:31:33.870374+0000","last_active":"2024-06-02T22:32:56.507177+0000","last_peered":"2024-06-02T22:32:56.507177+0000","last_clean":"2024-06-02T22:32:56.507177+0000","last_became_active":"2024-06-02T22:31:33.869931+0000","last_became_peered":"2024-06-02T22:31:33.869931+0000","last_unstale":"2024-06-02T22:32:56.507177+0000","last_undegraded":"2024-06-02T22:32:56.507177+0000","last_fullsized":"2024-06-02T22:32:56.507177+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:33:11.209183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680278+0000","last_change":"2024-06-02T22:31:15.645570+0000","last_active":"2024-06-02T22:32:56.680278+0000","last_peered":"2024-06-02T22:32:56.680278+0000","last_clean":"2024-06-02T22:32:56.680278+0000","last_became_active":"2024-06-02T22:31:15.645124+0000","last_became_peered":"2024-06-02T22:31:15.645124+0000","last_unstale":"2024-06-02T22:32:56.680278+0000","last_undegraded":"2024-06-02T22:32:56.680278+0000","last_fullsized":"2024-06-02T22:32:56.680278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:11:56.956942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:20.758501+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:20.758097+0000","last_became_peered":"2024-06-02T22:31:20.758097+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:47.523600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677871+0000","last_change":"2024-06-02T22:31:33.858463+0000","last_active":"2024-06-02T22:32:56.677871+0000","last_peered":"2024-06-02T22:32:56.677871+0000","last_clean":"2024-06-02T22:32:56.677871+0000","last_became_active":"2024-06-02T22:31:33.858001+0000","last_became_peered":"2024-06-02T22:31:33.858001+0000","last_unstale":"2024-06-02T22:32:56.677871+0000","last_undegraded":"2024-06-02T22:32:56.677871+0000","last_fullsized":"2024-06-02T22:32:56.677871+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:50.797150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677176+0000","last_change":"2024-06-02T22:31:15.644144+0000","last_active":"2024-06-02T22:32:56.677176+0000","last_peered":"2024-06-02T22:32:56.677176+0000","last_clean":"2024-06-02T22:32:56.677176+0000","last_became_active":"2024-06-02T22:31:15.643629+0000","last_became_peered":"2024-06-02T22:31:15.643629+0000","last_unstale":"2024-06-02T22:32:56.677176+0000","last_undegraded":"2024-06-02T22:32:56.677176+0000","last_fullsized":"2024-06-02T22:32:56.677176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:45:36.491134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683235+0000","last_change":"2024-06-02T22:32:56.681729+0000","last_active":"2024-06-02T22:32:56.683235+0000","last_peered":"2024-06-02T22:32:56.683235+0000","last_clean":"2024-06-02T22:32:56.683235+0000","last_became_active":"2024-06-02T22:32:56.680934+0000","last_became_peered":"2024-06-02T22:32:56.680934+0000","last_unstale":"2024-06-02T22:32:56.683235+0000","last_undegraded":"2024-06-02T22:32:56.683235+0000","last_fullsized":"2024-06-02T22:32:56.683235+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:02.046940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677677+0000","last_change":"2024-06-02T22:31:34.187743+0000","last_active":"2024-06-02T22:32:56.677677+0000","last_peered":"2024-06-02T22:32:56.677677+0000","last_clean":"2024-06-02T22:32:56.677677+0000","last_became_active":"2024-06-02T22:31:34.187241+0000","last_became_peered":"2024-06-02T22:31:34.187241+0000","last_unstale":"2024-06-02T22:32:56.677677+0000","last_undegraded":"2024-06-02T22:32:56.677677+0000","last_fullsized":"2024-06-02T22:32:56.677677+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:00.980570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496995+0000","last_change":"2024-06-02T22:31:15.639499+0000","last_active":"2024-06-02T22:32:56.496995+0000","last_peered":"2024-06-02T22:32:56.496995+0000","last_clean":"2024-06-02T22:32:56.496995+0000","last_became_active":"2024-06-02T22:31:15.639078+0000","last_became_peered":"2024-06-02T22:31:15.639078+0000","last_unstale":"2024-06-02T22:32:56.496995+0000","last_undegraded":"2024-06-02T22:32:56.496995+0000","last_fullsized":"2024-06-02T22:32:56.496995+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:29.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510815+0000","last_change":"2024-06-02T22:31:20.768079+0000","last_active":"2024-06-02T22:32:56.510815+0000","last_peered":"2024-06-02T22:32:56.510815+0000","last_clean":"2024-06-02T22:32:56.510815+0000","last_became_active":"2024-06-02T22:31:20.767762+0000","last_became_peered":"2024-06-02T22:31:20.767762+0000","last_unstale":"2024-06-02T22:32:56.510815+0000","last_undegraded":"2024-06-02T22:32:56.510815+0000","last_fullsized":"2024-06-02T22:32:56.510815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:50:05.247900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637534+0000","last_change":"2024-06-02T22:31:33.852366+0000","last_active":"2024-06-02T22:32:56.637534+0000","last_peered":"2024-06-02T22:32:56.637534+0000","last_clean":"2024-06-02T22:32:56.637534+0000","last_became_active":"2024-06-02T22:31:33.851836+0000","last_became_peered":"2024-06-02T22:31:33.851836+0000","last_unstale":"2024-06-02T22:32:56.637534+0000","last_undegraded":"2024-06-02T22:32:56.637534+0000","last_fullsized":"2024-06-02T22:32:56.637534+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:53.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"99'6","reported_seq":94,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:29.533454+0000","last_change":"2024-06-02T22:31:16.009788+0000","last_active":"2024-06-02T22:33:29.533454+0000","last_peered":"2024-06-02T22:33:29.533454+0000","last_clean":"2024-06-02T22:33:29.533454+0000","last_became_active":"2024-06-02T22:31:16.009413+0000","last_became_peered":"2024-06-02T22:31:16.009413+0000","last_unstale":"2024-06-02T22:33:29.533454+0000","last_undegraded":"2024-06-02T22:33:29.533454+0000","last_fullsized":"2024-06-02T22:33:29.533454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:43:38.985017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511262+0000","last_change":"2024-06-02T22:31:20.751507+0000","last_active":"2024-06-02T22:32:56.511262+0000","last_peered":"2024-06-02T22:32:56.511262+0000","last_clean":"2024-06-02T22:32:56.511262+0000","last_became_active":"2024-06-02T22:31:20.751179+0000","last_became_peered":"2024-06-02T22:31:20.751179+0000","last_unstale":"2024-06-02T22:32:56.511262+0000","last_undegraded":"2024-06-02T22:32:56.511262+0000","last_fullsized":"2024-06-02T22:32:56.511262+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:16.744759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678759+0000","last_change":"2024-06-02T22:31:33.862697+0000","last_active":"2024-06-02T22:32:56.678759+0000","last_peered":"2024-06-02T22:32:56.678759+0000","last_clean":"2024-06-02T22:32:56.678759+0000","last_became_active":"2024-06-02T22:31:33.862148+0000","last_became_peered":"2024-06-02T22:31:33.862148+0000","last_unstale":"2024-06-02T22:32:56.678759+0000","last_undegraded":"2024-06-02T22:32:56.678759+0000","last_fullsized":"2024-06-02T22:32:56.678759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:15.435992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635478+0000","last_change":"2024-06-02T22:31:15.644121+0000","last_active":"2024-06-02T22:32:56.635478+0000","last_peered":"2024-06-02T22:32:56.635478+0000","last_clean":"2024-06-02T22:32:56.635478+0000","last_became_active":"2024-06-02T22:31:15.643727+0000","last_became_peered":"2024-06-02T22:31:15.643727+0000","last_unstale":"2024-06-02T22:32:56.635478+0000","last_undegraded":"2024-06-02T22:32:56.635478+0000","last_fullsized":"2024-06-02T22:32:56.635478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:17:07.135824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511020+0000","last_change":"2024-06-02T22:31:20.748366+0000","last_active":"2024-06-02T22:32:56.511020+0000","last_peered":"2024-06-02T22:32:56.511020+0000","last_clean":"2024-06-02T22:32:56.511020+0000","last_became_active":"2024-06-02T22:31:20.748036+0000","last_became_peered":"2024-06-02T22:31:20.748036+0000","last_unstale":"2024-06-02T22:32:56.511020+0000","last_undegraded":"2024-06-02T22:32:56.511020+0000","last_fullsized":"2024-06-02T22:32:56.511020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:48.188964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634704+0000","last_change":"2024-06-02T22:31:33.847227+0000","last_active":"2024-06-02T22:32:56.634704+0000","last_peered":"2024-06-02T22:32:56.634704+0000","last_clean":"2024-06-02T22:32:56.634704+0000","last_became_active":"2024-06-02T22:31:33.846701+0000","last_became_peered":"2024-06-02T22:31:33.846701+0000","last_unstale":"2024-06-02T22:32:56.634704+0000","last_undegraded":"2024-06-02T22:32:56.634704+0000","last_fullsized":"2024-06-02T22:32:56.634704+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:19.436409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"97'5","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684220+0000","last_change":"2024-06-02T22:31:15.648048+0000","last_active":"2024-06-02T22:32:56.684220+0000","last_peered":"2024-06-02T22:32:56.684220+0000","last_clean":"2024-06-02T22:32:56.684220+0000","last_became_active":"2024-06-02T22:31:15.647400+0000","last_became_peered":"2024-06-02T22:31:15.647400+0000","last_unstale":"2024-06-02T22:32:56.684220+0000","last_undegraded":"2024-06-02T22:32:56.684220+0000","last_fullsized":"2024-06-02T22:32:56.684220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:29:23.458912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511286+0000","last_change":"2024-06-02T22:31:20.751545+0000","last_active":"2024-06-02T22:32:56.511286+0000","last_peered":"2024-06-02T22:32:56.511286+0000","last_clean":"2024-06-02T22:32:56.511286+0000","last_became_active":"2024-06-02T22:31:20.751202+0000","last_became_peered":"2024-06-02T22:31:20.751202+0000","last_unstale":"2024-06-02T22:32:56.511286+0000","last_undegraded":"2024-06-02T22:32:56.511286+0000","last_fullsized":"2024-06-02T22:32:56.511286+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:06:23.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677968+0000","last_change":"2024-06-02T22:31:20.752666+0000","last_active":"2024-06-02T22:32:56.677968+0000","last_peered":"2024-06-02T22:32:56.677968+0000","last_clean":"2024-06-02T22:32:56.677968+0000","last_became_active":"2024-06-02T22:31:20.750433+0000","last_became_peered":"2024-06-02T22:31:20.750433+0000","last_unstale":"2024-06-02T22:32:56.677968+0000","last_undegraded":"2024-06-02T22:32:56.677968+0000","last_fullsized":"2024-06-02T22:32:56.677968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:12.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677813+0000","last_change":"2024-06-02T22:31:20.747426+0000","last_active":"2024-06-02T22:32:56.677813+0000","last_peered":"2024-06-02T22:32:56.677813+0000","last_clean":"2024-06-02T22:32:56.677813+0000","last_became_active":"2024-06-02T22:31:20.746734+0000","last_became_peered":"2024-06-02T22:31:20.746734+0000","last_unstale":"2024-06-02T22:32:56.677813+0000","last_undegraded":"2024-06-02T22:32:56.677813+0000","last_fullsized":"2024-06-02T22:32:56.677813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:30.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677329+0000","last_change":"2024-06-02T22:31:20.771277+0000","last_active":"2024-06-02T22:32:56.677329+0000","last_peered":"2024-06-02T22:32:56.677329+0000","last_clean":"2024-06-02T22:32:56.677329+0000","last_became_active":"2024-06-02T22:31:20.770635+0000","last_became_peered":"2024-06-02T22:31:20.770635+0000","last_unstale":"2024-06-02T22:32:56.677329+0000","last_undegraded":"2024-06-02T22:32:56.677329+0000","last_fullsized":"2024-06-02T22:32:56.677329+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:03.051044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679001+0000","last_change":"2024-06-02T22:31:20.774709+0000","last_active":"2024-06-02T22:32:56.679001+0000","last_peered":"2024-06-02T22:32:56.679001+0000","last_clean":"2024-06-02T22:32:56.679001+0000","last_became_active":"2024-06-02T22:31:20.774260+0000","last_became_peered":"2024-06-02T22:31:20.774260+0000","last_unstale":"2024-06-02T22:32:56.679001+0000","last_undegraded":"2024-06-02T22:32:56.679001+0000","last_fullsized":"2024-06-02T22:32:56.679001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:25.045695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684221+0000","last_change":"2024-06-02T22:31:20.774013+0000","last_active":"2024-06-02T22:32:56.684221+0000","last_peered":"2024-06-02T22:32:56.684221+0000","last_clean":"2024-06-02T22:32:56.684221+0000","last_became_active":"2024-06-02T22:31:20.773479+0000","last_became_peered":"2024-06-02T22:31:20.773479+0000","last_unstale":"2024-06-02T22:32:56.684221+0000","last_undegraded":"2024-06-02T22:32:56.684221+0000","last_fullsized":"2024-06-02T22:32:56.684221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:19.583665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678418+0000","last_change":"2024-06-02T22:31:20.752637+0000","last_active":"2024-06-02T22:32:56.678418+0000","last_peered":"2024-06-02T22:32:56.678418+0000","last_clean":"2024-06-02T22:32:56.678418+0000","last_became_active":"2024-06-02T22:31:20.752279+0000","last_became_peered":"2024-06-02T22:31:20.752279+0000","last_unstale":"2024-06-02T22:32:56.678418+0000","last_undegraded":"2024-06-02T22:32:56.678418+0000","last_fullsized":"2024-06-02T22:32:56.678418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:09:11.124952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677694+0000","last_change":"2024-06-02T22:31:20.752138+0000","last_active":"2024-06-02T22:32:56.677694+0000","last_peered":"2024-06-02T22:32:56.677694+0000","last_clean":"2024-06-02T22:32:56.677694+0000","last_became_active":"2024-06-02T22:31:20.751744+0000","last_became_peered":"2024-06-02T22:31:20.751744+0000","last_unstale":"2024-06-02T22:32:56.677694+0000","last_undegraded":"2024-06-02T22:32:56.677694+0000","last_fullsized":"2024-06-02T22:32:56.677694+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:51.702632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681260+0000","last_change":"2024-06-02T22:31:20.769725+0000","last_active":"2024-06-02T22:32:56.681260+0000","last_peered":"2024-06-02T22:32:56.681260+0000","last_clean":"2024-06-02T22:32:56.681260+0000","last_became_active":"2024-06-02T22:31:20.767668+0000","last_became_peered":"2024-06-02T22:31:20.767668+0000","last_unstale":"2024-06-02T22:32:56.681260+0000","last_undegraded":"2024-06-02T22:32:56.681260+0000","last_fullsized":"2024-06-02T22:32:56.681260+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:56:57.860195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635001+0000","last_change":"2024-06-02T22:31:20.771863+0000","last_active":"2024-06-02T22:32:56.635001+0000","last_peered":"2024-06-02T22:32:56.635001+0000","last_clean":"2024-06-02T22:32:56.635001+0000","last_became_active":"2024-06-02T22:31:20.771533+0000","last_became_peered":"2024-06-02T22:31:20.771533+0000","last_unstale":"2024-06-02T22:32:56.635001+0000","last_undegraded":"2024-06-02T22:32:56.635001+0000","last_fullsized":"2024-06-02T22:32:56.635001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:34.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680285+0000","last_change":"2024-06-02T22:31:20.761906+0000","last_active":"2024-06-02T22:32:56.680285+0000","last_peered":"2024-06-02T22:32:56.680285+0000","last_clean":"2024-06-02T22:32:56.680285+0000","last_became_active":"2024-06-02T22:31:20.761571+0000","last_became_peered":"2024-06-02T22:31:20.761571+0000","last_unstale":"2024-06-02T22:32:56.680285+0000","last_undegraded":"2024-06-02T22:32:56.680285+0000","last_fullsized":"2024-06-02T22:32:56.680285+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:37.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637787+0000","last_change":"2024-06-02T22:31:20.764292+0000","last_active":"2024-06-02T22:32:56.637787+0000","last_peered":"2024-06-02T22:32:56.637787+0000","last_clean":"2024-06-02T22:32:56.637787+0000","last_became_active":"2024-06-02T22:31:20.763997+0000","last_became_peered":"2024-06-02T22:31:20.763997+0000","last_unstale":"2024-06-02T22:32:56.637787+0000","last_undegraded":"2024-06-02T22:32:56.637787+0000","last_fullsized":"2024-06-02T22:32:56.637787+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:44.151687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.683883+0000","last_change":"2024-06-02T22:31:20.773602+0000","last_active":"2024-06-02T22:32:56.683883+0000","last_peered":"2024-06-02T22:32:56.683883+0000","last_clean":"2024-06-02T22:32:56.683883+0000","last_became_active":"2024-06-02T22:31:20.773186+0000","last_became_peered":"2024-06-02T22:31:20.773186+0000","last_unstale":"2024-06-02T22:32:56.683883+0000","last_undegraded":"2024-06-02T22:32:56.683883+0000","last_fullsized":"2024-06-02T22:32:56.683883+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:45.238636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677994+0000","last_change":"2024-06-02T22:31:20.750509+0000","last_active":"2024-06-02T22:32:56.677994+0000","last_peered":"2024-06-02T22:32:56.677994+0000","last_clean":"2024-06-02T22:32:56.677994+0000","last_became_active":"2024-06-02T22:31:20.750121+0000","last_became_peered":"2024-06-02T22:31:20.750121+0000","last_unstale":"2024-06-02T22:32:56.677994+0000","last_undegraded":"2024-06-02T22:32:56.677994+0000","last_fullsized":"2024-06-02T22:32:56.677994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:05:24.916621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282802,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68707,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":414,"num_read_kb":280,"num_write":251,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":210386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":570945,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645360,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32396,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712756,"statfs":{"total":95995035648,"available":95961862144,"internally_reserved":0,"allocated":1249280,"data_stored":1218306,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808887,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":574401,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070525,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":570571,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332161,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1167569,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495688,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":566199,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36476,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708676,"statfs":{"total":95995035648,"available":95957684224,"internally_reserved":0,"allocated":1167360,"data_stored":628344,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1126400,"data_stored":567655,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":567771,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1114112,"data_stored":565517,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32328,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712824,"statfs":{"total":95995035648,"available":95961931776,"internally_reserved":0,"allocated":1179648,"data_stored":630998,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757326,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":1162761,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:33:33.137 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T22:33:33.138 INFO:tasks.cephadm:Setting up client nodes... 2024-06-02T22:33:33.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T22:33:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:33 smithi031 ceph-mon[31767]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:33.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:33 smithi031 ceph-mon[31767]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T22:33:33.639 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:33 smithi098 ceph-mon[36750]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:33.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:33 smithi098 ceph-mon[36750]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T22:33:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:33 smithi178 ceph-mon[36614]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:33:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:33 smithi178 ceph-mon[36614]: pgmap v408: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T22:33:35.624 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:35 smithi031 ceph-mon[31767]: pgmap v409: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-06-02T22:33:35.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:35 smithi098 ceph-mon[36750]: pgmap v409: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-06-02T22:33:35.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:35 smithi178 ceph-mon[36614]: pgmap v409: 129 pgs: 129 active+clean; 648 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-06-02T22:33:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 -- 172.21.15.31:0/701756079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 msgr2=0x7f4b941051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 --2- 172.21.15.31:0/701756079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b941051b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009990 tx=0x7f4b84009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 -- 172.21.15.31:0/701756079 shutdown_connections 2024-06-02T22:33:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 --2- 172.21.15.31:0/701756079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 0x7f4b9410a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 --2- 172.21.15.31:0/701756079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b941051b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 --2- 172.21.15.31:0/701756079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 0x7f4b94107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 -- 172.21.15.31:0/701756079 >> 172.21.15.31:0/701756079 conn(0x7f4b940fc7d0 msgr2=0x7f4b940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:35.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 -- 172.21.15.31:0/701756079 shutdown_connections 2024-06-02T22:33:35.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.921+0000 7f4b93e00700 1 -- 172.21.15.31:0/701756079 wait complete. 2024-06-02T22:33:35.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.922+0000 7f4b93e00700 1 Processor -- start 2024-06-02T22:33:35.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.922+0000 7f4b93e00700 1 -- start start 2024-06-02T22:33:35.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 0x7f4b941989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 0x7f4b9419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410df90 con 0x7f4b94102dc0 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410de10 con 0x7f4b941056f0 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9410e110 con 0x7f4b94108020 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b92a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b92a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52128/0 (socket says 172.21.15.31:52128) 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b92a00700 1 -- 172.21.15.31:0/804598337 learned_addr learned my addr 172.21.15.31:0/804598337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b92000700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 0x7f4b941989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.923+0000 7f4b93400700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 0x7f4b9419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 -- 172.21.15.31:0/804598337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 msgr2=0x7f4b9419fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 0x7f4b9419fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 -- 172.21.15.31:0/804598337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 msgr2=0x7f4b941989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 0x7f4b941989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 -- 172.21.15.31:0/804598337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b941a00f0 con 0x7f4b94102dc0 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b92a00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b840095c0 tx=0x7f4b8400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84026070 con 0x7f4b94102dc0 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b84003d70 con 0x7f4b94102dc0 2024-06-02T22:33:35.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.924+0000 7f4b93e00700 1 -- 172.21.15.31:0/804598337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b941a0380 con 0x7f4b94102dc0 2024-06-02T22:33:35.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.925+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84021410 con 0x7f4b94102dc0 2024-06-02T22:33:35.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.925+0000 7f4b93e00700 1 -- 172.21.15.31:0/804598337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b941a07d0 con 0x7f4b94102dc0 2024-06-02T22:33:35.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.926+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c005330 con 0x7f4b94102dc0 2024-06-02T22:33:35.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.928+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4b84029070 con 0x7f4b94102dc0 2024-06-02T22:33:35.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.929+0000 7f4b8b400700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 0x7f4b780a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:35.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.929+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4b840d0410 con 0x7f4b94102dc0 2024-06-02T22:33:35.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.930+0000 7f4b92000700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 0x7f4b780a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:35.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.931+0000 7f4b92000700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 0x7f4b780a5220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009680 tx=0x7f4b80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:35.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:35.935+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4b8405d850 con 0x7f4b94102dc0 2024-06-02T22:33:36.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.261+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4b6c005620 con 0x7f4b94102dc0 2024-06-02T22:33:36.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.265+0000 7f4b8b400700 1 -- 172.21.15.31:0/804598337 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7f4b84013070 con 0x7f4b94102dc0 2024-06-02T22:33:36.266 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-06-02T22:33:36.266 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBA81xmaEu3DxAAep3QZtEmhcC8ZaDSK9p4jQ== 2024-06-02T22:33:36.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 msgr2=0x7f4b780a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:36.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 0x7f4b780a5220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009680 tx=0x7f4b80009260 comp rx=0 tx=0).stop 2024-06-02T22:33:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 msgr2=0x7f4b94198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4b840095c0 tx=0x7f4b8400bb90 comp rx=0 tx=0).stop 2024-06-02T22:33:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 shutdown_connections 2024-06-02T22:33:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4b780a2d60 0x7f4b780a5220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:36.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b94108020 0x7f4b9419fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94102dc0 0x7f4b94198490 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 --2- 172.21.15.31:0/804598337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b941056f0 0x7f4b941989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.268+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 >> 172.21.15.31:0/804598337 conn(0x7f4b940fc7d0 msgr2=0x7f4b94103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.269+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 shutdown_connections 2024-06-02T22:33:36.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:36.269+0000 7f4b88c00700 1 -- 172.21.15.31:0/804598337 wait complete. 2024-06-02T22:33:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:36 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T22:33:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:36 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T22:33:36.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:36 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T22:33:36.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:36 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T22:33:36.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:36 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T22:33:36.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:36 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/804598337' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T22:33:37.286 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:33:37.287 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-02T22:33:37.287 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T22:33:37.417 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T22:33:37.417 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-02T22:33:37.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-02T22:33:37.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:37 smithi098 ceph-mon[36750]: pgmap v410: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-02T22:33:37.713 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:37 smithi178 ceph-mon[36614]: pgmap v410: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-02T22:33:37.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:37 smithi031 ceph-mon[31767]: pgmap v410: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-06-02T22:33:37.934 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:39.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:39 smithi098 ceph-mon[36750]: pgmap v411: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:39.793 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:39 smithi031 ceph-mon[31767]: pgmap v411: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:39.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:39 smithi178 ceph-mon[36614]: pgmap v411: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:40.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 -- 172.21.15.31:0/613415900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c10ef30 msgr2=0x7ff80c111320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 --2- 172.21.15.31:0/613415900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c10ef30 0x7ff80c111320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff80400b0a0 tx=0x7ff80400b3b0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 -- 172.21.15.31:0/613415900 shutdown_connections 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 --2- 172.21.15.31:0/613415900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c10ef30 0x7ff80c111320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 --2- 172.21.15.31:0/613415900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c06aa30 0x7ff80c06ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 --2- 172.21.15.31:0/613415900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 0x7ff80c10e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 -- 172.21.15.31:0/613415900 >> 172.21.15.31:0/613415900 conn(0x7ff80c078300 msgr2=0x7ff80c078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 -- 172.21.15.31:0/613415900 shutdown_connections 2024-06-02T22:33:40.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.398+0000 7ff812200700 1 -- 172.21.15.31:0/613415900 wait complete. 2024-06-02T22:33:40.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.399+0000 7ff812200700 1 Processor -- start 2024-06-02T22:33:40.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.399+0000 7ff812200700 1 -- start start 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 0x7ff80c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c10ef30 0x7ff80c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c114990 con 0x7ff80c10ef30 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c114810 con 0x7ff80c06b350 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff812200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c114b10 con 0x7ff80c06aa30 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff80b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff803e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 0x7ff80c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff80b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58054/0 (socket says 172.21.15.31:58054) 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff80b400700 1 -- 172.21.15.31:0/484095117 learned_addr learned my addr 172.21.15.31:0/484095117 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:40.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.400+0000 7ff80be00700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c10ef30 0x7ff80c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 -- 172.21.15.31:0/484095117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 msgr2=0x7ff80c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 0x7ff80c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 -- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c10ef30 msgr2=0x7ff80c19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c10ef30 0x7ff80c19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 -- 172.21.15.31:0/484095117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c19fdb0 con 0x7ff80c06aa30 2024-06-02T22:33:40.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.401+0000 7ff80b400700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00e9a0 tx=0x7ff7fc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:40.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.403+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00ca10 con 0x7ff80c06aa30 2024-06-02T22:33:40.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.404+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7fc00cbb0 con 0x7ff80c06aa30 2024-06-02T22:33:40.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.404+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc018680 con 0x7ff80c06aa30 2024-06-02T22:33:40.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.404+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c1a00a0 con 0x7ff80c06aa30 2024-06-02T22:33:40.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.404+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1a7920 con 0x7ff80c06aa30 2024-06-02T22:33:40.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.405+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff80c069180 con 0x7ff80c06aa30 2024-06-02T22:33:40.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.407+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff7fc010430 con 0x7ff80c06aa30 2024-06-02T22:33:40.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.408+0000 7ff808c00700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 0x7ff7f00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:40.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.408+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff7fc0cfab0 con 0x7ff80c06aa30 2024-06-02T22:33:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.409+0000 7ff803e00700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 0x7ff7f00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:40.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.409+0000 7ff803e00700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 0x7ff7f00a51f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff80c102790 tx=0x7ff7f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:40.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.411+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff7fc09c4c0 con 0x7ff80c06aa30 2024-06-02T22:33:40.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.703+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff80c02dca0 con 0x7ff80c06aa30 2024-06-02T22:33:40.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.709+0000 7ff808c00700 1 -- 172.21.15.31:0/484095117 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263196 (secure 0 0 0) 0x7ff7fc09bdc0 con 0x7ff80c06aa30 2024-06-02T22:33:40.710 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.716+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 msgr2=0x7ff7f00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.716+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 0x7ff7f00a51f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff80c102790 tx=0x7ff7f4009260 comp rx=0 tx=0).stop 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.716+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 msgr2=0x7ff80c19ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.716+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00e9a0 tx=0x7ff7fc00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 shutdown_connections 2024-06-02T22:33:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7f00a2d30 0x7ff7f00a51f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff80c10ef30 0x7ff80c19f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff80c06aa30 0x7ff80c19ada0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 --2- 172.21.15.31:0/484095117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff80c06b350 0x7ff80c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 >> 172.21.15.31:0/484095117 conn(0x7ff80c078300 msgr2=0x7ff80c110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 shutdown_connections 2024-06-02T22:33:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:40.717+0000 7ff812200700 1 -- 172.21.15.31:0/484095117 wait complete. 2024-06-02T22:33:41.632 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":784266653},{"type":"v1","addr":"172.21.15.31:6801","nonce":784266653}]},"active_addr":"172.21.15.31:6801/784266653","active_change":"2024-06-02T22:22:54.073748+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.31:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3836586636}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1444011975}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":26885434}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1475941824}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1315265193}]}]} 2024-06-02T22:33:41.641 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-02T22:33:41.641 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-02T22:33:41.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:33:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:41 smithi098 ceph-mon[36750]: pgmap v412: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:41.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/484095117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T22:33:41.750 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:41 smithi031 ceph-mon[31767]: pgmap v412: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:41.750 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/484095117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T22:33:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:41 smithi178 ceph-mon[36614]: pgmap v412: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:33:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/484095117' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T22:33:42.146 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:43.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:43 smithi031 ceph-mon[31767]: pgmap v413: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-02T22:33:43.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:43 smithi098 ceph-mon[36750]: pgmap v413: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-02T22:33:43.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:43 smithi178 ceph-mon[36614]: pgmap v413: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 682 B/s wr, 11 op/s 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 -- 172.21.15.31:0/2095994493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4810eac0 msgr2=0x7f5f4810eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/2095994493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4810eac0 0x7f5f4810eea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009990 tx=0x7f5f3c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 -- 172.21.15.31:0/2095994493 shutdown_connections 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/2095994493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f48109480 0x7f5f48115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/2095994493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4810eac0 0x7f5f4810eea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/2095994493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48108ac0 0x7f5f48108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 -- 172.21.15.31:0/2095994493 >> 172.21.15.31:0/2095994493 conn(0x7f5f48075c60 msgr2=0x7f5f481072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 -- 172.21.15.31:0/2095994493 shutdown_connections 2024-06-02T22:33:44.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.535+0000 7f5f4fc00700 1 -- 172.21.15.31:0/2095994493 wait complete. 2024-06-02T22:33:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 Processor -- start 2024-06-02T22:33:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 -- start start 2024-06-02T22:33:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f48108ac0 0x7f5f4819f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4810eac0 0x7f5f481a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48118e60 con 0x7f5f48108ac0 2024-06-02T22:33:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48118ce0 con 0x7f5f48109480 2024-06-02T22:33:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.537+0000 7f5f4fc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f48118fe0 con 0x7f5f4810eac0 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f4d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f48108ac0 0x7f5f4819f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44646/0 (socket says 172.21.15.31:44646) 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 -- 172.21.15.31:0/3487096427 learned_addr learned my addr 172.21.15.31:0/3487096427 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f4dc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4810eac0 0x7f5f481a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 -- 172.21.15.31:0/3487096427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4810eac0 msgr2=0x7f5f481a3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4810eac0 0x7f5f481a3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 -- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f48108ac0 msgr2=0x7f5f4819f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f48108ac0 0x7f5f4819f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.538+0000 7f5f47e00700 1 -- 172.21.15.31:0/3487096427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f481a4290 con 0x7f5f48109480 2024-06-02T22:33:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f47e00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400eb30 tx=0x7f5f3400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400cbd0 con 0x7f5f48109480 2024-06-02T22:33:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f34004500 con 0x7f5f48109480 2024-06-02T22:33:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34010430 con 0x7f5f48109480 2024-06-02T22:33:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f481a4580 con 0x7f5f48109480 2024-06-02T22:33:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.539+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f481abe00 con 0x7f5f48109480 2024-06-02T22:33:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.540+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f48069180 con 0x7f5f48109480 2024-06-02T22:33:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.542+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f34003f00 con 0x7f5f48109480 2024-06-02T22:33:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.544+0000 7f5f45600700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 0x7f5f300a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.544+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f5f340cf8a0 con 0x7f5f48109480 2024-06-02T22:33:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.544+0000 7f5f4d200700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 0x7f5f300a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.545+0000 7f5f4d200700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 0x7f5f300a51f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c006010 tx=0x7f5f3c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:44.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.548+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5f3409c2b0 con 0x7f5f48109480 2024-06-02T22:33:44.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.787+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f4802dca0 con 0x7f5f48109480 2024-06-02T22:33:44.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.790+0000 7f5f45600700 1 -- 172.21.15.31:0/3487096427 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7f5f3409bbb0 con 0x7f5f48109480 2024-06-02T22:33:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:44.790 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 msgr2=0x7f5f300a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 0x7f5f300a51f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c006010 tx=0x7f5f3c00b260 comp rx=0 tx=0).stop 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 msgr2=0x7f5f4819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400eb30 tx=0x7f5f3400ee40 comp rx=0 tx=0).stop 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 shutdown_connections 2024-06-02T22:33:44.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5f300a2d30 0x7f5f300a51f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f4810eac0 0x7f5f481a3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f48108ac0 0x7f5f4819f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 --2- 172.21.15.31:0/3487096427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f48109480 0x7f5f4819f810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 >> 172.21.15.31:0/3487096427 conn(0x7f5f48075c60 msgr2=0x7f5f48076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.794+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 shutdown_connections 2024-06-02T22:33:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:44.795+0000 7f5f4fc00700 1 -- 172.21.15.31:0/3487096427 wait complete. 2024-06-02T22:33:45.571 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:45 smithi031 ceph-mon[31767]: pgmap v414: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:33:45.571 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3487096427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:45.645 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-02T22:33:45.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:33:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:45 smithi098 ceph-mon[36750]: pgmap v414: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:33:45.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3487096427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:45.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:45 smithi178 ceph-mon[36614]: pgmap v414: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:33:45.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3487096427' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:46.114 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:47.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:47 smithi031 ceph-mon[31767]: pgmap v415: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:33:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:47 smithi098 ceph-mon[36750]: pgmap v415: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:33:47.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:47 smithi178 ceph-mon[36614]: pgmap v415: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:33:48.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 -- 172.21.15.31:0/3262268384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c107840 msgr2=0x7f864c10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:48.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 --2- 172.21.15.31:0/3262268384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c107840 0x7f864c10f3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f86440099c0 tx=0x7f8644009cd0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 -- 172.21.15.31:0/3262268384 shutdown_connections 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 --2- 172.21.15.31:0/3262268384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c107840 0x7f864c10f3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 --2- 172.21.15.31:0/3262268384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c102740 0x7f864c102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 --2- 172.21.15.31:0/3262268384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c1030f0 0x7f864c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 -- 172.21.15.31:0/3262268384 >> 172.21.15.31:0/3262268384 conn(0x7f864c0795f0 msgr2=0x7f864c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 -- 172.21.15.31:0/3262268384 shutdown_connections 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.553+0000 7f8652a00700 1 -- 172.21.15.31:0/3262268384 wait complete. 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.554+0000 7f8652a00700 1 Processor -- start 2024-06-02T22:33:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.554+0000 7f8652a00700 1 -- start start 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 0x7f864c19e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c107840 0x7f864c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f864c112780 con 0x7f864c102740 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f864c112600 con 0x7f864c1030f0 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8652a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f864c112900 con 0x7f864c107840 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f864be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 0x7f864c19e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8643400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8643400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44660/0 (socket says 172.21.15.31:44660) 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8643400700 1 -- 172.21.15.31:0/2768761890 learned_addr learned my addr 172.21.15.31:0/2768761890 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:33:48.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.555+0000 7f8650a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c107840 0x7f864c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 -- 172.21.15.31:0/2768761890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c107840 msgr2=0x7f864c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c107840 0x7f864c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 -- 172.21.15.31:0/2768761890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 msgr2=0x7f864c19ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 -- 172.21.15.31:0/2768761890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c1990a0 con 0x7f864c102740 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f8643400700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f864be00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 0x7f864c19e780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f863c00ef10 tx=0x7f863c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c00c9c0 con 0x7f864c102740 2024-06-02T22:33:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c019070 con 0x7f864c102740 2024-06-02T22:33:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c199330 con 0x7f864c102740 2024-06-02T22:33:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.556+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c0146e0 con 0x7f864c102740 2024-06-02T22:33:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.557+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c1a5650 con 0x7f864c102740 2024-06-02T22:33:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.558+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c069180 con 0x7f864c102740 2024-06-02T22:33:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.560+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f863c012050 con 0x7f864c102740 2024-06-02T22:33:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.561+0000 7f8649600700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 0x7f86300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:33:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.561+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f863c0cf5a0 con 0x7f864c102740 2024-06-02T22:33:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.562+0000 7f8643400700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 0x7f86300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:33:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.562+0000 7f8643400700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 0x7f86300a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f864c107240 tx=0x7f8634009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:33:48.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.566+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f863c010040 con 0x7f864c102740 2024-06-02T22:33:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.798+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f864c1a5820 con 0x7f864c102740 2024-06-02T22:33:48.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.801+0000 7f8649600700 1 -- 172.21.15.31:0/2768761890 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7f863c09bfb0 con 0x7f864c102740 2024-06-02T22:33:48.802 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:33:48.802 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:33:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 msgr2=0x7f86300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 0x7f86300a5170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f864c107240 tx=0x7f8634009260 comp rx=0 tx=0).stop 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 msgr2=0x7f864c19e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 0x7f864c19e780 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f863c00ef10 tx=0x7f863c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 shutdown_connections 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86300a2cb0 0x7f86300a5170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f864c107840 0x7f864c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864c102740 0x7f864c19e780 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 --2- 172.21.15.31:0/2768761890 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f864c1030f0 0x7f864c19ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:33:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 >> 172.21.15.31:0/2768761890 conn(0x7f864c0795f0 msgr2=0x7f864c100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:33:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 shutdown_connections 2024-06-02T22:33:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:48.805+0000 7f8652a00700 1 -- 172.21.15.31:0/2768761890 wait complete. 2024-06-02T22:33:49.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:49 smithi031 ceph-mon[31767]: pgmap v416: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:49.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2768761890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:49.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:49 smithi098 ceph-mon[36750]: pgmap v416: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:49.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2768761890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:49 smithi178 ceph-mon[36614]: pgmap v416: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2768761890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:33:49.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-02T22:33:49.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-02T22:33:49.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-02T22:33:49.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-02T22:33:49.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-02T22:33:49.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-02T22:33:49.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-02T22:33:49.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-02T22:33:49.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-02T22:33:49.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-02T22:33:49.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-02T22:33:49.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-02T22:33:50.865 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.027 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.492 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:51 smithi098 ceph-mon[36750]: pgmap v417: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:51.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:51 smithi178 ceph-mon[36614]: pgmap v417: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:51.839 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.841 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.844 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.845 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.846 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.855 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.855 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.861 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:33:51.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:51 smithi031 ceph-mon[31767]: pgmap v417: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:53.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:53 smithi031 ceph-mon[31767]: pgmap v418: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:33:53.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:53 smithi098 ceph-mon[36750]: pgmap v418: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:33:53.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:53 smithi178 ceph-mon[36614]: pgmap v418: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:33:55.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:55 smithi031 ceph-mon[31767]: pgmap v419: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:33:55.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:55 smithi098 ceph-mon[36750]: pgmap v419: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:33:55.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:55 smithi178 ceph-mon[36614]: pgmap v419: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:33:57.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:57 smithi031 ceph-mon[31767]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:33:57.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:57 smithi098 ceph-mon[36750]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:33:57.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:57 smithi178 ceph-mon[36614]: pgmap v420: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:33:59.637 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:33:59 smithi031 ceph-mon[31767]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:59.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:33:59 smithi178 ceph-mon[36614]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:33:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:33:59 smithi098 ceph-mon[36750]: pgmap v421: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:01.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:01 smithi031 ceph-mon[31767]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:01.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:01 smithi178 ceph-mon[36614]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 -- 172.21.15.31:0/3041438451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8201045c0 msgr2=0x7fd820104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 --2- 172.21.15.31:0/3041438451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8201045c0 0x7fd820104a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0099c0 tx=0x7fd80c009cd0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 -- 172.21.15.31:0/3041438451 shutdown_connections 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 --2- 172.21.15.31:0/3041438451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd820104f80 0x7fd820111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 --2- 172.21.15.31:0/3041438451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd82010a670 0x7fd82010aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 --2- 172.21.15.31:0/3041438451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8201045c0 0x7fd820104a40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 -- 172.21.15.31:0/3041438451 >> 172.21.15.31:0/3041438451 conn(0x7fd820100070 msgr2=0x7fd820102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 -- 172.21.15.31:0/3041438451 shutdown_connections 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.302+0000 7fd825a00700 1 -- 172.21.15.31:0/3041438451 wait complete. 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.303+0000 7fd825a00700 1 Processor -- start 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.303+0000 7fd825a00700 1 -- start start 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 0x7fd8201a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd820104f80 0x7fd8201a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd82010a670 0x7fd82019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd820114930 con 0x7fd8201045c0 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8201147b0 con 0x7fd82010a670 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd820114ab0 con 0x7fd820104f80 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd81fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 0x7fd8201a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:01.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd81fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 0x7fd8201a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36484/0 (socket says 172.21.15.31:36484) 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd81fe00700 1 -- 172.21.15.31:0/940549728 learned_addr learned my addr 172.21.15.31:0/940549728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd825000700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd82010a670 0x7fd82019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.304+0000 7fd81f400700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd820104f80 0x7fd8201a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 -- 172.21.15.31:0/940549728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd820104f80 msgr2=0x7fd8201a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd820104f80 0x7fd8201a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 -- 172.21.15.31:0/940549728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd82010a670 msgr2=0x7fd82019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd82010a670 0x7fd82019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82019b3f0 con 0x7fd8201045c0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81fe00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 0x7fd8201a0a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd81000eb30 tx=0x7fd81000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81000cbd0 con 0x7fd8201045c0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.305+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd810004500 con 0x7fd8201045c0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.306+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810010430 con 0x7fd8201045c0 2024-06-02T22:34:01.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.306+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82019b6e0 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.306+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8201a79c0 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.307+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd820062be0 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.311+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd810003f00 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81cc00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8040a2cb0 0x7fd8040a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd8100cfbe0 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81f400700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8040a2cb0 0x7fd8040a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81cc00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] conn(0x7fd8040ade40 0x7fd8040b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd81001aec0 con 0x7fd8040ade40 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.312+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fd8100cff90 con 0x7fd8201045c0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.313+0000 7fd825000700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] conn(0x7fd8040ade40 0x7fd8040b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:01.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.313+0000 7fd81f400700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8040a2cb0 0x7fd8040a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd82019c2f0 tx=0x7fd80c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.313+0000 7fd825000700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] conn(0x7fd8040ade40 0x7fd8040b02e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.314+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== osd.3 v2:172.21.15.31:6810/3409524597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd81001aec0 con 0x7fd8040ade40 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.333+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 --> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd820062fe0 con 0x7fd8040ade40 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.333+0000 7fd81cc00700 1 -- 172.21.15.31:0/940549728 <== osd.3 v2:172.21.15.31:6810/3409524597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd820062fe0 con 0x7fd8040ade40 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] conn(0x7fd8040ade40 msgr2=0x7fd8040b02e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] conn(0x7fd8040ade40 0x7fd8040b02e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8040a2cb0 msgr2=0x7fd8040a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8040a2cb0 0x7fd8040a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd82019c2f0 tx=0x7fd80c005fb0 comp rx=0 tx=0).stop 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 msgr2=0x7fd8201a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825a00700 1 --2- 172.21.15.31:0/940549728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8201045c0 0x7fd8201a0a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd81000eb30 tx=0x7fd81000ee40 comp rx=0 tx=0).stop 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.334+0000 7fd825000700 1 -- 172.21.15.31:0/940549728 reap_dead start 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.335+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 shutdown_connections 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.335+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 >> 172.21.15.31:0/940549728 conn(0x7fd820100070 msgr2=0x7fd820101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.335+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 shutdown_connections 2024-06-02T22:34:01.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:33:58.335+0000 7fd825a00700 1 -- 172.21.15.31:0/940549728 wait complete. 2024-06-02T22:34:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:01 smithi098 ceph-mon[36750]: pgmap v422: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:03.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:03 smithi178 ceph-mon[36614]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:03.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:03 smithi031 ceph-mon[31767]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:03 smithi098 ceph-mon[36750]: pgmap v423: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 -- 172.21.15.31:0/1133765727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55780746c0 msgr2=0x7f5578074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 --2- 172.21.15.31:0/1133765727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55780746c0 0x7f5578074aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5568009990 tx=0x7f5568009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 -- 172.21.15.31:0/1133765727 shutdown_connections 2024-06-02T22:34:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 --2- 172.21.15.31:0/1133765727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f557810ee90 0x7f5578111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 --2- 172.21.15.31:0/1133765727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55780746c0 0x7f5578074aa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 --2- 172.21.15.31:0/1133765727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 0x7f557810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 -- 172.21.15.31:0/1133765727 >> 172.21.15.31:0/1133765727 conn(0x7f55780795f0 msgr2=0x7f5578079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 -- 172.21.15.31:0/1133765727 shutdown_connections 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.275+0000 7f557ec00700 1 -- 172.21.15.31:0/1133765727 wait complete. 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.276+0000 7f557ec00700 1 Processor -- start 2024-06-02T22:34:04.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 -- start start 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55780746c0 0x7f557819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 0x7f557819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f557810ee90 0x7f557819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f55781149c0 con 0x7f557810ee90 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5578114840 con 0x7f55780746c0 2024-06-02T22:34:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.277+0000 7f557ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5578114b40 con 0x7f5578074fe0 2024-06-02T22:34:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f557cc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f557810ee90 0x7f557819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f556f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 0x7f557819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f556f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 0x7f557819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58768/0 (socket says 172.21.15.31:58768) 2024-06-02T22:34:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f556f400700 1 -- 172.21.15.31:0/3398507665 learned_addr learned my addr 172.21.15.31:0/3398507665 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55780746c0 0x7f557819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 -- 172.21.15.31:0/3398507665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 msgr2=0x7f557819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5578074fe0 0x7f557819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 -- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f557810ee90 msgr2=0x7f557819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f557810ee90 0x7f557819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.278+0000 7f5577e00700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557819fde0 con 0x7f55780746c0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f5577e00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55780746c0 0x7f557819add0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5568006010 tx=0x7f556800ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568027070 con 0x7f55780746c0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55781a0070 con 0x7f55780746c0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5568003d70 con 0x7f55780746c0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568022e00 con 0x7f55780746c0 2024-06-02T22:34:04.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.279+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55781a7950 con 0x7f55780746c0 2024-06-02T22:34:04.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.280+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5578062c20 con 0x7f55780746c0 2024-06-02T22:34:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.283+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f556802a070 con 0x7f55780746c0 2024-06-02T22:34:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f5575600700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f55580a2cb0 0x7f55580a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:04.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f55680d0c40 con 0x7f55780746c0 2024-06-02T22:34:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f556f400700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f55580a2cb0 0x7f55580a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f5575600700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] conn(0x7f55580adf10 0x7f55580b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55580b0a80 con 0x7f55580adf10 2024-06-02T22:34:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.284+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f55680d0ff0 con 0x7f55780746c0 2024-06-02T22:34:04.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.285+0000 7f557cc00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] conn(0x7f55580adf10 0x7f55580b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.285+0000 7f556f400700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f55580a2cb0 0x7f55580a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5578110b50 tx=0x7f556000b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.285+0000 7f557cc00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] conn(0x7f55580adf10 0x7f55580b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.286+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== osd.7 v2:172.21.15.98:6816/1807036424 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55580b0a80 con 0x7f55580adf10 2024-06-02T22:34:04.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.305+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 --> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5578063020 con 0x7f55580adf10 2024-06-02T22:34:04.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f5575600700 1 -- 172.21.15.31:0/3398507665 <== osd.7 v2:172.21.15.98:6816/1807036424 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5578063020 con 0x7f55580adf10 2024-06-02T22:34:04.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] conn(0x7f55580adf10 msgr2=0x7f55580b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] conn(0x7f55580adf10 0x7f55580b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:04.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f55580a2cb0 msgr2=0x7f55580a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f55580a2cb0 0x7f55580a5170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5578110b50 tx=0x7f556000b500 comp rx=0 tx=0).stop 2024-06-02T22:34:04.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55780746c0 msgr2=0x7f557819add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:04.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557ec00700 1 --2- 172.21.15.31:0/3398507665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55780746c0 0x7f557819add0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5568006010 tx=0x7f556800ba90 comp rx=0 tx=0).stop 2024-06-02T22:34:04.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.306+0000 7f557cc00700 1 -- 172.21.15.31:0/3398507665 reap_dead start 2024-06-02T22:34:04.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.307+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 shutdown_connections 2024-06-02T22:34:04.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.307+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 >> 172.21.15.31:0/3398507665 conn(0x7f55780795f0 msgr2=0x7f55780ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:04.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.307+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 shutdown_connections 2024-06-02T22:34:04.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:04.307+0000 7f557ec00700 1 -- 172.21.15.31:0/3398507665 wait complete. 2024-06-02T22:34:05.522 INFO:teuthology.orchestra.run.smithi031.stdout:107374182494 2024-06-02T22:34:05.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-02T22:34:05.780 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:05 smithi031 ceph-mon[31767]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:05.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:05 smithi178 ceph-mon[36614]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:05 smithi098 ceph-mon[36750]: pgmap v424: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:06.705 INFO:teuthology.orchestra.run.smithi031.stdout:219043332169 2024-06-02T22:34:06.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 -- 172.21.15.31:0/3661013545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498107700 msgr2=0x7f649810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 --2- 172.21.15.31:0/3661013545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498107700 0x7f649810f2d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f64900099c0 tx=0x7f6490009cd0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 -- 172.21.15.31:0/3661013545 shutdown_connections 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 --2- 172.21.15.31:0/3661013545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498107700 0x7f649810f2d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 --2- 172.21.15.31:0/3661013545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498102620 0x7f6498102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 --2- 172.21.15.31:0/3661013545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102fd0 0x7f6498107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 -- 172.21.15.31:0/3661013545 >> 172.21.15.31:0/3661013545 conn(0x7f64980fdf10 msgr2=0x7f6498100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 -- 172.21.15.31:0/3661013545 shutdown_connections 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.638+0000 7f649f000700 1 -- 172.21.15.31:0/3661013545 wait complete. 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.639+0000 7f649f000700 1 Processor -- start 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.639+0000 7f649f000700 1 -- start start 2024-06-02T22:34:07.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 0x7f649819ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498102fd0 0x7f649819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498107700 0x7f649819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6498112740 con 0x7f6498102fd0 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f64981125c0 con 0x7f6498107700 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649f000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f64981128c0 con 0x7f6498102620 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 0x7f649819ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649e600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498107700 0x7f649819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498102fd0 0x7f649819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:07.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 0x7f649819ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58798/0 (socket says 172.21.15.31:58798) 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.640+0000 7f649dc00700 1 -- 172.21.15.31:0/1924201076 learned_addr learned my addr 172.21.15.31:0/1924201076 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 -- 172.21.15.31:0/1924201076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498107700 msgr2=0x7f649819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498107700 0x7f649819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 -- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498102fd0 msgr2=0x7f649819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6498102fd0 0x7f649819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649819fd20 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649e600700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6498107700 0x7f649819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649dc00700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 0x7f649819ad10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f648c00ef10 tx=0x7f648c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c00c9c0 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f648c019070 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.641+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649819ffb0 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.642+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c007e60 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.642+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981a7890 con 0x7f6498102620 2024-06-02T22:34:07.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.643+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64980ffb20 con 0x7f6498102620 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.645+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f648c012050 con 0x7f6498102620 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.646+0000 7f6496000700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f64800a2d30 0x7f64800a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.646+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f648c0cf880 con 0x7f6498102620 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.646+0000 7f649d200700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f64800a2d30 0x7f64800a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.647+0000 7f6496000700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] conn(0x7f64800adf90 0x7f64800b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.647+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64800b0b00 con 0x7f64800adf90 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.647+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f648c0cfc30 con 0x7f6498102620 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.647+0000 7f649d200700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f64800a2d30 0x7f64800a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64980fe570 tx=0x7f6484009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:07.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.647+0000 7f649e600700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] conn(0x7f64800adf90 0x7f64800b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.648+0000 7f649e600700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] conn(0x7f64800adf90 0x7f64800b0430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.649+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== osd.8 v2:172.21.15.178:6816/2113425738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64800b0b00 con 0x7f64800adf90 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.667+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 --> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6498103b00 con 0x7f64800adf90 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.668+0000 7f6496000700 1 -- 172.21.15.31:0/1924201076 <== osd.8 v2:172.21.15.178:6816/2113425738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6498103b00 con 0x7f64800adf90 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.668+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] conn(0x7f64800adf90 msgr2=0x7f64800b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.668+0000 7f649f000700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] conn(0x7f64800adf90 0x7f64800b0430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f64800a2d30 msgr2=0x7f64800a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f64800a2d30 0x7f64800a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f64980fe570 tx=0x7f6484009260 comp rx=0 tx=0).stop 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 msgr2=0x7f649819ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 --2- 172.21.15.31:0/1924201076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6498102620 0x7f649819ad10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f648c00ef10 tx=0x7f648c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649e600700 1 -- 172.21.15.31:0/1924201076 reap_dead start 2024-06-02T22:34:07.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 shutdown_connections 2024-06-02T22:34:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 >> 172.21.15.31:0/1924201076 conn(0x7f64980fdf10 msgr2=0x7f649810db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 shutdown_connections 2024-06-02T22:34:07.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.669+0000 7f649f000700 1 -- 172.21.15.31:0/1924201076 wait complete. 2024-06-02T22:34:07.771 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:07 smithi031 ceph-mon[31767]: pgmap v425: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:07.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:07 smithi178 ceph-mon[36614]: pgmap v425: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:07 smithi098 ceph-mon[36750]: pgmap v425: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 -- 172.21.15.31:0/2090282803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb81030f0 msgr2=0x7fdeb8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 --2- 172.21.15.31:0/2090282803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb81030f0 0x7fdeb8107110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009990 tx=0x7fdea4009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 -- 172.21.15.31:0/2090282803 shutdown_connections 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 --2- 172.21.15.31:0/2090282803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb8107840 0x7fdeb810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 --2- 172.21.15.31:0/2090282803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 0x7fdeb8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 --2- 172.21.15.31:0/2090282803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb81030f0 0x7fdeb8107110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 -- 172.21.15.31:0/2090282803 >> 172.21.15.31:0/2090282803 conn(0x7fdeb80795f0 msgr2=0x7fdeb8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 -- 172.21.15.31:0/2090282803 shutdown_connections 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.771+0000 7fdebde00700 1 -- 172.21.15.31:0/2090282803 wait complete. 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 Processor -- start 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 -- start start 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 0x7fdeb819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 0x7fdeb819b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb8107840 0x7fdeb819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb81127c0 con 0x7fdeb8102740 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb8112640 con 0x7fdeb81030f0 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.773+0000 7fdebde00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb8112940 con 0x7fdeb8107840 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 0x7fdeb819b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 0x7fdeb819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:08.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 0x7fdeb819b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52186/0 (socket says 172.21.15.31:52186) 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6000700 1 -- 172.21.15.31:0/608809350 learned_addr learned my addr 172.21.15.31:0/608809350 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb7400700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb8107840 0x7fdeb819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 -- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb8107840 msgr2=0x7fdeb819f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdeb8107840 0x7fdeb819f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 -- 172.21.15.31:0/608809350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 msgr2=0x7fdeb819b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 0x7fdeb819b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6a00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb819fe30 con 0x7fdeb8102740 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.774+0000 7fdeb6000700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdeb81030f0 0x7fdeb819b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdeb6a00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 0x7fdeb819ae20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e9f0 tx=0x7fdea800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea800c9c0 con 0x7fdeb8102740 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea800cb60 con 0x7fdeb8102740 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8018680 con 0x7fdeb8102740 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb81a0120 con 0x7fdeb8102740 2024-06-02T22:34:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.775+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb81a79a0 con 0x7fdeb8102740 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.777+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdeb8075a20 con 0x7fdeb8102740 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.779+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdea8010430 con 0x7fdeb8102740 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.780+0000 7fdebca00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fde9c0a2d30 0x7fde9c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdea80d0220 con 0x7fdeb8102740 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdeb6000700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fde9c0a2d30 0x7fde9c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdebca00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] conn(0x7fde9c0adf90 0x7fde9c0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdea80056b0 con 0x7fde9c0adf90 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fdea80d05d0 con 0x7fdeb8102740 2024-06-02T22:34:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.781+0000 7fdeb7400700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] conn(0x7fde9c0adf90 0x7fde9c0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.782+0000 7fdeb6000700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fde9c0a2d30 0x7fde9c0a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009750 tx=0x7fdea400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.782+0000 7fdeb7400700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] conn(0x7fde9c0adf90 0x7fde9c0b0430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.783+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== osd.2 v2:172.21.15.178:6800/2072394322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdea80056b0 con 0x7fde9c0adf90 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.804+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 --> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdeb8103bd0 con 0x7fde9c0adf90 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.805+0000 7fdebca00700 1 -- 172.21.15.31:0/608809350 <== osd.2 v2:172.21.15.178:6800/2072394322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdeb8103bd0 con 0x7fde9c0adf90 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.805+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] conn(0x7fde9c0adf90 msgr2=0x7fde9c0b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] conn(0x7fde9c0adf90 0x7fde9c0b0430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fde9c0a2d30 msgr2=0x7fde9c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fde9c0a2d30 0x7fde9c0a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009750 tx=0x7fdea400b280 comp rx=0 tx=0).stop 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 msgr2=0x7fdeb819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 --2- 172.21.15.31:0/608809350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdeb8102740 0x7fdeb819ae20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdea800e9f0 tx=0x7fdea800ed00 comp rx=0 tx=0).stop 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdeb7400700 1 -- 172.21.15.31:0/608809350 reap_dead start 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 shutdown_connections 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 >> 172.21.15.31:0/608809350 conn(0x7fdeb80795f0 msgr2=0x7fdeb8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 shutdown_connections 2024-06-02T22:34:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:07.806+0000 7fdebde00700 1 -- 172.21.15.31:0/608809350 wait complete. 2024-06-02T22:34:09.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:09 smithi178 ceph-mon[36614]: pgmap v426: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:09.849 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:09 smithi031 ceph-mon[31767]: pgmap v426: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:09.909 INFO:teuthology.orchestra.run.smithi031.stdout:77309411432 2024-06-02T22:34:09.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-02T22:34:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:09 smithi098 ceph-mon[36750]: pgmap v426: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 -- 172.21.15.31:0/2129928831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44101df0 msgr2=0x7f7c441021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 --2- 172.21.15.31:0/2129928831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44101df0 0x7f7c441021d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098f0 tx=0x7f7c38009c00 comp rx=0 tx=0).stop 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 -- 172.21.15.31:0/2129928831 shutdown_connections 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 --2- 172.21.15.31:0/2129928831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c44106750 0x7f7c4410e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 --2- 172.21.15.31:0/2129928831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44101df0 0x7f7c441021d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 --2- 172.21.15.31:0/2129928831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c441027a0 0x7f7c44106020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.305+0000 7f7c4b800700 1 -- 172.21.15.31:0/2129928831 >> 172.21.15.31:0/2129928831 conn(0x7f7c44077a00 msgr2=0x7f7c440fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.306+0000 7f7c4b800700 1 -- 172.21.15.31:0/2129928831 shutdown_connections 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.306+0000 7f7c4b800700 1 -- 172.21.15.31:0/2129928831 wait complete. 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.307+0000 7f7c4b800700 1 Processor -- start 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.307+0000 7f7c4b800700 1 -- start start 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.307+0000 7f7c4b800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c44101df0 0x7f7c440fce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c4b800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 0x7f7c440fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c4b800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44106750 0x7f7c440fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c4b800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44111670 con 0x7f7c44101df0 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c4b800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c441114f0 con 0x7f7c441027a0 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c4b800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7c441117f0 con 0x7f7c44106750 2024-06-02T22:34:10.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 0x7f7c440fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c48e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c44101df0 0x7f7c440fce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 0x7f7c440fd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52218/0 (socket says 172.21.15.31:52218) 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 -- 172.21.15.31:0/397053609 learned_addr learned my addr 172.21.15.31:0/397053609 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c49800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44106750 0x7f7c440fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 -- 172.21.15.31:0/397053609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44106750 msgr2=0x7f7c440fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44106750 0x7f7c440fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 -- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c44101df0 msgr2=0x7f7c440fce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c44101df0 0x7f7c440fce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.308+0000 7f7c43e00700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c441ab580 con 0x7f7c441027a0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c43e00700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 0x7f7c440fd3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000ec10 tx=0x7f7c3000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000cc90 con 0x7f7c441027a0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c441ab810 con 0x7f7c441027a0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c3000ce30 con 0x7f7c441027a0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30010690 con 0x7f7c441027a0 2024-06-02T22:34:10.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.309+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c441abd50 con 0x7f7c441027a0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.310+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c44062ba0 con 0x7f7c441027a0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.313+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c30003680 con 0x7f7c441027a0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.314+0000 7f7c41600700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7c2c0a2cb0 0x7f7c2c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.314+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7c300cfc20 con 0x7f7c441027a0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.314+0000 7f7c48e00700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7c2c0a2cb0 0x7f7c2c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.314+0000 7f7c41600700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] conn(0x7f7c2c0adf10 0x7f7c2c0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.315+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c30023e50 con 0x7f7c2c0adf10 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.315+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f7c300cffd0 con 0x7f7c441027a0 2024-06-02T22:34:10.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.315+0000 7f7c49800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] conn(0x7f7c2c0adf10 0x7f7c2c0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.315+0000 7f7c48e00700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7c2c0a2cb0 0x7f7c2c0a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098c0 tx=0x7f7c3801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.316+0000 7f7c49800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] conn(0x7f7c2c0adf10 0x7f7c2c0b03b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.317+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== osd.0 v2:172.21.15.31:6802/487181160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c30023e50 con 0x7f7c2c0adf10 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.336+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 --> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c44062fa0 con 0x7f7c2c0adf10 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.336+0000 7f7c41600700 1 -- 172.21.15.31:0/397053609 <== osd.0 v2:172.21.15.31:6802/487181160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c44062fa0 con 0x7f7c2c0adf10 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] conn(0x7f7c2c0adf10 msgr2=0x7f7c2c0b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] conn(0x7f7c2c0adf10 0x7f7c2c0b03b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7c2c0a2cb0 msgr2=0x7f7c2c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7c2c0a2cb0 0x7f7c2c0a5170 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7c380098c0 tx=0x7f7c3801a040 comp rx=0 tx=0).stop 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 msgr2=0x7f7c440fd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 --2- 172.21.15.31:0/397053609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c441027a0 0x7f7c440fd3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000ec10 tx=0x7f7c3000ef20 comp rx=0 tx=0).stop 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c49800700 1 -- 172.21.15.31:0/397053609 reap_dead start 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 shutdown_connections 2024-06-02T22:34:10.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 >> 172.21.15.31:0/397053609 conn(0x7f7c44077a00 msgr2=0x7f7c44100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:10.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 shutdown_connections 2024-06-02T22:34:10.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:10.337+0000 7f7c4b800700 1 -- 172.21.15.31:0/397053609 wait complete. 2024-06-02T22:34:11.589 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:11 smithi031 ceph-mon[31767]: pgmap v427: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:11.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:11 smithi178 ceph-mon[36614]: pgmap v427: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:11 smithi098 ceph-mon[36750]: pgmap v427: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 -- 172.21.15.31:0/3457968772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa810ee90 msgr2=0x7faaa8111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 --2- 172.21.15.31:0/3457968772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa810ee90 0x7faaa8111280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009f90 tx=0x7faaa000b330 comp rx=0 tx=0).stop 2024-06-02T22:34:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 -- 172.21.15.31:0/3457968772 shutdown_connections 2024-06-02T22:34:12.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 --2- 172.21.15.31:0/3457968772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa810ee90 0x7faaa8111280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 --2- 172.21.15.31:0/3457968772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa80746c0 0x7faaa8074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 --2- 172.21.15.31:0/3457968772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 0x7faaa810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 -- 172.21.15.31:0/3457968772 >> 172.21.15.31:0/3457968772 conn(0x7faaa80795f0 msgr2=0x7faaa8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 -- 172.21.15.31:0/3457968772 shutdown_connections 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.259+0000 7faaaee00700 1 -- 172.21.15.31:0/3457968772 wait complete. 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.260+0000 7faaaee00700 1 Processor -- start 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 -- start start 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa80746c0 0x7faaa819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 0x7faaa819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa810ee90 0x7faaa819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81149d0 con 0x7faaa810ee90 2024-06-02T22:34:12.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8114850 con 0x7faaa8074fe0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaaee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8114b50 con 0x7faaa80746c0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.261+0000 7faaace00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa810ee90 0x7faaa819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 0x7faaa819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaace00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa810ee90 0x7faaa819f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52444/0 (socket says 172.21.15.31:52444) 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaace00700 1 -- 172.21.15.31:0/3808226303 learned_addr learned my addr 172.21.15.31:0/3808226303 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7e00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa80746c0 0x7faaa819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 -- 172.21.15.31:0/3808226303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa80746c0 msgr2=0x7faaa819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa80746c0 0x7faaa819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 -- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa810ee90 msgr2=0x7faaa819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaa810ee90 0x7faaa819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa819fdb0 con 0x7faaa8074fe0 2024-06-02T22:34:12.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.262+0000 7faaa7400700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 0x7faaa819b2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9c0 tx=0x7faa9400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.263+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94004220 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.263+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa940043c0 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.263+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa81a00a0 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.263+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94003cf0 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.263+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa81a7920 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.264+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaa8100020 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.267+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa9400c7c0 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.268+0000 7faaa4c00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa8c0a2cb0 0x7faa8c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.268+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7faa940cfaa0 con 0x7faaa8074fe0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.268+0000 7faaa7e00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa8c0a2cb0 0x7faa8c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.269+0000 7faaa4c00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] conn(0x7faa8c0adf10 0x7faa8c0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.269+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa94023e50 con 0x7faa8c0adf10 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.269+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7faa940cfe50 con 0x7faaa8074fe0 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.269+0000 7faaace00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] conn(0x7faa8c0adf10 0x7faa8c0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.269+0000 7faaa7e00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa8c0a2cb0 0x7faa8c0a5170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faa98005fd0 tx=0x7faa98009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.270+0000 7faaace00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] conn(0x7faa8c0adf10 0x7faa8c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.271+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== osd.1 v2:172.21.15.98:6800/1503486625 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa94023e50 con 0x7faa8c0adf10 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.296+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 --> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaa8075db0 con 0x7faa8c0adf10 2024-06-02T22:34:12.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaa4c00700 1 -- 172.21.15.31:0/3808226303 <== osd.1 v2:172.21.15.98:6800/1503486625 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faaa8075db0 con 0x7faa8c0adf10 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] conn(0x7faa8c0adf10 msgr2=0x7faa8c0b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] conn(0x7faa8c0adf10 0x7faa8c0b03b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa8c0a2cb0 msgr2=0x7faa8c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa8c0a2cb0 0x7faa8c0a5170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faa98005fd0 tx=0x7faa98009310 comp rx=0 tx=0).stop 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 msgr2=0x7faaa819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 --2- 172.21.15.31:0/3808226303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaa8074fe0 0x7faaa819b2e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa9400e9c0 tx=0x7faa9400ecd0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaace00700 1 -- 172.21.15.31:0/3808226303 reap_dead start 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.297+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 shutdown_connections 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.298+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 >> 172.21.15.31:0/3808226303 conn(0x7faaa80795f0 msgr2=0x7faaa80ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.298+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 shutdown_connections 2024-06-02T22:34:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.298+0000 7faaaee00700 1 -- 172.21.15.31:0/3808226303 wait complete. 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 -- 172.21.15.31:0/2735141484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 msgr2=0x7ff1f410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/2735141484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f410f320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b0d0 tx=0x7ff1ec00b3e0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 -- 172.21.15.31:0/2735141484 shutdown_connections 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/2735141484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f410f320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/2735141484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f41084e0 0x7ff1f41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/2735141484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f406a170 0x7ff1f406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 -- 172.21.15.31:0/2735141484 >> 172.21.15.31:0/2735141484 conn(0x7ff1f40782c0 msgr2=0x7ff1f40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 -- 172.21.15.31:0/2735141484 shutdown_connections 2024-06-02T22:34:12.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.804+0000 7ff1fbc00700 1 -- 172.21.15.31:0/2735141484 wait complete. 2024-06-02T22:34:12.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.806+0000 7ff1fbc00700 1 Processor -- start 2024-06-02T22:34:12.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 -- start start 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f406a170 0x7ff1f419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f41084e0 0x7ff1f41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f4112730 con 0x7ff1f406a170 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41125b0 con 0x7ff1f41084e0 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.807+0000 7ff1fbc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f41128b0 con 0x7ff1f406ab10 2024-06-02T22:34:12.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f419ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45252/0 (socket says 172.21.15.31:45252) 2024-06-02T22:34:12.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 -- 172.21.15.31:0/795840868 learned_addr learned my addr 172.21.15.31:0/795840868 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:12.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f9c00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f41084e0 0x7ff1f41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 -- 172.21.15.31:0/795840868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f41084e0 msgr2=0x7ff1f41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1f41084e0 0x7ff1f41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 -- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f406a170 msgr2=0x7ff1f419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.808+0000 7ff1f3e00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1f406a170 0x7ff1f419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1f3e00700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f4198f60 con 0x7ff1f406ab10 2024-06-02T22:34:12.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1f3e00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f419ed70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000e9a0 tx=0x7ff1e000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e000cbd0 con 0x7ff1f406ab10 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f41991f0 con 0x7ff1f406ab10 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1e000cd70 con 0x7ff1f406ab10 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.809+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0018750 con 0x7ff1f406ab10 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.810+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f41996d0 con 0x7ff1f406ab10 2024-06-02T22:34:12.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.810+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1f4062b60 con 0x7ff1f406ab10 2024-06-02T22:34:12.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.815+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff1e0010430 con 0x7ff1f406ab10 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.817+0000 7ff1f1600700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff1dc0a2d30 0x7ff1dc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.817+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff1e00d0150 con 0x7ff1f406ab10 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.818+0000 7ff1f9200700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff1dc0a2d30 0x7ff1dc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.818+0000 7ff1f1600700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] conn(0x7ff1dc0adf90 0x7ff1dc0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.818+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1e0028ea0 con 0x7ff1dc0adf90 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.818+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7ff1e00d0540 con 0x7ff1f406ab10 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.818+0000 7ff1f9c00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] conn(0x7ff1dc0adf90 0x7ff1dc0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.819+0000 7ff1f9200700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff1dc0a2d30 0x7ff1dc0a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4199b30 tx=0x7ff1e8009620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.819+0000 7ff1f9c00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] conn(0x7ff1dc0adf90 0x7ff1dc0b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:12.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.820+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== osd.6 v2:172.21.15.31:6818/3425159606 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1e0028ea0 con 0x7ff1dc0adf90 2024-06-02T22:34:12.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.839+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 --> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1f4062fe0 con 0x7ff1dc0adf90 2024-06-02T22:34:12.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.840+0000 7ff1f1600700 1 -- 172.21.15.31:0/795840868 <== osd.6 v2:172.21.15.31:6818/3425159606 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff1f4062fe0 con 0x7ff1dc0adf90 2024-06-02T22:34:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] conn(0x7ff1dc0adf90 msgr2=0x7ff1dc0b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] conn(0x7ff1dc0adf90 0x7ff1dc0b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff1dc0a2d30 msgr2=0x7ff1dc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff1dc0a2d30 0x7ff1dc0a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4199b30 tx=0x7ff1e8009620 comp rx=0 tx=0).stop 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 msgr2=0x7ff1f419ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 --2- 172.21.15.31:0/795840868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f406ab10 0x7ff1f419ed70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000e9a0 tx=0x7ff1e000ecb0 comp rx=0 tx=0).stop 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1f9c00700 1 -- 172.21.15.31:0/795840868 reap_dead start 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 shutdown_connections 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 >> 172.21.15.31:0/795840868 conn(0x7ff1f40782c0 msgr2=0x7ff1f40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 shutdown_connections 2024-06-02T22:34:12.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:12.841+0000 7ff1fbc00700 1 -- 172.21.15.31:0/795840868 wait complete. 2024-06-02T22:34:13.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:13 smithi178 ceph-mon[36614]: pgmap v428: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:13.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:13 smithi031 ceph-mon[31767]: pgmap v428: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:13.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:13 smithi098 ceph-mon[36750]: pgmap v428: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:14.219 INFO:teuthology.orchestra.run.smithi031.stdout:253403070533 2024-06-02T22:34:14.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-02T22:34:14.858 INFO:teuthology.orchestra.run.smithi031.stdout:197568495698 2024-06-02T22:34:14.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 -- 172.21.15.31:0/4276396072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c01033e0 msgr2=0x7f47c006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 --2- 172.21.15.31:0/4276396072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c01033e0 0x7f47c006ab60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009990 tx=0x7f47b4009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 -- 172.21.15.31:0/4276396072 shutdown_connections 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 --2- 172.21.15.31:0/4276396072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c010ede0 0x7f47c01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 --2- 172.21.15.31:0/4276396072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c01033e0 0x7f47c006ab60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 --2- 172.21.15.31:0/4276396072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47c006b0a0 0x7f47c006b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 -- 172.21.15.31:0/4276396072 >> 172.21.15.31:0/4276396072 conn(0x7f47c0078340 msgr2=0x7f47c0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 -- 172.21.15.31:0/4276396072 shutdown_connections 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.248+0000 7f47c8200700 1 -- 172.21.15.31:0/4276396072 wait complete. 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.250+0000 7f47c8200700 1 Processor -- start 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.250+0000 7f47c8200700 1 -- start start 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 0x7f47c019ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47c01033e0 0x7f47c019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c010ede0 0x7f47c019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f47c01149a0 con 0x7f47c010ede0 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0114820 con 0x7f47c01033e0 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c8200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0114b20 con 0x7f47c006b0a0 2024-06-02T22:34:15.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c5800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 0x7f47c019ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c6200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c010ede0 0x7f47c019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c5800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 0x7f47c019ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45282/0 (socket says 172.21.15.31:45282) 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c5800700 1 -- 172.21.15.31:0/490964048 learned_addr learned my addr 172.21.15.31:0/490964048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.251+0000 7f47c4e00700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47c01033e0 0x7f47c019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 -- 172.21.15.31:0/490964048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47c01033e0 msgr2=0x7f47c019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f47c01033e0 0x7f47c019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 -- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c010ede0 msgr2=0x7f47c019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c010ede0 0x7f47c019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c019fd60 con 0x7f47c006b0a0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47c5800700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 0x7f47c019ad50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000c00 tx=0x7f47b400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.252+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4027070 con 0x7f47c006b0a0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.253+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c019fff0 con 0x7f47c006b0a0 2024-06-02T22:34:15.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.253+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47b4003d70 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.253+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400f460 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.253+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01a78d0 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.254+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47c01011c0 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.256+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f47b402a070 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.257+0000 7f47be000700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f47a80a2cb0 0x7f47a80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f47b40d0990 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47c4e00700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f47a80a2cb0 0x7f47a80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47be000700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] conn(0x7f47a80adf10 0x7f47a80b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47a80b0a80 con 0x7f47a80adf10 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f47b40d0d40 con 0x7f47c006b0a0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.258+0000 7f47c6200700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] conn(0x7f47a80adf10 0x7f47a80b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.259+0000 7f47c4e00700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f47a80a2cb0 0x7f47a80a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47c0078a80 tx=0x7f47ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.259+0000 7f47c6200700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] conn(0x7f47a80adf10 0x7f47a80b03b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:15.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.260+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== osd.5 v2:172.21.15.178:6808/1564865420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47a80b0a80 con 0x7f47a80adf10 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.279+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 --> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47c006a410 con 0x7f47a80adf10 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.280+0000 7f47be000700 1 -- 172.21.15.31:0/490964048 <== osd.5 v2:172.21.15.178:6808/1564865420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47c006a410 con 0x7f47a80adf10 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] conn(0x7f47a80adf10 msgr2=0x7f47a80b03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] conn(0x7f47a80adf10 0x7f47a80b03b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f47a80a2cb0 msgr2=0x7f47a80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f47a80a2cb0 0x7f47a80a5170 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47c0078a80 tx=0x7f47ac009260 comp rx=0 tx=0).stop 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 msgr2=0x7f47c019ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 --2- 172.21.15.31:0/490964048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47c006b0a0 0x7f47c019ad50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47b4000c00 tx=0x7f47b400bab0 comp rx=0 tx=0).stop 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c6200700 1 -- 172.21.15.31:0/490964048 reap_dead start 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 shutdown_connections 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.281+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 >> 172.21.15.31:0/490964048 conn(0x7f47c0078340 msgr2=0x7f47c0100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.282+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 shutdown_connections 2024-06-02T22:34:15.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:14.282+0000 7f47c8200700 1 -- 172.21.15.31:0/490964048 wait complete. 2024-06-02T22:34:15.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:15 smithi178 ceph-mon[36614]: pgmap v429: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T22:34:15.833 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:15 smithi031 ceph-mon[31767]: pgmap v429: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T22:34:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:15 smithi098 ceph-mon[36750]: pgmap v429: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-06-02T22:34:15.982 INFO:teuthology.orchestra.run.smithi031.stdout:55834574958 2024-06-02T22:34:15.982 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-02T22:34:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 -- 172.21.15.31:0/1933359239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5950100f20 msgr2=0x7f5950101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 --2- 172.21.15.31:0/1933359239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5950100f20 0x7f5950101300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5940009990 tx=0x7f5940009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 -- 172.21.15.31:0/1933359239 shutdown_connections 2024-06-02T22:34:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 --2- 172.21.15.31:0/1933359239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5950107790 0x7f595010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 --2- 172.21.15.31:0/1933359239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5950100f20 0x7f5950101300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 --2- 172.21.15.31:0/1933359239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59501018d0 0x7f59501070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 -- 172.21.15.31:0/1933359239 >> 172.21.15.31:0/1933359239 conn(0x7f5950076640 msgr2=0x7f5950076a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 -- 172.21.15.31:0/1933359239 shutdown_connections 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.229+0000 7f5955400700 1 -- 172.21.15.31:0/1933359239 wait complete. 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.231+0000 7f5955400700 1 Processor -- start 2024-06-02T22:34:16.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.231+0000 7f5955400700 1 -- start start 2024-06-02T22:34:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.231+0000 7f5955400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 0x7f5950101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.231+0000 7f5955400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 0x7f59501023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.231+0000 7f5955400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5950107790 0x7f5950102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5955400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112780 con 0x7f5950100f20 2024-06-02T22:34:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5955400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112600 con 0x7f59501018d0 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5955400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5950112900 con 0x7f5950107790 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f594fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 0x7f5950101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 0x7f59501023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 0x7f59501023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40490/0 (socket says 172.21.15.31:40490) 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 -- 172.21.15.31:0/889277275 learned_addr learned my addr 172.21.15.31:0/889277275 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f594fe00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 0x7f5950101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52504/0 (socket says 172.21.15.31:52504) 2024-06-02T22:34:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5954a00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5950107790 0x7f5950102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:16.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 -- 172.21.15.31:0/889277275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5950107790 msgr2=0x7f5950102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5950107790 0x7f5950102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 -- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 msgr2=0x7f5950101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 0x7f5950101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f5947400700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59501a70e0 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.232+0000 7f594fe00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5950100f20 0x7f5950101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f5947400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 0x7f59501023e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f593800efc0 tx=0x7f593800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593800c9c0 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5938019070 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59380146e0 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59501a7370 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.233+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59501a7860 con 0x7f59501018d0 2024-06-02T22:34:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.235+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5950062ba0 con 0x7f59501018d0 2024-06-02T22:34:16.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.237+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5938012050 con 0x7f59501018d0 2024-06-02T22:34:16.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.238+0000 7f594d600700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59340a2d30 0x7f59340a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:16.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.238+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f59380cf880 con 0x7f59501018d0 2024-06-02T22:34:16.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f594fe00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59340a2d30 0x7f59340a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:16.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f594d600700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] conn(0x7f59340adf90 0x7f59340b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:16.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f593800df90 con 0x7f59340adf90 2024-06-02T22:34:16.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f59380cfc30 con 0x7f59501018d0 2024-06-02T22:34:16.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f5954a00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] conn(0x7f59340adf90 0x7f59340b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:16.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.239+0000 7f594fe00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59340a2d30 0x7f59340a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5940006010 tx=0x7f594000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:16.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.240+0000 7f5954a00700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] conn(0x7f59340adf90 0x7f59340b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:16.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.241+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== osd.10 v2:172.21.15.98:6824/810778248 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f593800df90 con 0x7f59340adf90 2024-06-02T22:34:16.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.273+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 --> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5950063070 con 0x7f59340adf90 2024-06-02T22:34:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f594d600700 1 -- 172.21.15.31:0/889277275 <== osd.10 v2:172.21.15.98:6824/810778248 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5950063070 con 0x7f59340adf90 2024-06-02T22:34:16.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] conn(0x7f59340adf90 msgr2=0x7f59340b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] conn(0x7f59340adf90 0x7f59340b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59340a2d30 msgr2=0x7f59340a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f59340a2d30 0x7f59340a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5940006010 tx=0x7f594000b260 comp rx=0 tx=0).stop 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 msgr2=0x7f59501023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5955400700 1 --2- 172.21.15.31:0/889277275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59501018d0 0x7f59501023e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f593800efc0 tx=0x7f593800c3a0 comp rx=0 tx=0).stop 2024-06-02T22:34:16.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.274+0000 7f5954a00700 1 -- 172.21.15.31:0/889277275 reap_dead start 2024-06-02T22:34:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.275+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 shutdown_connections 2024-06-02T22:34:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.275+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 >> 172.21.15.31:0/889277275 conn(0x7f5950076640 msgr2=0x7f59500fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.275+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 shutdown_connections 2024-06-02T22:34:16.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:16.275+0000 7f5955400700 1 -- 172.21.15.31:0/889277275 wait complete. 2024-06-02T22:34:17.472 INFO:teuthology.orchestra.run.smithi031.stdout:163208757335 2024-06-02T22:34:17.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-02T22:34:17.655 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:17 smithi031 ceph-mon[31767]: pgmap v430: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-06-02T22:34:17.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:17 smithi178 ceph-mon[36614]: pgmap v430: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-06-02T22:34:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:17 smithi098 ceph-mon[36750]: pgmap v430: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-06-02T22:34:18.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 -- 172.21.15.31:0/3007059478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c105070 msgr2=0x7fbd5c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3007059478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c105070 0x7fbd5c111580 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009f90 tx=0x7fbd5400b330 comp rx=0 tx=0).stop 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 -- 172.21.15.31:0/3007059478 shutdown_connections 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3007059478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c105070 0x7fbd5c111580 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3007059478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c10a6b0 0x7fbd5c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3007059478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 -- 172.21.15.31:0/3007059478 >> 172.21.15.31:0/3007059478 conn(0x7fbd5c1001a0 msgr2=0x7fbd5c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 -- 172.21.15.31:0/3007059478 shutdown_connections 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.399+0000 7fbd61c00700 1 -- 172.21.15.31:0/3007059478 wait complete. 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.400+0000 7fbd61c00700 1 Processor -- start 2024-06-02T22:34:18.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.400+0000 7fbd61c00700 1 -- start start 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c105070 0x7fbd5c19b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c10a6b0 0x7fbd5c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c114a50 con 0x7fbd5c1046b0 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1148d0 con 0x7fbd5c10a6b0 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd61c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c114bd0 con 0x7fbd5c105070 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd5aa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd5aa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52526/0 (socket says 172.21.15.31:52526) 2024-06-02T22:34:18.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd5aa00700 1 -- 172.21.15.31:0/3150363804 learned_addr learned my addr 172.21.15.31:0/3150363804 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd52000700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c105070 0x7fbd5c19b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.401+0000 7fbd5b400700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c10a6b0 0x7fbd5c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 -- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c105070 msgr2=0x7fbd5c19b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd5c105070 0x7fbd5c19b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 -- 172.21.15.31:0/3150363804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c10a6b0 msgr2=0x7fbd5c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd5c10a6b0 0x7fbd5c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c19fe10 con 0x7fbd5c1046b0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd5aa00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c19ae00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00ec10 tx=0x7fbd4c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00cc90 con 0x7fbd5c1046b0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1a0100 con 0x7fbd5c1046b0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd4c00ce30 con 0x7fbd5c1046b0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.402+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c010690 con 0x7fbd5c1046b0 2024-06-02T22:34:18.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.403+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1a7980 con 0x7fbd5c1046b0 2024-06-02T22:34:18.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.404+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd5c1010e0 con 0x7fbd5c1046b0 2024-06-02T22:34:18.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.406+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd4c003680 con 0x7fbd5c1046b0 2024-06-02T22:34:18.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.407+0000 7fbd53e00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd3c0a2d30 0x7fbd3c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:18.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fbd4c0cf810 con 0x7fbd5c1046b0 2024-06-02T22:34:18.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd52000700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd3c0a2d30 0x7fbd3c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:18.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd53e00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] conn(0x7fbd3c0adf90 0x7fbd3c0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:18.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd4c00be50 con 0x7fbd3c0adf90 2024-06-02T22:34:18.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7fbd4c0d6050 con 0x7fbd5c1046b0 2024-06-02T22:34:18.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd5b400700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] conn(0x7fbd3c0adf90 0x7fbd3c0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:18.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.408+0000 7fbd52000700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd3c0a2d30 0x7fbd3c0a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c109b90 tx=0x7fbd44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:18.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.409+0000 7fbd5b400700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] conn(0x7fbd3c0adf90 0x7fbd3c0b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:18.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.410+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== osd.11 v2:172.21.15.178:6824/2684096429 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd4c00be50 con 0x7fbd3c0adf90 2024-06-02T22:34:18.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.428+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 --> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd5c105df0 con 0x7fbd3c0adf90 2024-06-02T22:34:18.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.429+0000 7fbd53e00700 1 -- 172.21.15.31:0/3150363804 <== osd.11 v2:172.21.15.178:6824/2684096429 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbd5c105df0 con 0x7fbd3c0adf90 2024-06-02T22:34:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.429+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] conn(0x7fbd3c0adf90 msgr2=0x7fbd3c0b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.429+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] conn(0x7fbd3c0adf90 0x7fbd3c0b0430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:18.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd3c0a2d30 msgr2=0x7fbd3c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbd3c0a2d30 0x7fbd3c0a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c109b90 tx=0x7fbd44009260 comp rx=0 tx=0).stop 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 msgr2=0x7fbd5c19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 --2- 172.21.15.31:0/3150363804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5c1046b0 0x7fbd5c19ae00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00ec10 tx=0x7fbd4c00ef20 comp rx=0 tx=0).stop 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd5b400700 1 -- 172.21.15.31:0/3150363804 reap_dead start 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 shutdown_connections 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 >> 172.21.15.31:0/3150363804 conn(0x7fbd5c1001a0 msgr2=0x7fbd5c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 shutdown_connections 2024-06-02T22:34:18.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.430+0000 7fbd61c00700 1 -- 172.21.15.31:0/3150363804 wait complete. 2024-06-02T22:34:19.470 INFO:teuthology.orchestra.run.smithi031.stdout:34359738482 2024-06-02T22:34:19.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-02T22:34:19.741 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:19 smithi031 ceph-mon[31767]: pgmap v431: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:19.796 INFO:teuthology.orchestra.run.smithi031.stdout:309237645371 2024-06-02T22:34:19.796 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-02T22:34:19.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:19 smithi178 ceph-mon[36614]: pgmap v431: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:19 smithi098 ceph-mon[36750]: pgmap v431: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:20.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.742+0000 7f8c59c00700 1 -- 172.21.15.31:0/2039285081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 msgr2=0x7f8c5410ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.742+0000 7f8c59c00700 1 --2- 172.21.15.31:0/2039285081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 0x7f8c5410ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8c440098f0 tx=0x7f8c44009c00 comp rx=0 tx=0).stop 2024-06-02T22:34:20.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 -- 172.21.15.31:0/2039285081 shutdown_connections 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 --2- 172.21.15.31:0/2039285081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54109460 0x7f8c54115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 --2- 172.21.15.31:0/2039285081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 0x7f8c5410ee80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 --2- 172.21.15.31:0/2039285081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c54108aa0 0x7f8c54108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 -- 172.21.15.31:0/2039285081 >> 172.21.15.31:0/2039285081 conn(0x7f8c54075c60 msgr2=0x7f8c541072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 -- 172.21.15.31:0/2039285081 shutdown_connections 2024-06-02T22:34:20.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.743+0000 7f8c59c00700 1 -- 172.21.15.31:0/2039285081 wait complete. 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.744+0000 7f8c59c00700 1 Processor -- start 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.744+0000 7f8c59c00700 1 -- start start 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 0x7f8c5419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c54109460 0x7f8c5419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 0x7f8c541a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54118e40 con 0x7f8c54109460 2024-06-02T22:34:20.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54118cc0 con 0x7f8c54108aa0 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c59c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c54118fc0 con 0x7f8c5410eaa0 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 0x7f8c5419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c53400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 0x7f8c541a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 0x7f8c5419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40526/0 (socket says 172.21.15.31:40526) 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 -- 172.21.15.31:0/783554276 learned_addr learned my addr 172.21.15.31:0/783554276 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c4be00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c54109460 0x7f8c5419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 -- 172.21.15.31:0/783554276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 msgr2=0x7f8c541a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5410eaa0 0x7f8c541a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 -- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c54109460 msgr2=0x7f8c5419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c54109460 0x7f8c5419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.745+0000 7f8c52a00700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c541a42a0 con 0x7f8c54108aa0 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c52a00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 0x7f8c5419f290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c44005950 tx=0x7f8c4400fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44005140 con 0x7f8c54108aa0 2024-06-02T22:34:20.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c541a4530 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c4400b560 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44003ae0 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.746+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c541abe10 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.747+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c54062c20 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.750+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8c4400ba80 con 0x7f8c54108aa0 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.751+0000 7f8c4b400700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8c380a2cb0 0x7f8c380a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.751+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8c440d0910 con 0x7f8c54108aa0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.751+0000 7f8c4be00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8c380a2cb0 0x7f8c380a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.752+0000 7f8c4b400700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] conn(0x7f8c380adde0 0x7f8c380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.752+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c44001d30 con 0x7f8c380adde0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.752+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f8c440d0cc0 con 0x7f8c54108aa0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.752+0000 7f8c53400700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] conn(0x7f8c380adde0 0x7f8c380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.752+0000 7f8c4be00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8c380a2cb0 0x7f8c380a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c54077bd0 tx=0x7f8c3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.753+0000 7f8c53400700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] conn(0x7f8c380adde0 0x7f8c380b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.754+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== osd.4 v2:172.21.15.98:6808/4148113847 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c44001d30 con 0x7f8c380adde0 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.772+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 --> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c540630a0 con 0x7f8c380adde0 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.773+0000 7f8c4b400700 1 -- 172.21.15.31:0/783554276 <== osd.4 v2:172.21.15.98:6808/4148113847 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c540630a0 con 0x7f8c380adde0 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.773+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] conn(0x7f8c380adde0 msgr2=0x7f8c380b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.773+0000 7f8c59c00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] conn(0x7f8c380adde0 0x7f8c380b0280 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8c380a2cb0 msgr2=0x7f8c380a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8c380a2cb0 0x7f8c380a5170 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c54077bd0 tx=0x7f8c3c009260 comp rx=0 tx=0).stop 2024-06-02T22:34:20.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 msgr2=0x7f8c5419f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 --2- 172.21.15.31:0/783554276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c54108aa0 0x7f8c5419f290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c44005950 tx=0x7f8c4400fb20 comp rx=0 tx=0).stop 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c53400700 1 -- 172.21.15.31:0/783554276 reap_dead start 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 shutdown_connections 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 >> 172.21.15.31:0/783554276 conn(0x7f8c54075c60 msgr2=0x7f8c54076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 shutdown_connections 2024-06-02T22:34:20.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:18.774+0000 7f8c59c00700 1 -- 172.21.15.31:0/783554276 wait complete. 2024-06-02T22:34:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 -- 172.21.15.31:0/4019721662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 msgr2=0x7f347410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 --2- 172.21.15.31:0/4019721662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347410e950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3460009990 tx=0x7f3460009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 -- 172.21.15.31:0/4019721662 shutdown_connections 2024-06-02T22:34:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 --2- 172.21.15.31:0/4019721662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 0x7f3474111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 --2- 172.21.15.31:0/4019721662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f3474074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 --2- 172.21.15.31:0/4019721662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347410e950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 -- 172.21.15.31:0/4019721662 >> 172.21.15.31:0/4019721662 conn(0x7f34740795f0 msgr2=0x7f3474079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 -- 172.21.15.31:0/4019721662 shutdown_connections 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.677+0000 7f347b400700 1 -- 172.21.15.31:0/4019721662 wait complete. 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.678+0000 7f347b400700 1 Processor -- start 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 -- start start 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f347419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 0x7f347419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3474114a50 con 0x7f3474074fe0 2024-06-02T22:34:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34741148d0 con 0x7f34740746c0 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.679+0000 7f347b400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3474114bd0 con 0x7f347410ee90 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3478a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f347419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3478a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f347419aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47560/0 (socket says 172.21.15.31:47560) 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3478a00700 1 -- 172.21.15.31:0/1036376867 learned_addr learned my addr 172.21.15.31:0/1036376867 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 0x7f347419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3473e00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 -- 172.21.15.31:0/1036376867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 msgr2=0x7f347419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f347419aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 -- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 msgr2=0x7f347419b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347419b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347419fe80 con 0x7f347410ee90 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3478a00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34740746c0 0x7f347419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3473e00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3474074fe0 0x7f347419b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.680+0000 7f3479400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 0x7f347419f740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f346c00efc0 tx=0x7f346c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.681+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0092e0 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.681+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346c004bb0 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.681+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c004280 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.681+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34741a0110 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.682+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34741a79f0 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.682+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34740fffe0 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.685+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f346c012050 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.686+0000 7f3471600700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f345c0a2d30 0x7f345c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.686+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f346c0cf3a0 con 0x7f347410ee90 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3471600700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] conn(0x7f345c0adf90 0x7f345c0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3478a00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f345c0a2d30 0x7f345c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f346c0048a0 con 0x7f345c0adf90 2024-06-02T22:34:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=99) ==== 24+0+0 (secure 0 0 0) 0x7f346c0cf790 con 0x7f347410ee90 2024-06-02T22:34:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3473e00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] conn(0x7f345c0adf90 0x7f345c0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.687+0000 7f3478a00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f345c0a2d30 0x7f345c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3468011550 tx=0x7f3468009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.688+0000 7f3473e00700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] conn(0x7f345c0adf90 0x7f345c0b0430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.689+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== osd.9 v2:172.21.15.31:6826/3616812337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f346c0048a0 con 0x7f345c0adf90 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.708+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 --> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3474075df0 con 0x7f345c0adf90 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.708+0000 7f3471600700 1 -- 172.21.15.31:0/1036376867 <== osd.9 v2:172.21.15.31:6826/3616812337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3474075df0 con 0x7f345c0adf90 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.708+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] conn(0x7f345c0adf90 msgr2=0x7f345c0b0430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.708+0000 7f347b400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] conn(0x7f345c0adf90 0x7f345c0b0430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f345c0a2d30 msgr2=0x7f345c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f345c0a2d30 0x7f345c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3468011550 tx=0x7f3468009260 comp rx=0 tx=0).stop 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 msgr2=0x7f347419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 --2- 172.21.15.31:0/1036376867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f347410ee90 0x7f347419f740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f346c00efc0 tx=0x7f346c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f3479400700 1 -- 172.21.15.31:0/1036376867 reap_dead start 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 shutdown_connections 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 >> 172.21.15.31:0/1036376867 conn(0x7f34740795f0 msgr2=0x7f34740ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 shutdown_connections 2024-06-02T22:34:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:20.709+0000 7f347b400700 1 -- 172.21.15.31:0/1036376867 wait complete. 2024-06-02T22:34:21.116 INFO:teuthology.orchestra.run.smithi031.stdout:141733920863 2024-06-02T22:34:21.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-02T22:34:21.765 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:21 smithi098 ceph-mon[36750]: pgmap v432: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:21.767 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:21 smithi031 ceph-mon[31767]: pgmap v432: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:21.793 INFO:teuthology.orchestra.run.smithi031.stdout:343597383734 2024-06-02T22:34:21.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-02T22:34:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:21 smithi178 ceph-mon[36614]: pgmap v432: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:22.594 INFO:teuthology.orchestra.run.smithi031.stdout:287762808898 2024-06-02T22:34:22.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-02T22:34:22.631 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.638 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.648 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.649 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.653 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.663 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.749 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:22.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:34:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:22.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:22 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:22.861 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:34:22.862 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:22.862 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:22 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:34:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:22.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:22 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: pgmap v433: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:34:23.788 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: pgmap v433: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-06-02T22:34:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:34:23.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:34:23.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: pgmap v433: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 11 op/s 2024-06-02T22:34:23.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:23.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:34:23.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:34:23.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:34:24.271 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:24.405 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:25.749 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:25 smithi031 ceph-mon[31767]: pgmap v434: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:25.749 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:25 smithi031 ceph-mon[31767]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-02T22:34:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:25 smithi178 ceph-mon[36614]: pgmap v434: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:25.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:25 smithi178 ceph-mon[36614]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-02T22:34:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:25 smithi098 ceph-mon[36750]: pgmap v434: 129 pgs: 129 active+clean; 649 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:25 smithi098 ceph-mon[36750]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-02T22:34:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:27 smithi178 ceph-mon[36614]: pgmap v435: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-02T22:34:27.821 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:27 smithi031 ceph-mon[31767]: pgmap v435: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-02T22:34:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:27 smithi098 ceph-mon[36750]: pgmap v435: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-06-02T22:34:28.911 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:29.744 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:29 smithi031 ceph-mon[31767]: pgmap v436: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:34:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:29 smithi178 ceph-mon[36614]: pgmap v436: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:34:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:29 smithi098 ceph-mon[36750]: pgmap v436: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 9 op/s 2024-06-02T22:34:31.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:31 smithi178 ceph-mon[36614]: pgmap v437: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-02T22:34:31.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:31 smithi031 ceph-mon[31767]: pgmap v437: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-02T22:34:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:31 smithi098 ceph-mon[36750]: pgmap v437: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 10 op/s 2024-06-02T22:34:32.046 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:33 smithi031 ceph-mon[31767]: pgmap v438: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:33 smithi098 ceph-mon[36750]: pgmap v438: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:33 smithi178 ceph-mon[36614]: pgmap v438: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:34.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 -- 172.21.15.31:0/4158563802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 msgr2=0x7fa42c105290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 --2- 172.21.15.31:0/4158563802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c105290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa418009990 tx=0x7fa418009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 -- 172.21.15.31:0/4158563802 shutdown_connections 2024-06-02T22:34:34.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 --2- 172.21.15.31:0/4158563802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 --2- 172.21.15.31:0/4158563802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 --2- 172.21.15.31:0/4158563802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c105290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 -- 172.21.15.31:0/4158563802 >> 172.21.15.31:0/4158563802 conn(0x7fa42c076130 msgr2=0x7fa42c076540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 -- 172.21.15.31:0/4158563802 shutdown_connections 2024-06-02T22:34:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.635+0000 7fa430c00700 1 -- 172.21.15.31:0/4158563802 wait complete. 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.636+0000 7fa430c00700 1 Processor -- start 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 -- start start 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c1027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c111650 con 0x7fa42c1059c0 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1114d0 con 0x7fa42c100a90 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa430c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa42c1117d0 con 0x7fa42c101440 2024-06-02T22:34:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa42b400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.637+0000 7fa42aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c1027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42be00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43768/0 (socket says 172.21.15.31:43768) 2024-06-02T22:34:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c1027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56746/0 (socket says 172.21.15.31:56746) 2024-06-02T22:34:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 -- 172.21.15.31:0/358960098 learned_addr learned my addr 172.21.15.31:0/358960098 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 -- 172.21.15.31:0/358960098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 msgr2=0x7fa42c1027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c1027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 -- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 msgr2=0x7fa42c102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 -- 172.21.15.31:0/358960098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42c1a7060 con 0x7fa42c100a90 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42be00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.638+0000 7fa42b400700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00e9a0 tx=0x7fa41c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.639+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00ca10 con 0x7fa42c100a90 2024-06-02T22:34:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.639+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41c00cbb0 con 0x7fa42c100a90 2024-06-02T22:34:34.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.639+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c018680 con 0x7fa42c100a90 2024-06-02T22:34:34.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.639+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42c1a7350 con 0x7fa42c100a90 2024-06-02T22:34:34.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.639+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42c1a7840 con 0x7fa42c100a90 2024-06-02T22:34:34.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.640+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42c069180 con 0x7fa42c100a90 2024-06-02T22:34:34.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.642+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa41c010430 con 0x7fa42c100a90 2024-06-02T22:34:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.643+0000 7fa423e00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 0x7fa4100a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.643+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fa41c0cf950 con 0x7fa42c100a90 2024-06-02T22:34:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.644+0000 7fa42aa00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 0x7fa4100a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.644+0000 7fa42aa00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 0x7fa4100a5160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ff280 tx=0x7fa418005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:34.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.646+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa41c09c4c0 con 0x7fa42c100a90 2024-06-02T22:34:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 -- 172.21.15.31:0/2924111067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc701030f0 msgr2=0x7fdc70107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 --2- 172.21.15.31:0/2924111067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc701030f0 0x7fdc70107110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0099c0 tx=0x7fdc5c009cd0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 -- 172.21.15.31:0/2924111067 shutdown_connections 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 --2- 172.21.15.31:0/2924111067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc70107840 0x7fdc7010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 --2- 172.21.15.31:0/2924111067 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70102740 0x7fdc70102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 --2- 172.21.15.31:0/2924111067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc701030f0 0x7fdc70107110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 -- 172.21.15.31:0/2924111067 >> 172.21.15.31:0/2924111067 conn(0x7fdc700795f0 msgr2=0x7fdc70079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.861+0000 7fdc77600700 1 -- 172.21.15.31:0/2924111067 shutdown_connections 2024-06-02T22:34:34.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.862+0000 7fdc77600700 1 -- 172.21.15.31:0/2924111067 wait complete. 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 Processor -- start 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 -- start start 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc701030f0 0x7fdc7019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 0x7fdc7019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdc701127a0 con 0x7fdc70102740 2024-06-02T22:34:34.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70112620 con 0x7fdc70107840 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.863+0000 7fdc77600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdc70112920 con 0x7fdc701030f0 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc74c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 0x7fdc7019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc74c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34140/0 (socket says 172.21.15.31:34140) 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc74c00700 1 -- 172.21.15.31:0/3538583677 learned_addr learned my addr 172.21.15.31:0/3538583677 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:34.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc6fe00700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc701030f0 0x7fdc7019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 -- 172.21.15.31:0/3538583677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc701030f0 msgr2=0x7fdc7019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc701030f0 0x7fdc7019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 -- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 msgr2=0x7fdc7019ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc75600700 1 -- 172.21.15.31:0/3538583677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7019fe30 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.864+0000 7fdc74c00700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc75600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 0x7fdc7019f6f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800efc0 tx=0x7fdc6800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc680092e0 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc701a00c0 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc68004bb0 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68004280 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.865+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc701a79a0 con 0x7fdc70107840 2024-06-02T22:34:34.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.866+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc70069180 con 0x7fdc70107840 2024-06-02T22:34:34.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.868+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fdc6801b030 con 0x7fdc70107840 2024-06-02T22:34:34.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.870+0000 7fdc6d600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 0x7fdc580a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:34.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.870+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdc680cef90 con 0x7fdc70107840 2024-06-02T22:34:34.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.870+0000 7fdc74c00700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 0x7fdc580a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:34.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.871+0000 7fdc74c00700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 0x7fdc580a50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc64011550 tx=0x7fdc64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:34.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.874+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdc68022020 con 0x7fdc70107840 2024-06-02T22:34:34.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.885+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa42c02de60 con 0x7fa42c100a90 2024-06-02T22:34:34.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.886+0000 7fa423e00700 1 -- 172.21.15.31:0/358960098 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa41c09bdc0 con 0x7fa42c100a90 2024-06-02T22:34:34.887 INFO:teuthology.orchestra.run.smithi031.stdout:107374182502 2024-06-02T22:34:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 msgr2=0x7fa4100a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 0x7fa4100a5160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ff280 tx=0x7fa418005fd0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 msgr2=0x7fa42c1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00e9a0 tx=0x7fa41c00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 shutdown_connections 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fa4100a2ca0 0x7fa4100a5160 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa42c1059c0 0x7fa42c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa42c100a90 0x7fa42c1022a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 --2- 172.21.15.31:0/358960098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42c101440 0x7fa42c1027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.889+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 >> 172.21.15.31:0/358960098 conn(0x7fa42c076130 msgr2=0x7fa42c104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.890+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 shutdown_connections 2024-06-02T22:34:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:34.890+0000 7fa430c00700 1 -- 172.21.15.31:0/358960098 wait complete. 2024-06-02T22:34:35.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 -- 172.21.15.31:0/66341398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b481045c0 msgr2=0x7f8b48104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 --2- 172.21.15.31:0/66341398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b481045c0 0x7f8b48104a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009920 tx=0x7f8b34009c30 comp rx=0 tx=0).stop 2024-06-02T22:34:35.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 -- 172.21.15.31:0/66341398 shutdown_connections 2024-06-02T22:34:35.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 --2- 172.21.15.31:0/66341398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b48104f80 0x7f8b48111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 --2- 172.21.15.31:0/66341398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 0x7f8b4810aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 --2- 172.21.15.31:0/66341398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b481045c0 0x7f8b48104a40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 -- 172.21.15.31:0/66341398 >> 172.21.15.31:0/66341398 conn(0x7f8b48100070 msgr2=0x7f8b48102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:35.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.049+0000 7f8b47e00700 1 -- 172.21.15.31:0/66341398 shutdown_connections 2024-06-02T22:34:35.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.050+0000 7f8b47e00700 1 -- 172.21.15.31:0/66341398 wait complete. 2024-06-02T22:34:35.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 Processor -- start 2024-06-02T22:34:35.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 -- start start 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 0x7f8b4819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 0x7f8b4819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48114970 con 0x7f8b4810a670 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b481147f0 con 0x7f8b48104f80 2024-06-02T22:34:35.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.051+0000 7f8b47e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8b48114af0 con 0x7f8b481045c0 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56790/0 (socket says 172.21.15.31:56790) 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46a00700 1 -- 172.21.15.31:0/3554200580 learned_addr learned my addr 172.21.15.31:0/3554200580 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b47400700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 0x7f8b4819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 0x7f8b4819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:35.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 -- 172.21.15.31:0/3554200580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 msgr2=0x7f8b4819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 -- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 msgr2=0x7f8b4819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 0x7f8b4819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46000700 1 -- 172.21.15.31:0/3554200580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4819fd70 con 0x7f8b48104f80 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.052+0000 7f8b46a00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b46000700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 0x7f8b4819b2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400a010 tx=0x7f8b3400fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:35.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340050c0 con 0x7f8b48104f80 2024-06-02T22:34:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3400b560 con 0x7f8b48104f80 2024-06-02T22:34:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b481a0000 con 0x7f8b48104f80 2024-06-02T22:34:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34003a00 con 0x7f8b48104f80 2024-06-02T22:34:35.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.053+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481a78e0 con 0x7f8b48104f80 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.054+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b48105ce0 con 0x7f8b48104f80 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.057+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8b34029060 con 0x7f8b48104f80 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.058+0000 7f8b3f400700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.058+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8b340cfe50 con 0x7f8b48104f80 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.058+0000 7f8b46a00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:35.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.059+0000 7f8b46a00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b38005950 tx=0x7f8b38009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:35.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.060+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8b34013030 con 0x7f8b48104f80 2024-06-02T22:34:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.119+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdc701a7b70 con 0x7fdc70107840 2024-06-02T22:34:35.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.120+0000 7fdc6d600700 1 -- 172.21.15.31:0/3538583677 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdc68010040 con 0x7fdc70107840 2024-06-02T22:34:35.121 INFO:teuthology.orchestra.run.smithi031.stdout:197568495702 2024-06-02T22:34:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 msgr2=0x7fdc580a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 0x7fdc580a50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdc64011550 tx=0x7fdc64009260 comp rx=0 tx=0).stop 2024-06-02T22:34:35.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 msgr2=0x7fdc7019f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 0x7fdc7019f6f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800efc0 tx=0x7fdc6800c3a0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 shutdown_connections 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdc580a2c20 0x7fdc580a50e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc70107840 0x7fdc7019f6f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc70102740 0x7fdc7019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 --2- 172.21.15.31:0/3538583677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc701030f0 0x7fdc7019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 >> 172.21.15.31:0/3538583677 conn(0x7fdc700795f0 msgr2=0x7fdc70100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 shutdown_connections 2024-06-02T22:34:35.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.123+0000 7fdc77600700 1 -- 172.21.15.31:0/3538583677 wait complete. 2024-06-02T22:34:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.299+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8b4802dca0 con 0x7f8b48104f80 2024-06-02T22:34:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.300+0000 7f8b3f400700 1 -- 172.21.15.31:0/3554200580 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8b3409ca50 con 0x7f8b48104f80 2024-06-02T22:34:35.301 INFO:teuthology.orchestra.run.smithi031.stdout:253403070539 2024-06-02T22:34:35.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 msgr2=0x7f8b2c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b38005950 tx=0x7f8b38009310 comp rx=0 tx=0).stop 2024-06-02T22:34:35.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 msgr2=0x7f8b4819b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:35.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 0x7f8b4819b2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400a010 tx=0x7f8b3400fa70 comp rx=0 tx=0).stop 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 shutdown_connections 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b2c0a2ca0 0x7f8b2c0a5160 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b4810a670 0x7f8b4819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b481045c0 0x7f8b4819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 --2- 172.21.15.31:0/3554200580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b48104f80 0x7f8b4819b2a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 >> 172.21.15.31:0/3554200580 conn(0x7f8b48100070 msgr2=0x7f8b48101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:35.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 shutdown_connections 2024-06-02T22:34:35.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:35.303+0000 7f8b47e00700 1 -- 172.21.15.31:0/3554200580 wait complete. 2024-06-02T22:34:35.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:35 smithi031 ceph-mon[31767]: pgmap v439: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-02T22:34:35.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:35 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/358960098' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T22:34:35.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:35 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3538583677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T22:34:35.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:35 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3554200580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T22:34:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:35 smithi098 ceph-mon[36750]: pgmap v439: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-02T22:34:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:35 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/358960098' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T22:34:35.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:35 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3538583677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T22:34:35.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:35 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3554200580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T22:34:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:35 smithi178 ceph-mon[36614]: pgmap v439: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-06-02T22:34:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:35 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/358960098' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T22:34:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:35 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3538583677' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T22:34:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:35 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3554200580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.836+0000 7f673c000700 1 -- 172.21.15.31:0/3349371713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67341078d0 msgr2=0x7f673406b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.836+0000 7f673c000700 1 --2- 172.21.15.31:0/3349371713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67341078d0 0x7f673406b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f67200098f0 tx=0x7f6720009c00 comp rx=0 tx=0).stop 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 -- 172.21.15.31:0/3349371713 shutdown_connections 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 --2- 172.21.15.31:0/3349371713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f673406b6c0 0x7f6734104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 --2- 172.21.15.31:0/3349371713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341074f0 0x7f673406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 --2- 172.21.15.31:0/3349371713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67341078d0 0x7f673406b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 -- 172.21.15.31:0/3349371713 >> 172.21.15.31:0/3349371713 conn(0x7f6734078340 msgr2=0x7f6734078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:37.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 -- 172.21.15.31:0/3349371713 shutdown_connections 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.837+0000 7f673c000700 1 -- 172.21.15.31:0/3349371713 wait complete. 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.838+0000 7f673c000700 1 Processor -- start 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.838+0000 7f673c000700 1 -- start start 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.838+0000 7f673c000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 0x7f673419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673c000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67341074f0 0x7f673419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673c000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673c000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6734118d70 con 0x7f67341078d0 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673c000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6734118bf0 con 0x7f67341074f0 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673c000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6734118ef0 con 0x7f673406b6c0 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673a000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 0x7f673419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673a000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34174/0 (socket says 172.21.15.31:34174) 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673a000700 1 -- 172.21.15.31:0/2234750551 learned_addr learned my addr 172.21.15.31:0/2234750551 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:37.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6738c00700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67341074f0 0x7f673419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 -- 172.21.15.31:0/2234750551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67341074f0 msgr2=0x7f673419f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67341074f0 0x7f673419f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 -- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 msgr2=0x7f67341a3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f6739600700 1 -- 172.21.15.31:0/2234750551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67341a4240 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.839+0000 7f673a000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f6739600700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 0x7f673419f280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f672800eb90 tx=0x7f672800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672800cc90 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f672800ce30 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6728010430 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67341a4530 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.840+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67341abdb0 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.842+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6734069180 con 0x7f673406b6c0 2024-06-02T22:34:37.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.844+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6728004000 con 0x7f673406b6c0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.845+0000 7f6732000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 0x7f671c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stdout:219043332175 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.845+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f67280cf7b0 con 0x7f673406b6c0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.845+0000 7f6738c00700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 0x7f671c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.846+0000 7f6738c00700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 0x7f671c0a50e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67200098c0 tx=0x7f6720019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:36.849+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f672809c320 con 0x7f673406b6c0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.087+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f67341a0590 con 0x7f673406b6c0 2024-06-02T22:34:37.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.087+0000 7f6732000700 1 -- 172.21.15.31:0/2234750551 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6728086090 con 0x7f673406b6c0 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 msgr2=0x7f671c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 0x7f671c0a50e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67200098c0 tx=0x7f6720019040 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 msgr2=0x7f673419f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 0x7f673419f280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f672800eb90 tx=0x7f672800eea0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 shutdown_connections 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f671c0a2c20 0x7f671c0a50e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341078d0 0x7f67341a3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f673406b6c0 0x7f673419f280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 --2- 172.21.15.31:0/2234750551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67341074f0 0x7f673419f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 >> 172.21.15.31:0/2234750551 conn(0x7f6734078340 msgr2=0x7f6734102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 shutdown_connections 2024-06-02T22:34:37.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:37.091+0000 7f673c000700 1 -- 172.21.15.31:0/2234750551 wait complete. 2024-06-02T22:34:37.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:37 smithi031 ceph-mon[31767]: pgmap v440: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:37.852 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:37 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2234750551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T22:34:37.863 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:37 smithi178 ceph-mon[36614]: pgmap v440: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:37.863 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:37 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2234750551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T22:34:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:37 smithi098 ceph-mon[36750]: pgmap v440: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-06-02T22:34:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:37 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2234750551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T22:34:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 -- 172.21.15.31:0/856210893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 msgr2=0x7ff8d41088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:38.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/856210893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d41088d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009990 tx=0x7ff8c4009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 -- 172.21.15.31:0/856210893 shutdown_connections 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/856210893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d4102e80 0x7ff8d410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/856210893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d41088d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/856210893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d41024e0 0x7ff8d4102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 -- 172.21.15.31:0/856210893 >> 172.21.15.31:0/856210893 conn(0x7ff8d4079530 msgr2=0x7ff8d4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 -- 172.21.15.31:0/856210893 shutdown_connections 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.155+0000 7ff8d8c00700 1 -- 172.21.15.31:0/856210893 wait complete. 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.156+0000 7ff8d8c00700 1 Processor -- start 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.156+0000 7ff8d8c00700 1 -- start start 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41024e0 0x7ff8d419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d4102e80 0x7ff8d419b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:38.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d41127d0 con 0x7ff8d41084f0 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4112650 con 0x7ff8d41024e0 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d8c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4112950 con 0x7ff8d4102e80 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d2800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d2800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34204/0 (socket says 172.21.15.31:34204) 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d2800700 1 -- 172.21.15.31:0/3971326331 learned_addr learned my addr 172.21.15.31:0/3971326331 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d1400700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d4102e80 0x7ff8d419b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.157+0000 7ff8d1e00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41024e0 0x7ff8d419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 -- 172.21.15.31:0/3971326331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d4102e80 msgr2=0x7ff8d419b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d4102e80 0x7ff8d419b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 -- 172.21.15.31:0/3971326331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41024e0 msgr2=0x7ff8d419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41024e0 0x7ff8d419aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 -- 172.21.15.31:0/3971326331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d419fe80 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d2800700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ef30 tx=0x7ff8cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0092e0 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8cc004bb0 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d41a0110 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.158+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc004280 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.159+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a79f0 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.160+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4069180 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.162+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff8cc01b030 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.163+0000 7ff8caa00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 0x7ff8b80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.163+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff8cc0cef00 con 0x7ff8d41084f0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.164+0000 7ff8d1e00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 0x7ff8b80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.164+0000 7ff8d1e00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 0x7ff8b80a50e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009750 tx=0x7ff8c400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:38.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.169+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff8cc022020 con 0x7ff8d41084f0 2024-06-02T22:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.405+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff8d41a7bc0 con 0x7ff8d41084f0 2024-06-02T22:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.406+0000 7ff8caa00700 1 -- 172.21.15.31:0/3971326331 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8cc010040 con 0x7ff8d41084f0 2024-06-02T22:34:38.406 INFO:teuthology.orchestra.run.smithi031.stdout:77309411438 2024-06-02T22:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 msgr2=0x7ff8b80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 0x7ff8b80a50e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009750 tx=0x7ff8c400b260 comp rx=0 tx=0).stop 2024-06-02T22:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 msgr2=0x7ff8d419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00ef30 tx=0x7ff8cc00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 shutdown_connections 2024-06-02T22:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff8b80a2c20 0x7ff8b80a50e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8d41084f0 0x7ff8d419f740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8d41024e0 0x7ff8d419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 --2- 172.21.15.31:0/3971326331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8d4102e80 0x7ff8d419b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:38.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 >> 172.21.15.31:0/3971326331 conn(0x7ff8d4079530 msgr2=0x7ff8d4100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:38.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 shutdown_connections 2024-06-02T22:34:38.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:38.410+0000 7ff8d8c00700 1 -- 172.21.15.31:0/3971326331 wait complete. 2024-06-02T22:34:38.660 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:38 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3971326331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T22:34:38.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:38 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3971326331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T22:34:39.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:38 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3971326331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T22:34:39.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:39 smithi031 ceph-mon[31767]: pgmap v441: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T22:34:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:39 smithi098 ceph-mon[36750]: pgmap v441: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T22:34:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:39 smithi178 ceph-mon[36614]: pgmap v441: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T22:34:40.418 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070533 got 253403070539 for osd.8 2024-06-02T22:34:40.418 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:40.515 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182494 got 107374182502 for osd.3 2024-06-02T22:34:40.515 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:40.692 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:40 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2595723694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T22:34:40.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:40 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2595723694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T22:34:41.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:40 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2595723694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 -- 172.21.15.31:0/25626347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06b520 msgr2=0x7f2a4c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 --2- 172.21.15.31:0/25626347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06b520 0x7f2a4c10f340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009990 tx=0x7f2a44009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 -- 172.21.15.31:0/25626347 shutdown_connections 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 --2- 172.21.15.31:0/25626347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06b520 0x7f2a4c10f340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 --2- 172.21.15.31:0/25626347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c108520 0x7f2a4c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 --2- 172.21.15.31:0/25626347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c06afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 -- 172.21.15.31:0/25626347 >> 172.21.15.31:0/25626347 conn(0x7f2a4c078340 msgr2=0x7f2a4c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 -- 172.21.15.31:0/25626347 shutdown_connections 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.966+0000 7f2a51c00700 1 -- 172.21.15.31:0/25626347 wait complete. 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.967+0000 7f2a51c00700 1 Processor -- start 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 -- start start 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 0x7f2a4c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c108520 0x7f2a4c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1127a0 con 0x7f2a4c06b520 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c112620 con 0x7f2a4c108520 2024-06-02T22:34:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.968+0000 7f2a51c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c112920 con 0x7f2a4c06ab60 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a42000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 0x7f2a4c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57054/0 (socket says 172.21.15.31:57054) 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 -- 172.21.15.31:0/3539020397 learned_addr learned my addr 172.21.15.31:0/3539020397 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4b400700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c108520 0x7f2a4c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 -- 172.21.15.31:0/3539020397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c108520 msgr2=0x7f2a4c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c108520 0x7f2a4c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 -- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 msgr2=0x7f2a4c19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 0x7f2a4c19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a4aa00700 1 -- 172.21.15.31:0/3539020397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c199140 con 0x7f2a4c06ab60 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.969+0000 7f2a42000700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 0x7f2a4c19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a4aa00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00e9a0 tx=0x7f2a3c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:41.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00ca10 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a3c00cbb0 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c199430 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c018660 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.970+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1a56f0 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.972+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c103be0 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.973+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a3c010430 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.975+0000 7f2a43e00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 0x7f2a300a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.975+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2a3c0cf510 con 0x7f2a4c06ab60 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.975+0000 7f2a42000700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 0x7f2a300a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.976+0000 7f2a42000700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 0x7f2a300a5160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c078940 tx=0x7f2a3400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:41.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.979+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a3c09c080 con 0x7f2a4c06ab60 2024-06-02T22:34:41.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.227+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2a4c02dca0 con 0x7f2a4c06ab60 2024-06-02T22:34:41.229 INFO:teuthology.orchestra.run.smithi031.stdout:309237645375 2024-06-02T22:34:41.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.228+0000 7f2a43e00700 1 -- 172.21.15.31:0/3539020397 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2a3c09b980 con 0x7f2a4c06ab60 2024-06-02T22:34:41.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.232+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 msgr2=0x7f2a300a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:41.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.232+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 0x7f2a300a5160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c078940 tx=0x7f2a3400b040 comp rx=0 tx=0).stop 2024-06-02T22:34:41.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.232+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 msgr2=0x7f2a4c19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:41.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.232+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00e9a0 tx=0x7f2a3c00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 shutdown_connections 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a300a2ca0 0x7f2a300a5160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a4c108520 0x7f2a4c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a4c06ab60 0x7f2a4c19e820 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 --2- 172.21.15.31:0/3539020397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4c06b520 0x7f2a4c19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 >> 172.21.15.31:0/3539020397 conn(0x7f2a4c078340 msgr2=0x7f2a4c1003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 shutdown_connections 2024-06-02T22:34:41.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:41.233+0000 7f2a51c00700 1 -- 172.21.15.31:0/3539020397 wait complete. 2024-06-02T22:34:41.618 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411432 got 77309411438 for osd.2 2024-06-02T22:34:41.618 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:41.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:41 smithi031 ceph-mon[31767]: pgmap v442: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-02T22:34:41.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3539020397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T22:34:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:41 smithi098 ceph-mon[36750]: pgmap v442: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-02T22:34:41.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3539020397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T22:34:42.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:41 smithi178 ceph-mon[36614]: pgmap v442: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 9 op/s 2024-06-02T22:34:42.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3539020397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T22:34:42.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.498+0000 7f10ae800700 1 -- 172.21.15.31:0/232525372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a8107840 msgr2=0x7f10a810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:42.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.498+0000 7f10ae800700 1 --2- 172.21.15.31:0/232525372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a8107840 0x7f10a810f3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b0d0 tx=0x7f10a000b3e0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.498+0000 7f10ae800700 1 -- 172.21.15.31:0/232525372 shutdown_connections 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 --2- 172.21.15.31:0/232525372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a8107840 0x7f10a810f3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 --2- 172.21.15.31:0/232525372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 0x7f10a8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 --2- 172.21.15.31:0/232525372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a81030f0 0x7f10a8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 -- 172.21.15.31:0/232525372 >> 172.21.15.31:0/232525372 conn(0x7f10a80795f0 msgr2=0x7f10a8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 -- 172.21.15.31:0/232525372 shutdown_connections 2024-06-02T22:34:42.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.499+0000 7f10ae800700 1 -- 172.21.15.31:0/232525372 wait complete. 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 Processor -- start 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 -- start start 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 0x7f10a819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 0x7f10a8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81127d0 con 0x7f10a81030f0 2024-06-02T22:34:42.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8112650 con 0x7f10a8107840 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.500+0000 7f10ae800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8112950 con 0x7f10a8102740 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51556/0 (socket says 172.21.15.31:51556) 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 -- 172.21.15.31:0/107600642 learned_addr learned my addr 172.21.15.31:0/107600642 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a7e00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 0x7f10a8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:42.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a7400700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 0x7f10a819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 -- 172.21.15.31:0/107600642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 msgr2=0x7f10a819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 0x7f10a819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 -- 172.21.15.31:0/107600642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 msgr2=0x7f10a8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 0x7f10a8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a6a00700 1 -- 172.21.15.31:0/107600642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a81991b0 con 0x7f10a81030f0 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.501+0000 7f10a7e00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 0x7f10a8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f10a6a00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f109400e9a0 tx=0x7f109400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109400ca10 con 0x7f10a81030f0 2024-06-02T22:34:42.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109400cbb0 con 0x7f10a81030f0 2024-06-02T22:34:42.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81994a0 con 0x7f10a81030f0 2024-06-02T22:34:42.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094018680 con 0x7f10a81030f0 2024-06-02T22:34:42.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.502+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81a5760 con 0x7f10a81030f0 2024-06-02T22:34:42.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.503+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a8069180 con 0x7f10a81030f0 2024-06-02T22:34:42.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.506+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1094010430 con 0x7f10a81030f0 2024-06-02T22:34:42.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.508+0000 7f109fe00700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 0x7f108c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:42.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.508+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f10940cf710 con 0x7f10a81030f0 2024-06-02T22:34:42.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.508+0000 7f10a7400700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 0x7f108c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:42.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.509+0000 7f10a7400700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 0x7f108c0a50e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f10a8199b90 tx=0x7f1098009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:42.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.512+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1094053850 con 0x7f10a81030f0 2024-06-02T22:34:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.737+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f10a802dca0 con 0x7f10a81030f0 2024-06-02T22:34:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.738+0000 7f109fe00700 1 -- 172.21.15.31:0/107600642 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f109409c280 con 0x7f10a81030f0 2024-06-02T22:34:42.737 INFO:teuthology.orchestra.run.smithi031.stdout:55834574964 2024-06-02T22:34:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 msgr2=0x7f108c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 0x7f108c0a50e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f10a8199b90 tx=0x7f1098009260 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 msgr2=0x7f10a819edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f109400e9a0 tx=0x7f109400ecb0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 shutdown_connections 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f108c0a2c20 0x7f108c0a50e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8107840 0x7f10a8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8102740 0x7f10a819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 --2- 172.21.15.31:0/107600642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10a81030f0 0x7f10a819edd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 >> 172.21.15.31:0/107600642 conn(0x7f10a80795f0 msgr2=0x7f10a8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 shutdown_connections 2024-06-02T22:34:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:42.741+0000 7f10ae800700 1 -- 172.21.15.31:0/107600642 wait complete. 2024-06-02T22:34:42.934 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495698 got 197568495702 for osd.6 2024-06-02T22:34:42.934 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 -- 172.21.15.31:0/583586125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964108ac0 msgr2=0x7f8964108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 --2- 172.21.15.31:0/583586125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964108ac0 0x7f8964108f40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8950009990 tx=0x7f8950009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 -- 172.21.15.31:0/583586125 shutdown_connections 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 --2- 172.21.15.31:0/583586125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964109480 0x7f8964115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 --2- 172.21.15.31:0/583586125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 0x7f896410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 --2- 172.21.15.31:0/583586125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964108ac0 0x7f8964108f40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 -- 172.21.15.31:0/583586125 >> 172.21.15.31:0/583586125 conn(0x7f8964075c60 msgr2=0x7f89641072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:43.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 -- 172.21.15.31:0/583586125 shutdown_connections 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.174+0000 7f896a400700 1 -- 172.21.15.31:0/583586125 wait complete. 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.175+0000 7f896a400700 1 Processor -- start 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.175+0000 7f896a400700 1 -- start start 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964108ac0 0x7f896419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 0x7f89641a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8964118e50 con 0x7f8964108ac0 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8964118cd0 con 0x7f896410eac0 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f896a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8964118fd0 con 0x7f8964109480 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8963400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964108ac0 0x7f896419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:43.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56842/0 (socket says 172.21.15.31:56842) 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 -- 172.21.15.31:0/2595723694 learned_addr learned my addr 172.21.15.31:0/2595723694 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8963e00700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 0x7f89641a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 -- 172.21.15.31:0/2595723694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 msgr2=0x7f89641a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 0x7f89641a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 -- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964108ac0 msgr2=0x7f896419f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.176+0000 7f8962a00700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964108ac0 0x7f896419f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f8962a00700 1 -- 172.21.15.31:0/2595723694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89641a4210 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f8962a00700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8950000c00 tx=0x7f895000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950027070 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89641a44a0 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89641abd80 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.177+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8950003d70 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.178+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895000f460 con 0x7f8964109480 2024-06-02T22:34:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.179+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8964069180 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.181+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f895002a070 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.182+0000 7f895be00700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.182+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f89500d04c0 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.182+0000 7f8963400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.183+0000 7f8963400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 0x7f89480a5160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8954007b60 tx=0x7f89540073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.185+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8950013070 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.427+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f89641a0560 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.428+0000 7f895be00700 1 -- 172.21.15.31:0/2595723694 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f895009d0c0 con 0x7f8964109480 2024-06-02T22:34:43.653 INFO:teuthology.orchestra.run.smithi031.stdout:163208757340 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 msgr2=0x7f89480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 0x7f89480a5160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8954007b60 tx=0x7f89540073d0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 msgr2=0x7f896419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8950000c00 tx=0x7f895000bab0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 shutdown_connections 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89480a2ca0 0x7f89480a5160 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896410eac0 0x7f89641a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8964108ac0 0x7f896419f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 --2- 172.21.15.31:0/2595723694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8964109480 0x7f896419f740 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:43.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 >> 172.21.15.31:0/2595723694 conn(0x7f8964075c60 msgr2=0x7f8964076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:43.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 shutdown_connections 2024-06-02T22:34:43.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:40.431+0000 7f896a400700 1 -- 172.21.15.31:0/2595723694 wait complete. 2024-06-02T22:34:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:43 smithi031 ceph-mon[31767]: pgmap v443: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:43 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/107600642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T22:34:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:43 smithi098 ceph-mon[36750]: pgmap v443: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:43 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/107600642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T22:34:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:43 smithi178 ceph-mon[36614]: pgmap v443: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:43 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/107600642' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T22:34:44.573 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757335 got 163208757340 for osd.5 2024-06-02T22:34:44.574 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:45.259 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332169 got 219043332175 for osd.7 2024-06-02T22:34:45.260 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:45.754 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:45 smithi031 ceph-mon[31767]: pgmap v444: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:45 smithi098 ceph-mon[36750]: pgmap v444: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:46.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:45 smithi178 ceph-mon[36614]: pgmap v444: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:46.482 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645371 got 309237645375 for osd.10 2024-06-02T22:34:46.482 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:46.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 -- 172.21.15.31:0/3959857556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c810ef40 msgr2=0x7f25c8111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:46.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 --2- 172.21.15.31:0/3959857556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c810ef40 0x7f25c8111330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009f90 tx=0x7f25c000b330 comp rx=0 tx=0).stop 2024-06-02T22:34:46.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 -- 172.21.15.31:0/3959857556 shutdown_connections 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 --2- 172.21.15.31:0/3959857556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c810ef40 0x7f25c8111330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 --2- 172.21.15.31:0/3959857556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 --2- 172.21.15.31:0/3959857556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c806aac0 0x7f25c810ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 -- 172.21.15.31:0/3959857556 >> 172.21.15.31:0/3959857556 conn(0x7f25c8078340 msgr2=0x7f25c8078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 -- 172.21.15.31:0/3959857556 shutdown_connections 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.691+0000 7f25cf200700 1 -- 172.21.15.31:0/3959857556 wait complete. 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.692+0000 7f25cf200700 1 Processor -- start 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.692+0000 7f25cf200700 1 -- start start 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c806aac0 0x7f25c819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 0x7f25c819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8114a00 con 0x7f25c806a1a0 2024-06-02T22:34:46.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8114880 con 0x7f25c806aac0 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cf200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8114b80 con 0x7f25c810ef40 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25c7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25c7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51578/0 (socket says 172.21.15.31:51578) 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25c7e00700 1 -- 172.21.15.31:0/292397706 learned_addr learned my addr 172.21.15.31:0/292397706 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25cd200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 0x7f25c819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.693+0000 7f25bfe00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c806aac0 0x7f25c819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 -- 172.21.15.31:0/292397706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 msgr2=0x7f25c819f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 0x7f25c819f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 -- 172.21.15.31:0/292397706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c806aac0 msgr2=0x7f25c819b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:46.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c806aac0 0x7f25c819b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 -- 172.21.15.31:0/292397706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c819fec0 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25cd200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 0x7f25c819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c7e00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25b800e9c0 tx=0x7f25b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8004a30 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b800cca0 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8005610 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.694+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81a01b0 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.695+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81a7a30 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.696+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8069180 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.698+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f25b8004cf0 con 0x7f25c806a1a0 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.700+0000 7f25c5600700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 0x7f25ac0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:46.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.700+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f25b80cf720 con 0x7f25c806a1a0 2024-06-02T22:34:46.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.700+0000 7f25bfe00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 0x7f25ac0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:46.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.701+0000 7f25bfe00700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 0x7f25ac0a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f25c81028c0 tx=0x7f25b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:46.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.703+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f25b8053850 con 0x7f25c806a1a0 2024-06-02T22:34:46.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.940+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f25c819c210 con 0x7f25c806a1a0 2024-06-02T22:34:46.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.941+0000 7f25c5600700 1 -- 172.21.15.31:0/292397706 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25b809c290 con 0x7f25c806a1a0 2024-06-02T22:34:46.941 INFO:teuthology.orchestra.run.smithi031.stdout:34359738490 2024-06-02T22:34:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.944+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 msgr2=0x7f25ac0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.944+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 0x7f25ac0a50e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f25c81028c0 tx=0x7f25b0009260 comp rx=0 tx=0).stop 2024-06-02T22:34:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.944+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 msgr2=0x7f25c819aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.944+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25b800e9c0 tx=0x7f25b800ecd0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 shutdown_connections 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f25ac0a2c20 0x7f25ac0a50e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25c810ef40 0x7f25c819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25c806a1a0 0x7f25c819aeb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 --2- 172.21.15.31:0/292397706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c806aac0 0x7f25c819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 >> 172.21.15.31:0/292397706 conn(0x7f25c8078340 msgr2=0x7f25c81103f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 shutdown_connections 2024-06-02T22:34:46.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:46.945+0000 7f25cf200700 1 -- 172.21.15.31:0/292397706 wait complete. 2024-06-02T22:34:47.844 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574958 got 55834574964 for osd.1 2024-06-02T22:34:47.844 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:47.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:47 smithi031 ceph-mon[31767]: pgmap v445: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:47.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:47 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/292397706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T22:34:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:47 smithi098 ceph-mon[36750]: pgmap v445: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:47 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/292397706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T22:34:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:47 smithi178 ceph-mon[36614]: pgmap v445: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:47 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/292397706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T22:34:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:48.155 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738482 got 34359738490 for osd.0 2024-06-02T22:34:48.155 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 -- 172.21.15.31:0/1001621091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164109480 msgr2=0x7fd164115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 --2- 172.21.15.31:0/1001621091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164109480 0x7fd164115990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00b0a0 tx=0x7fd15c00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 -- 172.21.15.31:0/1001621091 shutdown_connections 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 --2- 172.21.15.31:0/1001621091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164109480 0x7fd164115990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 --2- 172.21.15.31:0/1001621091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd16410eac0 0x7fd16410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 --2- 172.21.15.31:0/1001621091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd164108ac0 0x7fd164108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 -- 172.21.15.31:0/1001621091 >> 172.21.15.31:0/1001621091 conn(0x7fd164075c60 msgr2=0x7fd1641072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 -- 172.21.15.31:0/1001621091 shutdown_connections 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.632+0000 7fd16a800700 1 -- 172.21.15.31:0/1001621091 wait complete. 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.633+0000 7fd16a800700 1 Processor -- start 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.633+0000 7fd16a800700 1 -- start start 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd164109480 0x7fd16419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd16410eac0 0x7fd1641a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd164118e60 con 0x7fd164109480 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd164118ce0 con 0x7fd164108ac0 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd16a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd164118fe0 con 0x7fd16410eac0 2024-06-02T22:34:48.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd163400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd162a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd164109480 0x7fd16419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd163e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd16410eac0 0x7fd1641a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd163400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57646/0 (socket says 172.21.15.31:57646) 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.634+0000 7fd163400700 1 -- 172.21.15.31:0/444206728 learned_addr learned my addr 172.21.15.31:0/444206728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 -- 172.21.15.31:0/444206728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd16410eac0 msgr2=0x7fd1641a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd16410eac0 0x7fd1641a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 -- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd164109480 msgr2=0x7fd16419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd164109480 0x7fd16419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 -- 172.21.15.31:0/444206728 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1641a42c0 con 0x7fd164108ac0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd163400700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e9a0 tx=0x7fd15400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400ca10 con 0x7fd164108ac0 2024-06-02T22:34:48.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.635+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd15400cbb0 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.636+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1641a45b0 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.636+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154018680 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.636+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641abe30 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.637+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd164069180 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.640+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd154010430 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.641+0000 7fd15be00700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 0x7fd1480a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.642+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd1540cf4e0 con 0x7fd164108ac0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.642+0000 7fd162a00700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 0x7fd1480a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.643+0000 7fd162a00700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 0x7fd1480a5160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd164077a60 tx=0x7fd150009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:48.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.646+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd15409c0b0 con 0x7fd164108ac0 2024-06-02T22:34:48.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.889+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd1641ac000 con 0x7fd164108ac0 2024-06-02T22:34:48.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.889+0000 7fd15be00700 1 -- 172.21.15.31:0/444206728 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd15409b9b0 con 0x7fd164108ac0 2024-06-02T22:34:48.889 INFO:teuthology.orchestra.run.smithi031.stdout:343597383740 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 msgr2=0x7fd1480a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 0x7fd1480a5160 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd164077a60 tx=0x7fd150009260 comp rx=0 tx=0).stop 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 msgr2=0x7fd16419f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd15400e9a0 tx=0x7fd15400ecb0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 shutdown_connections 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd1480a2ca0 0x7fd1480a5160 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd16410eac0 0x7fd1641a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd164108ac0 0x7fd16419f2b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 --2- 172.21.15.31:0/444206728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd164109480 0x7fd16419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 >> 172.21.15.31:0/444206728 conn(0x7fd164075c60 msgr2=0x7fd164076140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 shutdown_connections 2024-06-02T22:34:48.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.893+0000 7fd16a800700 1 -- 172.21.15.31:0/444206728 wait complete. 2024-06-02T22:34:48.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 -- 172.21.15.31:0/2510368193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 msgr2=0x7f333c1089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 --2- 172.21.15.31:0/2510368193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c1089d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f332c009990 tx=0x7f332c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 -- 172.21.15.31:0/2510368193 shutdown_connections 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 --2- 172.21.15.31:0/2510368193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c102ea0 0x7f333c10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 --2- 172.21.15.31:0/2510368193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c1089d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 --2- 172.21.15.31:0/2510368193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c1024e0 0x7f333c102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 -- 172.21.15.31:0/2510368193 >> 172.21.15.31:0/2510368193 conn(0x7f333c079640 msgr2=0x7f333c079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.951+0000 7f3341c00700 1 -- 172.21.15.31:0/2510368193 shutdown_connections 2024-06-02T22:34:48.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.952+0000 7f3341c00700 1 -- 172.21.15.31:0/2510368193 wait complete. 2024-06-02T22:34:48.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 Processor -- start 2024-06-02T22:34:48.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 -- start start 2024-06-02T22:34:48.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c1024e0 0x7f333c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f333c1127e0 con 0x7f333c1085f0 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f333c112660 con 0x7f333c1024e0 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.953+0000 7f3341c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f333c112960 con 0x7f333c102ea0 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57134/0 (socket says 172.21.15.31:57134) 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 -- 172.21.15.31:0/172830956 learned_addr learned my addr 172.21.15.31:0/172830956 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:48.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333aa00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c1024e0 0x7f333c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333b400700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 -- 172.21.15.31:0/172830956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c1024e0 msgr2=0x7f333c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c1024e0 0x7f333c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 -- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 msgr2=0x7f333c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333a000700 1 -- 172.21.15.31:0/172830956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c199180 con 0x7f333c102ea0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.954+0000 7f333b400700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f333a000700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f332800eb30 tx=0x7f332800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332800cc90 con 0x7f333c102ea0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c199470 con 0x7f333c102ea0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a5730 con 0x7f333c102ea0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3328004500 con 0x7f333c102ea0 2024-06-02T22:34:48.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.955+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328010430 con 0x7f333c102ea0 2024-06-02T22:34:48.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.956+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331c005330 con 0x7f333c102ea0 2024-06-02T22:34:48.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.959+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3328003680 con 0x7f333c102ea0 2024-06-02T22:34:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.961+0000 7f3333400700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 0x7f33200a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.961+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f33280cf5e0 con 0x7f333c102ea0 2024-06-02T22:34:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.961+0000 7f333aa00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 0x7f33200a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.962+0000 7f333aa00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 0x7f33200a5160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f333c199b60 tx=0x7f332c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:48.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:48.965+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f332809c150 con 0x7f333c102ea0 2024-06-02T22:34:49.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.199+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f331c005620 con 0x7f333c102ea0 2024-06-02T22:34:49.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.200+0000 7f3333400700 1 -- 172.21.15.31:0/172830956 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f332809ba50 con 0x7f333c102ea0 2024-06-02T22:34:49.200 INFO:teuthology.orchestra.run.smithi031.stdout:141733920869 2024-06-02T22:34:49.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 msgr2=0x7f33200a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:49.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 0x7f33200a5160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f333c199b60 tx=0x7f332c00b260 comp rx=0 tx=0).stop 2024-06-02T22:34:49.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 msgr2=0x7f333c19eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f332800eb30 tx=0x7f332800ee40 comp rx=0 tx=0).stop 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 shutdown_connections 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f33200a2ca0 0x7f33200a5160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1085f0 0x7f333c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f333c1024e0 0x7f333c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 --2- 172.21.15.31:0/172830956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f333c102ea0 0x7f333c19eda0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 >> 172.21.15.31:0/172830956 conn(0x7f333c079640 msgr2=0x7f333c100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 shutdown_connections 2024-06-02T22:34:49.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:49.204+0000 7f3341c00700 1 -- 172.21.15.31:0/172830956 wait complete. 2024-06-02T22:34:49.962 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:49 smithi031 ceph-mon[31767]: pgmap v446: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:49.962 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/444206728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T22:34:49.962 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/172830956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T22:34:49.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:49 smithi098 ceph-mon[36750]: pgmap v446: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:49.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/444206728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T22:34:49.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/172830956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T22:34:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:49 smithi178 ceph-mon[36614]: pgmap v446: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/444206728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T22:34:50.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/172830956' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T22:34:50.636 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383734 got 343597383740 for osd.11 2024-06-02T22:34:50.636 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:51.197 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920863 got 141733920869 for osd.4 2024-06-02T22:34:51.197 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:51.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:51 smithi031 ceph-mon[31767]: pgmap v447: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:51 smithi098 ceph-mon[36750]: pgmap v447: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:51 smithi178 ceph-mon[36614]: pgmap v447: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 -- 172.21.15.31:0/54439308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0107840 msgr2=0x7f8ea010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 --2- 172.21.15.31:0/54439308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0107840 0x7f8ea010f3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800b0d0 tx=0x7f8e9800b3e0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 -- 172.21.15.31:0/54439308 shutdown_connections 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 --2- 172.21.15.31:0/54439308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea0107840 0x7f8ea010f3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 --2- 172.21.15.31:0/54439308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0102740 0x7f8ea0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 --2- 172.21.15.31:0/54439308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea01030f0 0x7f8ea0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 -- 172.21.15.31:0/54439308 >> 172.21.15.31:0/54439308 conn(0x7f8ea00795f0 msgr2=0x7f8ea0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.563+0000 7f8ea8600700 1 -- 172.21.15.31:0/54439308 shutdown_connections 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.564+0000 7f8ea8600700 1 -- 172.21.15.31:0/54439308 wait complete. 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.565+0000 7f8ea8600700 1 Processor -- start 2024-06-02T22:34:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.565+0000 7f8ea8600700 1 -- start start 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 0x7f8ea01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 0x7f8ea019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0075330 con 0x7f8ea01030f0 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00751b0 con 0x7f8ea0107840 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea8600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00754b0 con 0x7f8ea0102740 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea5200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:52.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea5200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33370/0 (socket says 172.21.15.31:33370) 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea5200700 1 -- 172.21.15.31:0/2326558108 learned_addr learned my addr 172.21.15.31:0/2326558108 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea5c00700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 0x7f8ea01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.566+0000 7f8ea6600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 0x7f8ea019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 -- 172.21.15.31:0/2326558108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 msgr2=0x7f8ea01a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 0x7f8ea01a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 -- 172.21.15.31:0/2326558108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 msgr2=0x7f8ea019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 0x7f8ea019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 -- 172.21.15.31:0/2326558108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea019b510 con 0x7f8ea01030f0 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5c00700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 0x7f8ea01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea6600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 0x7f8ea019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:34:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea5200700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d980 tx=0x7f8e8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c016070 con 0x7f8ea01030f0 2024-06-02T22:34:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e8c004d10 con 0x7f8ea01030f0 2024-06-02T22:34:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c005670 con 0x7f8ea01030f0 2024-06-02T22:34:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.567+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea019b800 con 0x7f8ea01030f0 2024-06-02T22:34:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.568+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01a79e0 con 0x7f8ea01030f0 2024-06-02T22:34:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.569+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea0103bd0 con 0x7f8ea01030f0 2024-06-02T22:34:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.571+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8e8c004750 con 0x7f8ea01030f0 2024-06-02T22:34:52.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.572+0000 7f8e9e000700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 0x7f8e880a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:52.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.572+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8e8c0cf0e0 con 0x7f8ea01030f0 2024-06-02T22:34:52.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.573+0000 7f8ea5c00700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 0x7f8e880a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:52.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.573+0000 7f8ea5c00700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 0x7f8e880a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e94010420 tx=0x7f8e940073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:52.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.577+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8e8c01f020 con 0x7f8ea01030f0 2024-06-02T22:34:52.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.811+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f8ea01a7bb0 con 0x7f8ea01030f0 2024-06-02T22:34:52.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.812+0000 7f8e9e000700 1 -- 172.21.15.31:0/2326558108 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e8c022350 con 0x7f8ea01030f0 2024-06-02T22:34:52.812 INFO:teuthology.orchestra.run.smithi031.stdout:287762808904 2024-06-02T22:34:52.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 msgr2=0x7f8e880a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:52.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 0x7f8e880a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8e94010420 tx=0x7f8e940073d0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 msgr2=0x7f8ea01a0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:52.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00d980 tx=0x7f8e8c00dc90 comp rx=0 tx=0).stop 2024-06-02T22:34:52.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 shutdown_connections 2024-06-02T22:34:52.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8e880a2ca0 0x7f8e880a5160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ea0107840 0x7f8ea019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ea0102740 0x7f8ea01a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 --2- 172.21.15.31:0/2326558108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ea01030f0 0x7f8ea01a0fa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.816+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 >> 172.21.15.31:0/2326558108 conn(0x7f8ea00795f0 msgr2=0x7f8ea00ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.817+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 shutdown_connections 2024-06-02T22:34:52.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:52.817+0000 7f8ea8600700 1 -- 172.21.15.31:0/2326558108 wait complete. 2024-06-02T22:34:53.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808898 got 287762808904 for osd.9 2024-06-02T22:34:53.651 DEBUG:teuthology.parallel:result is None 2024-06-02T22:34:53.651 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T22:34:53.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T22:34:53.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:53 smithi031 ceph-mon[31767]: pgmap v448: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:53.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:53 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2326558108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T22:34:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:53 smithi098 ceph-mon[36750]: pgmap v448: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:53 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2326558108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T22:34:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:53 smithi178 ceph-mon[36614]: pgmap v448: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:34:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:53 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2326558108' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T22:34:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:55.869 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:55 smithi031 ceph-mon[31767]: pgmap v449: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:55 smithi098 ceph-mon[36750]: pgmap v449: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:55 smithi178 ceph-mon[36614]: pgmap v449: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:34:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 -- 172.21.15.31:0/2149847873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102620 msgr2=0x7fd8c0102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/2149847873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102620 0x7fd8c0102a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009920 tx=0x7fd8b4009c30 comp rx=0 tx=0).stop 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 -- 172.21.15.31:0/2149847873 shutdown_connections 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/2149847873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0107700 0x7fd8c010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/2149847873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102620 0x7fd8c0102a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/2149847873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0102fd0 0x7fd8c0107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.399+0000 7fd8c6a00700 1 -- 172.21.15.31:0/2149847873 >> 172.21.15.31:0/2149847873 conn(0x7fd8c00fdf10 msgr2=0x7fd8c0100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.400+0000 7fd8c6a00700 1 -- 172.21.15.31:0/2149847873 shutdown_connections 2024-06-02T22:34:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.400+0000 7fd8c6a00700 1 -- 172.21.15.31:0/2149847873 wait complete. 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 Processor -- start 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 -- start start 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 0x7fd8c019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 0x7fd8c019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0107700 0x7fd8c019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112700 con 0x7fd8c0102620 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112580 con 0x7fd8c0107700 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.401+0000 7fd8c6a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0112880 con 0x7fd8c0102fd0 2024-06-02T22:34:56.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c5600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 0x7fd8c019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 0x7fd8c019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c5600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 0x7fd8c019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33388/0 (socket says 172.21.15.31:33388) 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c5600700 1 -- 172.21.15.31:0/1034348196 learned_addr learned my addr 172.21.15.31:0/1034348196 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c6000700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0107700 0x7fd8c019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 -- 172.21.15.31:0/1034348196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0107700 msgr2=0x7fd8c019f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0107700 0x7fd8c019f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 -- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 msgr2=0x7fd8c019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 0x7fd8c019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.402+0000 7fd8c4c00700 1 -- 172.21.15.31:0/1034348196 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c019fe60 con 0x7fd8c0102fd0 2024-06-02T22:34:56.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8c4c00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 0x7fd8c019b390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00e9c0 tx=0x7fd8ac00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac004220 con 0x7fd8c0102fd0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8ac004d10 con 0x7fd8c0102fd0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005020 con 0x7fd8c0102fd0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c01a0150 con 0x7fd8c0102fd0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.403+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c01a79d0 con 0x7fd8c0102fd0 2024-06-02T22:34:56.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.404+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c0069180 con 0x7fd8c0102fd0 2024-06-02T22:34:56.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.407+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd8ac004750 con 0x7fd8c0102fd0 2024-06-02T22:34:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.408+0000 7fd8be000700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 0x7fd8a80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:34:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.408+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd8ac0cf350 con 0x7fd8c0102fd0 2024-06-02T22:34:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.408+0000 7fd8c5600700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 0x7fd8a80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:34:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.409+0000 7fd8c5600700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 0x7fd8a80a5160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009680 tx=0x7fd8b4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:34:56.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.410+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd8ac09bf50 con 0x7fd8c0102fd0 2024-06-02T22:34:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.638+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8c00756d0 con 0x7fd8a80a2ca0 2024-06-02T22:34:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.651+0000 7fd8be000700 1 -- 172.21.15.31:0/1034348196 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340819 (secure 0 0 0) 0x7fd8c00756d0 con 0x7fd8a80a2ca0 2024-06-02T22:34:56.659 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:34:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 msgr2=0x7fd8a80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 0x7fd8a80a5160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009680 tx=0x7fd8b4019040 comp rx=0 tx=0).stop 2024-06-02T22:34:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 msgr2=0x7fd8c019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:34:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 0x7fd8c019b390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00e9c0 tx=0x7fd8ac00ecd0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 shutdown_connections 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd8a80a2ca0 0x7fd8a80a5160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8c0107700 0x7fd8c019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8c0102620 0x7fd8c019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 --2- 172.21.15.31:0/1034348196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8c0102fd0 0x7fd8c019b390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 >> 172.21.15.31:0/1034348196 conn(0x7fd8c00fdf10 msgr2=0x7fd8c0100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 shutdown_connections 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:34:56.660+0000 7fd8c6a00700 1 -- 172.21.15.31:0/1034348196 wait complete. 2024-06-02T22:34:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-06-02T22:34:57.459 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":450,"stamp":"2024-06-02T22:34:56.334183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665384,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1420,"num_read_kb":839,"num_write":448,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182382,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383424,"kb_used_data":13472,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558400,"statfs":{"total":1151940427776,"available":1151547801600,"internally_reserved":0,"allocated":13795328,"data_stored":8809262,"data_compressed":496710,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006429"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.281355+0000","last_change":"2024-06-02T22:31:20.770673+0000","last_active":"2024-06-02T22:34:24.281355+0000","last_peered":"2024-06-02T22:34:24.281355+0000","last_clean":"2024-06-02T22:34:24.281355+0000","last_became_active":"2024-06-02T22:31:20.770000+0000","last_became_peered":"2024-06-02T22:31:20.770000+0000","last_unstale":"2024-06-02T22:34:24.281355+0000","last_undegraded":"2024-06-02T22:34:24.281355+0000","last_fullsized":"2024-06-02T22:34:24.281355+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:52.632084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272688+0000","last_change":"2024-06-02T22:31:20.766311+0000","last_active":"2024-06-02T22:34:24.272688+0000","last_peered":"2024-06-02T22:34:24.272688+0000","last_clean":"2024-06-02T22:34:24.272688+0000","last_became_active":"2024-06-02T22:31:20.765960+0000","last_became_peered":"2024-06-02T22:31:20.765960+0000","last_unstale":"2024-06-02T22:34:24.272688+0000","last_undegraded":"2024-06-02T22:34:24.272688+0000","last_fullsized":"2024-06-02T22:34:24.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:30.500082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286775+0000","last_change":"2024-06-02T22:31:20.766005+0000","last_active":"2024-06-02T22:34:24.286775+0000","last_peered":"2024-06-02T22:34:24.286775+0000","last_clean":"2024-06-02T22:34:24.286775+0000","last_became_active":"2024-06-02T22:31:20.762135+0000","last_became_peered":"2024-06-02T22:31:20.762135+0000","last_unstale":"2024-06-02T22:34:24.286775+0000","last_undegraded":"2024-06-02T22:34:24.286775+0000","last_fullsized":"2024-06-02T22:34:24.286775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:44:10.201470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242463+0000","last_change":"2024-06-02T22:31:20.754293+0000","last_active":"2024-06-02T22:34:24.242463+0000","last_peered":"2024-06-02T22:34:24.242463+0000","last_clean":"2024-06-02T22:34:24.242463+0000","last_became_active":"2024-06-02T22:31:20.753996+0000","last_became_peered":"2024-06-02T22:31:20.753996+0000","last_unstale":"2024-06-02T22:34:24.242463+0000","last_undegraded":"2024-06-02T22:34:24.242463+0000","last_fullsized":"2024-06-02T22:34:24.242463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:25.050471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268677+0000","last_change":"2024-06-02T22:31:20.776227+0000","last_active":"2024-06-02T22:34:24.268677+0000","last_peered":"2024-06-02T22:34:24.268677+0000","last_clean":"2024-06-02T22:34:24.268677+0000","last_became_active":"2024-06-02T22:31:20.775922+0000","last_became_peered":"2024-06-02T22:31:20.775922+0000","last_unstale":"2024-06-02T22:34:24.268677+0000","last_undegraded":"2024-06-02T22:34:24.268677+0000","last_fullsized":"2024-06-02T22:34:24.268677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:54:49.228748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270517+0000","last_change":"2024-06-02T22:32:56.684643+0000","last_active":"2024-06-02T22:34:24.270517+0000","last_peered":"2024-06-02T22:34:24.270517+0000","last_clean":"2024-06-02T22:34:24.270517+0000","last_became_active":"2024-06-02T22:32:56.684253+0000","last_became_peered":"2024-06-02T22:32:56.684253+0000","last_unstale":"2024-06-02T22:34:24.270517+0000","last_undegraded":"2024-06-02T22:34:24.270517+0000","last_fullsized":"2024-06-02T22:34:24.270517+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:40:57.474007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.237478+0000","last_change":"2024-06-02T22:31:20.748702+0000","last_active":"2024-06-02T22:34:24.237478+0000","last_peered":"2024-06-02T22:34:24.237478+0000","last_clean":"2024-06-02T22:34:24.237478+0000","last_became_active":"2024-06-02T22:31:20.748361+0000","last_became_peered":"2024-06-02T22:31:20.748361+0000","last_unstale":"2024-06-02T22:34:24.237478+0000","last_undegraded":"2024-06-02T22:34:24.237478+0000","last_fullsized":"2024-06-02T22:34:24.237478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:00.065043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.271709+0000","last_change":"2024-06-02T22:31:20.761647+0000","last_active":"2024-06-02T22:34:24.271709+0000","last_peered":"2024-06-02T22:34:24.271709+0000","last_clean":"2024-06-02T22:34:24.271709+0000","last_became_active":"2024-06-02T22:31:20.758453+0000","last_became_peered":"2024-06-02T22:31:20.758453+0000","last_unstale":"2024-06-02T22:34:24.271709+0000","last_undegraded":"2024-06-02T22:34:24.271709+0000","last_fullsized":"2024-06-02T22:34:24.271709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:32.586129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.246676+0000","last_change":"2024-06-02T22:31:20.753972+0000","last_active":"2024-06-02T22:34:24.246676+0000","last_peered":"2024-06-02T22:34:24.246676+0000","last_clean":"2024-06-02T22:34:24.246676+0000","last_became_active":"2024-06-02T22:31:20.753667+0000","last_became_peered":"2024-06-02T22:31:20.753667+0000","last_unstale":"2024-06-02T22:34:24.246676+0000","last_undegraded":"2024-06-02T22:34:24.246676+0000","last_fullsized":"2024-06-02T22:34:24.246676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:32:59.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.254086+0000","last_change":"2024-06-02T22:31:56.475364+0000","last_active":"2024-06-02T22:34:24.254086+0000","last_peered":"2024-06-02T22:34:24.254086+0000","last_clean":"2024-06-02T22:34:24.254086+0000","last_became_active":"2024-06-02T22:31:56.475086+0000","last_became_peered":"2024-06-02T22:31:56.475086+0000","last_unstale":"2024-06-02T22:34:24.254086+0000","last_undegraded":"2024-06-02T22:34:24.254086+0000","last_fullsized":"2024-06-02T22:34:24.254086+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:01:37.348839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.245175+0000","last_change":"2024-06-02T22:31:20.748745+0000","last_active":"2024-06-02T22:34:24.245175+0000","last_peered":"2024-06-02T22:34:24.245175+0000","last_clean":"2024-06-02T22:34:24.245175+0000","last_became_active":"2024-06-02T22:31:20.747808+0000","last_became_peered":"2024-06-02T22:31:20.747808+0000","last_unstale":"2024-06-02T22:34:24.245175+0000","last_undegraded":"2024-06-02T22:34:24.245175+0000","last_fullsized":"2024-06-02T22:34:24.245175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:29.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242750+0000","last_change":"2024-06-02T22:31:20.754184+0000","last_active":"2024-06-02T22:34:24.242750+0000","last_peered":"2024-06-02T22:34:24.242750+0000","last_clean":"2024-06-02T22:34:24.242750+0000","last_became_active":"2024-06-02T22:31:20.753691+0000","last_became_peered":"2024-06-02T22:31:20.753691+0000","last_unstale":"2024-06-02T22:34:24.242750+0000","last_undegraded":"2024-06-02T22:34:24.242750+0000","last_fullsized":"2024-06-02T22:34:24.242750+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:43.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.273809+0000","last_change":"2024-06-02T22:31:56.478669+0000","last_active":"2024-06-02T22:34:24.273809+0000","last_peered":"2024-06-02T22:34:24.273809+0000","last_clean":"2024-06-02T22:34:24.273809+0000","last_became_active":"2024-06-02T22:31:56.476440+0000","last_became_peered":"2024-06-02T22:31:56.476440+0000","last_unstale":"2024-06-02T22:34:24.273809+0000","last_undegraded":"2024-06-02T22:34:24.273809+0000","last_fullsized":"2024-06-02T22:34:24.273809+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:17:08.753386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283630+0000","last_change":"2024-06-02T22:31:20.756993+0000","last_active":"2024-06-02T22:34:24.283630+0000","last_peered":"2024-06-02T22:34:24.283630+0000","last_clean":"2024-06-02T22:34:24.283630+0000","last_became_active":"2024-06-02T22:31:20.756518+0000","last_became_peered":"2024-06-02T22:31:20.756518+0000","last_unstale":"2024-06-02T22:34:24.283630+0000","last_undegraded":"2024-06-02T22:34:24.283630+0000","last_fullsized":"2024-06-02T22:34:24.283630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:28.743386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.287050+0000","last_change":"2024-06-02T22:31:20.760152+0000","last_active":"2024-06-02T22:34:24.287050+0000","last_peered":"2024-06-02T22:34:24.287050+0000","last_clean":"2024-06-02T22:34:24.287050+0000","last_became_active":"2024-06-02T22:31:20.759291+0000","last_became_peered":"2024-06-02T22:31:20.759291+0000","last_unstale":"2024-06-02T22:34:24.287050+0000","last_undegraded":"2024-06-02T22:34:24.287050+0000","last_fullsized":"2024-06-02T22:34:24.287050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:30.465537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286297+0000","last_change":"2024-06-02T22:31:20.766881+0000","last_active":"2024-06-02T22:34:24.286297+0000","last_peered":"2024-06-02T22:34:24.286297+0000","last_clean":"2024-06-02T22:34:24.286297+0000","last_became_active":"2024-06-02T22:31:20.766552+0000","last_became_peered":"2024-06-02T22:31:20.766552+0000","last_unstale":"2024-06-02T22:34:24.286297+0000","last_undegraded":"2024-06-02T22:34:24.286297+0000","last_fullsized":"2024-06-02T22:34:24.286297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:58.133220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.281465+0000","last_change":"2024-06-02T22:31:20.770370+0000","last_active":"2024-06-02T22:34:24.281465+0000","last_peered":"2024-06-02T22:34:24.281465+0000","last_clean":"2024-06-02T22:34:24.281465+0000","last_became_active":"2024-06-02T22:31:20.769938+0000","last_became_peered":"2024-06-02T22:31:20.769938+0000","last_unstale":"2024-06-02T22:34:24.281465+0000","last_undegraded":"2024-06-02T22:34:24.281465+0000","last_fullsized":"2024-06-02T22:34:24.281465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:59.835221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.251926+0000","last_change":"2024-06-02T22:31:20.762933+0000","last_active":"2024-06-02T22:34:24.251926+0000","last_peered":"2024-06-02T22:34:24.251926+0000","last_clean":"2024-06-02T22:34:24.251926+0000","last_became_active":"2024-06-02T22:31:20.761598+0000","last_became_peered":"2024-06-02T22:31:20.761598+0000","last_unstale":"2024-06-02T22:34:24.251926+0000","last_undegraded":"2024-06-02T22:34:24.251926+0000","last_fullsized":"2024-06-02T22:34:24.251926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:25:45.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274579+0000","last_change":"2024-06-02T22:31:20.758974+0000","last_active":"2024-06-02T22:34:24.274579+0000","last_peered":"2024-06-02T22:34:24.274579+0000","last_clean":"2024-06-02T22:34:24.274579+0000","last_became_active":"2024-06-02T22:31:20.758583+0000","last_became_peered":"2024-06-02T22:31:20.758583+0000","last_unstale":"2024-06-02T22:34:24.274579+0000","last_undegraded":"2024-06-02T22:34:24.274579+0000","last_fullsized":"2024-06-02T22:34:24.274579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:00.333362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677108+0000","last_change":"2024-06-02T22:31:33.865290+0000","last_active":"2024-06-02T22:32:56.677108+0000","last_peered":"2024-06-02T22:32:56.677108+0000","last_clean":"2024-06-02T22:32:56.677108+0000","last_became_active":"2024-06-02T22:31:33.864721+0000","last_became_peered":"2024-06-02T22:31:33.864721+0000","last_unstale":"2024-06-02T22:32:56.677108+0000","last_undegraded":"2024-06-02T22:32:56.677108+0000","last_fullsized":"2024-06-02T22:32:56.677108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:45.344953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"99'14","reported_seq":183,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:51.795101+0000","last_change":"2024-06-02T22:31:15.645169+0000","last_active":"2024-06-02T22:34:51.795101+0000","last_peered":"2024-06-02T22:34:51.795101+0000","last_clean":"2024-06-02T22:34:51.795101+0000","last_became_active":"2024-06-02T22:31:15.643956+0000","last_became_peered":"2024-06-02T22:31:15.643956+0000","last_unstale":"2024-06-02T22:34:51.795101+0000","last_undegraded":"2024-06-02T22:34:51.795101+0000","last_fullsized":"2024-06-02T22:34:51.795101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:01.560086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274886+0000","last_change":"2024-06-02T22:31:20.759157+0000","last_active":"2024-06-02T22:34:24.274886+0000","last_peered":"2024-06-02T22:34:24.274886+0000","last_clean":"2024-06-02T22:34:24.274886+0000","last_became_active":"2024-06-02T22:31:20.758718+0000","last_became_peered":"2024-06-02T22:31:20.758718+0000","last_unstale":"2024-06-02T22:34:24.274886+0000","last_undegraded":"2024-06-02T22:34:24.274886+0000","last_fullsized":"2024-06-02T22:34:24.274886+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:57.685311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677406+0000","last_change":"2024-06-02T22:31:55.989604+0000","last_active":"2024-06-02T22:32:56.677406+0000","last_peered":"2024-06-02T22:32:56.677406+0000","last_clean":"2024-06-02T22:32:56.677406+0000","last_became_active":"2024-06-02T22:31:55.989177+0000","last_became_peered":"2024-06-02T22:31:55.989177+0000","last_unstale":"2024-06-02T22:32:56.677406+0000","last_undegraded":"2024-06-02T22:32:56.677406+0000","last_fullsized":"2024-06-02T22:32:56.677406+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:48:58.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681341+0000","last_change":"2024-06-02T22:31:15.845856+0000","last_active":"2024-06-02T22:32:56.681341+0000","last_peered":"2024-06-02T22:32:56.681341+0000","last_clean":"2024-06-02T22:32:56.681341+0000","last_became_active":"2024-06-02T22:31:15.845025+0000","last_became_peered":"2024-06-02T22:31:15.845025+0000","last_unstale":"2024-06-02T22:32:56.681341+0000","last_undegraded":"2024-06-02T22:32:56.681341+0000","last_fullsized":"2024-06-02T22:32:56.681341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:37.491987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.287856+0000","last_change":"2024-06-02T22:31:20.767420+0000","last_active":"2024-06-02T22:34:24.287856+0000","last_peered":"2024-06-02T22:34:24.287856+0000","last_clean":"2024-06-02T22:34:24.287856+0000","last_became_active":"2024-06-02T22:31:20.766768+0000","last_became_peered":"2024-06-02T22:31:20.766768+0000","last_unstale":"2024-06-02T22:34:24.287856+0000","last_undegraded":"2024-06-02T22:34:24.287856+0000","last_fullsized":"2024-06-02T22:34:24.287856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:20.829696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677467+0000","last_change":"2024-06-02T22:31:33.865917+0000","last_active":"2024-06-02T22:32:56.677467+0000","last_peered":"2024-06-02T22:32:56.677467+0000","last_clean":"2024-06-02T22:32:56.677467+0000","last_became_active":"2024-06-02T22:31:33.865466+0000","last_became_peered":"2024-06-02T22:31:33.865466+0000","last_unstale":"2024-06-02T22:32:56.677467+0000","last_undegraded":"2024-06-02T22:32:56.677467+0000","last_fullsized":"2024-06-02T22:32:56.677467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:37.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'12","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497246+0000","last_change":"2024-06-02T22:31:15.639522+0000","last_active":"2024-06-02T22:32:56.497246+0000","last_peered":"2024-06-02T22:32:56.497246+0000","last_clean":"2024-06-02T22:32:56.497246+0000","last_became_active":"2024-06-02T22:31:15.639029+0000","last_became_peered":"2024-06-02T22:31:15.639029+0000","last_unstale":"2024-06-02T22:32:56.497246+0000","last_undegraded":"2024-06-02T22:32:56.497246+0000","last_fullsized":"2024-06-02T22:32:56.497246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:29.388739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.269250+0000","last_change":"2024-06-02T22:31:20.772370+0000","last_active":"2024-06-02T22:34:24.269250+0000","last_peered":"2024-06-02T22:34:24.269250+0000","last_clean":"2024-06-02T22:34:24.269250+0000","last_became_active":"2024-06-02T22:31:20.772041+0000","last_became_peered":"2024-06-02T22:31:20.772041+0000","last_unstale":"2024-06-02T22:34:24.269250+0000","last_undegraded":"2024-06-02T22:34:24.269250+0000","last_fullsized":"2024-06-02T22:34:24.269250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:27.518648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677454+0000","last_change":"2024-06-02T22:31:55.990609+0000","last_active":"2024-06-02T22:32:56.677454+0000","last_peered":"2024-06-02T22:32:56.677454+0000","last_clean":"2024-06-02T22:32:56.677454+0000","last_became_active":"2024-06-02T22:31:55.990075+0000","last_became_peered":"2024-06-02T22:31:55.990075+0000","last_unstale":"2024-06-02T22:32:56.677454+0000","last_undegraded":"2024-06-02T22:32:56.677454+0000","last_fullsized":"2024-06-02T22:32:56.677454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:55:52.836659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497261+0000","last_change":"2024-06-02T22:31:15.636472+0000","last_active":"2024-06-02T22:32:56.497261+0000","last_peered":"2024-06-02T22:32:56.497261+0000","last_clean":"2024-06-02T22:32:56.497261+0000","last_became_active":"2024-06-02T22:31:15.636078+0000","last_became_peered":"2024-06-02T22:31:15.636078+0000","last_unstale":"2024-06-02T22:32:56.497261+0000","last_undegraded":"2024-06-02T22:32:56.497261+0000","last_fullsized":"2024-06-02T22:32:56.497261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:18:35.318873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.246688+0000","last_change":"2024-06-02T22:31:55.986887+0000","last_active":"2024-06-02T22:34:24.246688+0000","last_peered":"2024-06-02T22:34:24.246688+0000","last_clean":"2024-06-02T22:34:24.246688+0000","last_became_active":"2024-06-02T22:31:55.986468+0000","last_became_peered":"2024-06-02T22:31:55.986468+0000","last_unstale":"2024-06-02T22:34:24.246688+0000","last_undegraded":"2024-06-02T22:34:24.246688+0000","last_fullsized":"2024-06-02T22:34:24.246688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:58:27.696250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677538+0000","last_change":"2024-06-02T22:31:33.847193+0000","last_active":"2024-06-02T22:32:56.677538+0000","last_peered":"2024-06-02T22:32:56.677538+0000","last_clean":"2024-06-02T22:32:56.677538+0000","last_became_active":"2024-06-02T22:31:33.845955+0000","last_became_peered":"2024-06-02T22:31:33.845955+0000","last_unstale":"2024-06-02T22:32:56.677538+0000","last_undegraded":"2024-06-02T22:32:56.677538+0000","last_fullsized":"2024-06-02T22:32:56.677538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:43.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'7","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:53.666573+0000","last_change":"2024-06-02T22:31:15.640589+0000","last_active":"2024-06-02T22:34:53.666573+0000","last_peered":"2024-06-02T22:34:53.666573+0000","last_clean":"2024-06-02T22:34:53.666573+0000","last_became_active":"2024-06-02T22:31:15.640216+0000","last_became_peered":"2024-06-02T22:31:15.640216+0000","last_unstale":"2024-06-02T22:34:53.666573+0000","last_undegraded":"2024-06-02T22:34:53.666573+0000","last_fullsized":"2024-06-02T22:34:53.666573+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:40:02.375914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244809+0000","last_change":"2024-06-02T22:31:20.753879+0000","last_active":"2024-06-02T22:34:24.244809+0000","last_peered":"2024-06-02T22:34:24.244809+0000","last_clean":"2024-06-02T22:34:24.244809+0000","last_became_active":"2024-06-02T22:31:20.753528+0000","last_became_peered":"2024-06-02T22:31:20.753528+0000","last_unstale":"2024-06-02T22:34:24.244809+0000","last_undegraded":"2024-06-02T22:34:24.244809+0000","last_fullsized":"2024-06-02T22:34:24.244809+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:19.299178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677437+0000","last_change":"2024-06-02T22:31:33.858175+0000","last_active":"2024-06-02T22:32:56.677437+0000","last_peered":"2024-06-02T22:32:56.677437+0000","last_clean":"2024-06-02T22:32:56.677437+0000","last_became_active":"2024-06-02T22:31:33.857712+0000","last_became_peered":"2024-06-02T22:31:33.857712+0000","last_unstale":"2024-06-02T22:32:56.677437+0000","last_undegraded":"2024-06-02T22:32:56.677437+0000","last_fullsized":"2024-06-02T22:32:56.677437+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:30:01.632018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501055+0000","last_change":"2024-06-02T22:31:15.639810+0000","last_active":"2024-06-02T22:32:56.501055+0000","last_peered":"2024-06-02T22:32:56.501055+0000","last_clean":"2024-06-02T22:32:56.501055+0000","last_became_active":"2024-06-02T22:31:15.639487+0000","last_became_peered":"2024-06-02T22:31:15.639487+0000","last_unstale":"2024-06-02T22:32:56.501055+0000","last_undegraded":"2024-06-02T22:32:56.501055+0000","last_fullsized":"2024-06-02T22:32:56.501055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:26:48.168636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274921+0000","last_change":"2024-06-02T22:31:20.771988+0000","last_active":"2024-06-02T22:34:24.274921+0000","last_peered":"2024-06-02T22:34:24.274921+0000","last_clean":"2024-06-02T22:34:24.274921+0000","last_became_active":"2024-06-02T22:31:20.771506+0000","last_became_peered":"2024-06-02T22:31:20.771506+0000","last_unstale":"2024-06-02T22:34:24.274921+0000","last_undegraded":"2024-06-02T22:34:24.274921+0000","last_fullsized":"2024-06-02T22:34:24.274921+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:51:10.199149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678363+0000","last_change":"2024-06-02T22:31:33.861319+0000","last_active":"2024-06-02T22:32:56.678363+0000","last_peered":"2024-06-02T22:32:56.678363+0000","last_clean":"2024-06-02T22:32:56.678363+0000","last_became_active":"2024-06-02T22:31:33.860834+0000","last_became_peered":"2024-06-02T22:31:33.860834+0000","last_unstale":"2024-06-02T22:32:56.678363+0000","last_undegraded":"2024-06-02T22:32:56.678363+0000","last_fullsized":"2024-06-02T22:32:56.678363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:26.094118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681932+0000","last_change":"2024-06-02T22:31:15.645298+0000","last_active":"2024-06-02T22:32:56.681932+0000","last_peered":"2024-06-02T22:32:56.681932+0000","last_clean":"2024-06-02T22:32:56.681932+0000","last_became_active":"2024-06-02T22:31:15.643278+0000","last_became_peered":"2024-06-02T22:31:15.643278+0000","last_unstale":"2024-06-02T22:32:56.681932+0000","last_undegraded":"2024-06-02T22:32:56.681932+0000","last_fullsized":"2024-06-02T22:32:56.681932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:38:09.548519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270958+0000","last_change":"2024-06-02T22:31:20.769928+0000","last_active":"2024-06-02T22:34:24.270958+0000","last_peered":"2024-06-02T22:34:24.270958+0000","last_clean":"2024-06-02T22:34:24.270958+0000","last_became_active":"2024-06-02T22:31:20.769008+0000","last_became_peered":"2024-06-02T22:31:20.769008+0000","last_unstale":"2024-06-02T22:34:24.270958+0000","last_undegraded":"2024-06-02T22:34:24.270958+0000","last_fullsized":"2024-06-02T22:34:24.270958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:02.808992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679464+0000","last_change":"2024-06-02T22:31:33.869072+0000","last_active":"2024-06-02T22:32:56.679464+0000","last_peered":"2024-06-02T22:32:56.679464+0000","last_clean":"2024-06-02T22:32:56.679464+0000","last_became_active":"2024-06-02T22:31:33.868641+0000","last_became_peered":"2024-06-02T22:31:33.868641+0000","last_unstale":"2024-06-02T22:32:56.679464+0000","last_undegraded":"2024-06-02T22:32:56.679464+0000","last_fullsized":"2024-06-02T22:32:56.679464+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:29.227798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635017+0000","last_change":"2024-06-02T22:31:15.637656+0000","last_active":"2024-06-02T22:32:56.635017+0000","last_peered":"2024-06-02T22:32:56.635017+0000","last_clean":"2024-06-02T22:32:56.635017+0000","last_became_active":"2024-06-02T22:31:15.637317+0000","last_became_peered":"2024-06-02T22:31:15.637317+0000","last_unstale":"2024-06-02T22:32:56.635017+0000","last_undegraded":"2024-06-02T22:32:56.635017+0000","last_fullsized":"2024-06-02T22:32:56.635017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:21.307766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.277458+0000","last_change":"2024-06-02T22:31:20.764811+0000","last_active":"2024-06-02T22:34:24.277458+0000","last_peered":"2024-06-02T22:34:24.277458+0000","last_clean":"2024-06-02T22:34:24.277458+0000","last_became_active":"2024-06-02T22:31:20.763605+0000","last_became_peered":"2024-06-02T22:31:20.763605+0000","last_unstale":"2024-06-02T22:34:24.277458+0000","last_undegraded":"2024-06-02T22:34:24.277458+0000","last_fullsized":"2024-06-02T22:34:24.277458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:57:24.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680118+0000","last_change":"2024-06-02T22:31:33.861450+0000","last_active":"2024-06-02T22:32:56.680118+0000","last_peered":"2024-06-02T22:32:56.680118+0000","last_clean":"2024-06-02T22:32:56.680118+0000","last_became_active":"2024-06-02T22:31:33.860933+0000","last_became_peered":"2024-06-02T22:31:33.860933+0000","last_unstale":"2024-06-02T22:32:56.680118+0000","last_undegraded":"2024-06-02T22:32:56.680118+0000","last_fullsized":"2024-06-02T22:32:56.680118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:26.480320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'6","reported_seq":303,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:55.668790+0000","last_change":"2024-06-02T22:31:15.644469+0000","last_active":"2024-06-02T22:34:55.668790+0000","last_peered":"2024-06-02T22:34:55.668790+0000","last_clean":"2024-06-02T22:34:55.668790+0000","last_became_active":"2024-06-02T22:31:15.644115+0000","last_became_peered":"2024-06-02T22:31:15.644115+0000","last_unstale":"2024-06-02T22:34:55.668790+0000","last_undegraded":"2024-06-02T22:34:55.668790+0000","last_fullsized":"2024-06-02T22:34:55.668790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:44:49.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":252,"num_read_kb":252,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.250899+0000","last_change":"2024-06-02T22:31:20.752581+0000","last_active":"2024-06-02T22:34:24.250899+0000","last_peered":"2024-06-02T22:34:24.250899+0000","last_clean":"2024-06-02T22:34:24.250899+0000","last_became_active":"2024-06-02T22:31:20.752102+0000","last_became_peered":"2024-06-02T22:31:20.752102+0000","last_unstale":"2024-06-02T22:34:24.250899+0000","last_undegraded":"2024-06-02T22:34:24.250899+0000","last_fullsized":"2024-06-02T22:34:24.250899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:57.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.504594+0000","last_change":"2024-06-02T22:31:33.860102+0000","last_active":"2024-06-02T22:32:56.504594+0000","last_peered":"2024-06-02T22:32:56.504594+0000","last_clean":"2024-06-02T22:32:56.504594+0000","last_became_active":"2024-06-02T22:31:33.859689+0000","last_became_peered":"2024-06-02T22:31:33.859689+0000","last_unstale":"2024-06-02T22:32:56.504594+0000","last_undegraded":"2024-06-02T22:32:56.504594+0000","last_fullsized":"2024-06-02T22:32:56.504594+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:36.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511269+0000","last_change":"2024-06-02T22:31:15.636548+0000","last_active":"2024-06-02T22:32:56.511269+0000","last_peered":"2024-06-02T22:32:56.511269+0000","last_clean":"2024-06-02T22:32:56.511269+0000","last_became_active":"2024-06-02T22:31:15.636097+0000","last_became_peered":"2024-06-02T22:31:15.636097+0000","last_unstale":"2024-06-02T22:32:56.511269+0000","last_undegraded":"2024-06-02T22:32:56.511269+0000","last_fullsized":"2024-06-02T22:32:56.511269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:26:04.280465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.284491+0000","last_change":"2024-06-02T22:31:20.760290+0000","last_active":"2024-06-02T22:34:24.284491+0000","last_peered":"2024-06-02T22:34:24.284491+0000","last_clean":"2024-06-02T22:34:24.284491+0000","last_became_active":"2024-06-02T22:31:20.759678+0000","last_became_peered":"2024-06-02T22:31:20.759678+0000","last_unstale":"2024-06-02T22:34:24.284491+0000","last_undegraded":"2024-06-02T22:34:24.284491+0000","last_fullsized":"2024-06-02T22:34:24.284491+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:46.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677637+0000","last_change":"2024-06-02T22:31:33.865919+0000","last_active":"2024-06-02T22:32:56.677637+0000","last_peered":"2024-06-02T22:32:56.677637+0000","last_clean":"2024-06-02T22:32:56.677637+0000","last_became_active":"2024-06-02T22:31:33.865396+0000","last_became_peered":"2024-06-02T22:31:33.865396+0000","last_unstale":"2024-06-02T22:32:56.677637+0000","last_undegraded":"2024-06-02T22:32:56.677637+0000","last_fullsized":"2024-06-02T22:32:56.677637+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:06:09.238985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635370+0000","last_change":"2024-06-02T22:31:15.847154+0000","last_active":"2024-06-02T22:32:56.635370+0000","last_peered":"2024-06-02T22:32:56.635370+0000","last_clean":"2024-06-02T22:32:56.635370+0000","last_became_active":"2024-06-02T22:31:15.846743+0000","last_became_peered":"2024-06-02T22:31:15.846743+0000","last_unstale":"2024-06-02T22:32:56.635370+0000","last_undegraded":"2024-06-02T22:32:56.635370+0000","last_fullsized":"2024-06-02T22:32:56.635370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:00.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244296+0000","last_change":"2024-06-02T22:31:20.748926+0000","last_active":"2024-06-02T22:34:24.244296+0000","last_peered":"2024-06-02T22:34:24.244296+0000","last_clean":"2024-06-02T22:34:24.244296+0000","last_became_active":"2024-06-02T22:31:20.748588+0000","last_became_peered":"2024-06-02T22:31:20.748588+0000","last_unstale":"2024-06-02T22:34:24.244296+0000","last_undegraded":"2024-06-02T22:34:24.244296+0000","last_fullsized":"2024-06-02T22:34:24.244296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:26:09.876916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506125+0000","last_change":"2024-06-02T22:31:33.859876+0000","last_active":"2024-06-02T22:32:56.506125+0000","last_peered":"2024-06-02T22:32:56.506125+0000","last_clean":"2024-06-02T22:32:56.506125+0000","last_became_active":"2024-06-02T22:31:33.856511+0000","last_became_peered":"2024-06-02T22:31:33.856511+0000","last_unstale":"2024-06-02T22:32:56.506125+0000","last_undegraded":"2024-06-02T22:32:56.506125+0000","last_fullsized":"2024-06-02T22:32:56.506125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:00.255066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'41","reported_seq":366,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:55.669008+0000","last_change":"2024-06-02T22:31:55.992340+0000","last_active":"2024-06-02T22:34:55.669008+0000","last_peered":"2024-06-02T22:34:55.669008+0000","last_clean":"2024-06-02T22:34:55.669008+0000","last_became_active":"2024-06-02T22:31:55.984100+0000","last_became_peered":"2024-06-02T22:31:55.984100+0000","last_unstale":"2024-06-02T22:34:55.669008+0000","last_undegraded":"2024-06-02T22:34:55.669008+0000","last_fullsized":"2024-06-02T22:34:55.669008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:40.557506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66767,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":264,"num_read_kb":198,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.239021+0000","last_change":"2024-06-02T22:31:20.755532+0000","last_active":"2024-06-02T22:34:24.239021+0000","last_peered":"2024-06-02T22:34:24.239021+0000","last_clean":"2024-06-02T22:34:24.239021+0000","last_became_active":"2024-06-02T22:31:20.755186+0000","last_became_peered":"2024-06-02T22:31:20.755186+0000","last_unstale":"2024-06-02T22:34:24.239021+0000","last_undegraded":"2024-06-02T22:34:24.239021+0000","last_fullsized":"2024-06-02T22:34:24.239021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:24.459712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635671+0000","last_change":"2024-06-02T22:31:33.864513+0000","last_active":"2024-06-02T22:32:56.635671+0000","last_peered":"2024-06-02T22:32:56.635671+0000","last_clean":"2024-06-02T22:32:56.635671+0000","last_became_active":"2024-06-02T22:31:33.864009+0000","last_became_peered":"2024-06-02T22:31:33.864009+0000","last_unstale":"2024-06-02T22:32:56.635671+0000","last_undegraded":"2024-06-02T22:32:56.635671+0000","last_fullsized":"2024-06-02T22:32:56.635671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:36:14.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'9","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678103+0000","last_change":"2024-06-02T22:31:55.994602+0000","last_active":"2024-06-02T22:32:56.678103+0000","last_peered":"2024-06-02T22:32:56.678103+0000","last_clean":"2024-06-02T22:32:56.678103+0000","last_became_active":"2024-06-02T22:31:55.989825+0000","last_became_peered":"2024-06-02T22:31:55.989825+0000","last_unstale":"2024-06-02T22:32:56.678103+0000","last_undegraded":"2024-06-02T22:32:56.678103+0000","last_fullsized":"2024-06-02T22:32:56.678103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:20:50.155888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.269882+0000","last_change":"2024-06-02T22:31:20.777927+0000","last_active":"2024-06-02T22:34:24.269882+0000","last_peered":"2024-06-02T22:34:24.269882+0000","last_clean":"2024-06-02T22:34:24.269882+0000","last_became_active":"2024-06-02T22:31:20.777609+0000","last_became_peered":"2024-06-02T22:31:20.777609+0000","last_unstale":"2024-06-02T22:34:24.269882+0000","last_undegraded":"2024-06-02T22:34:24.269882+0000","last_fullsized":"2024-06-02T22:34:24.269882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:07.396916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677833+0000","last_change":"2024-06-02T22:31:33.861447+0000","last_active":"2024-06-02T22:32:56.677833+0000","last_peered":"2024-06-02T22:32:56.677833+0000","last_clean":"2024-06-02T22:32:56.677833+0000","last_became_active":"2024-06-02T22:31:33.860836+0000","last_became_peered":"2024-06-02T22:31:33.860836+0000","last_unstale":"2024-06-02T22:32:56.677833+0000","last_undegraded":"2024-06-02T22:32:56.677833+0000","last_fullsized":"2024-06-02T22:32:56.677833+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:21.297872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635188+0000","last_change":"2024-06-02T22:31:15.644306+0000","last_active":"2024-06-02T22:32:56.635188+0000","last_peered":"2024-06-02T22:32:56.635188+0000","last_clean":"2024-06-02T22:32:56.635188+0000","last_became_active":"2024-06-02T22:31:15.643741+0000","last_became_peered":"2024-06-02T22:31:15.643741+0000","last_unstale":"2024-06-02T22:32:56.635188+0000","last_undegraded":"2024-06-02T22:32:56.635188+0000","last_fullsized":"2024-06-02T22:32:56.635188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:53.161633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268768+0000","last_change":"2024-06-02T22:31:20.751551+0000","last_active":"2024-06-02T22:34:24.268768+0000","last_peered":"2024-06-02T22:34:24.268768+0000","last_clean":"2024-06-02T22:34:24.268768+0000","last_became_active":"2024-06-02T22:31:20.751002+0000","last_became_peered":"2024-06-02T22:31:20.751002+0000","last_unstale":"2024-06-02T22:34:24.268768+0000","last_undegraded":"2024-06-02T22:34:24.268768+0000","last_fullsized":"2024-06-02T22:34:24.268768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:40:18.201325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507255+0000","last_change":"2024-06-02T22:31:33.871515+0000","last_active":"2024-06-02T22:32:56.507255+0000","last_peered":"2024-06-02T22:32:56.507255+0000","last_clean":"2024-06-02T22:32:56.507255+0000","last_became_active":"2024-06-02T22:31:33.870756+0000","last_became_peered":"2024-06-02T22:31:33.870756+0000","last_unstale":"2024-06-02T22:32:56.507255+0000","last_undegraded":"2024-06-02T22:32:56.507255+0000","last_fullsized":"2024-06-02T22:32:56.507255+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:12:31.109559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'5","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:54.703912+0000","last_change":"2024-06-02T22:31:15.638139+0000","last_active":"2024-06-02T22:34:54.703912+0000","last_peered":"2024-06-02T22:34:54.703912+0000","last_clean":"2024-06-02T22:34:54.703912+0000","last_became_active":"2024-06-02T22:31:15.636635+0000","last_became_peered":"2024-06-02T22:31:15.636635+0000","last_unstale":"2024-06-02T22:34:54.703912+0000","last_undegraded":"2024-06-02T22:34:54.703912+0000","last_fullsized":"2024-06-02T22:34:54.703912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:07.195137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.235429+0000","last_change":"2024-06-02T22:31:20.745347+0000","last_active":"2024-06-02T22:34:24.235429+0000","last_peered":"2024-06-02T22:34:24.235429+0000","last_clean":"2024-06-02T22:34:24.235429+0000","last_became_active":"2024-06-02T22:31:20.744990+0000","last_became_peered":"2024-06-02T22:31:20.744990+0000","last_unstale":"2024-06-02T22:34:24.235429+0000","last_undegraded":"2024-06-02T22:34:24.235429+0000","last_fullsized":"2024-06-02T22:34:24.235429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:20.215740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684338+0000","last_change":"2024-06-02T22:31:33.866261+0000","last_active":"2024-06-02T22:32:56.684338+0000","last_peered":"2024-06-02T22:32:56.684338+0000","last_clean":"2024-06-02T22:32:56.684338+0000","last_became_active":"2024-06-02T22:31:33.865863+0000","last_became_peered":"2024-06-02T22:31:33.865863+0000","last_unstale":"2024-06-02T22:32:56.684338+0000","last_undegraded":"2024-06-02T22:32:56.684338+0000","last_fullsized":"2024-06-02T22:32:56.684338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:00:41.670289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'17","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496844+0000","last_change":"2024-06-02T22:31:15.848282+0000","last_active":"2024-06-02T22:32:56.496844+0000","last_peered":"2024-06-02T22:32:56.496844+0000","last_clean":"2024-06-02T22:32:56.496844+0000","last_became_active":"2024-06-02T22:31:15.847846+0000","last_became_peered":"2024-06-02T22:31:15.847846+0000","last_unstale":"2024-06-02T22:32:56.496844+0000","last_undegraded":"2024-06-02T22:32:56.496844+0000","last_fullsized":"2024-06-02T22:32:56.496844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:09:12.971908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242845+0000","last_change":"2024-06-02T22:31:20.756682+0000","last_active":"2024-06-02T22:34:24.242845+0000","last_peered":"2024-06-02T22:34:24.242845+0000","last_clean":"2024-06-02T22:34:24.242845+0000","last_became_active":"2024-06-02T22:31:20.756357+0000","last_became_peered":"2024-06-02T22:31:20.756357+0000","last_unstale":"2024-06-02T22:34:24.242845+0000","last_undegraded":"2024-06-02T22:34:24.242845+0000","last_fullsized":"2024-06-02T22:34:24.242845+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:39:53.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635098+0000","last_change":"2024-06-02T22:31:33.858267+0000","last_active":"2024-06-02T22:32:56.635098+0000","last_peered":"2024-06-02T22:32:56.635098+0000","last_clean":"2024-06-02T22:32:56.635098+0000","last_became_active":"2024-06-02T22:31:33.857784+0000","last_became_peered":"2024-06-02T22:31:33.857784+0000","last_unstale":"2024-06-02T22:32:56.635098+0000","last_undegraded":"2024-06-02T22:32:56.635098+0000","last_fullsized":"2024-06-02T22:32:56.635098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:07:11.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497427+0000","last_change":"2024-06-02T22:31:15.637328+0000","last_active":"2024-06-02T22:32:56.497427+0000","last_peered":"2024-06-02T22:32:56.497427+0000","last_clean":"2024-06-02T22:32:56.497427+0000","last_became_active":"2024-06-02T22:31:15.636933+0000","last_became_peered":"2024-06-02T22:31:15.636933+0000","last_unstale":"2024-06-02T22:32:56.497427+0000","last_undegraded":"2024-06-02T22:32:56.497427+0000","last_fullsized":"2024-06-02T22:32:56.497427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:12:40.358884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.239868+0000","last_change":"2024-06-02T22:31:20.752471+0000","last_active":"2024-06-02T22:34:24.239868+0000","last_peered":"2024-06-02T22:34:24.239868+0000","last_clean":"2024-06-02T22:34:24.239868+0000","last_became_active":"2024-06-02T22:31:20.750450+0000","last_became_peered":"2024-06-02T22:31:20.750450+0000","last_unstale":"2024-06-02T22:34:24.239868+0000","last_undegraded":"2024-06-02T22:34:24.239868+0000","last_fullsized":"2024-06-02T22:34:24.239868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:26:21.467156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497322+0000","last_change":"2024-06-02T22:31:55.984989+0000","last_active":"2024-06-02T22:32:56.497322+0000","last_peered":"2024-06-02T22:32:56.497322+0000","last_clean":"2024-06-02T22:32:56.497322+0000","last_became_active":"2024-06-02T22:31:55.984481+0000","last_became_peered":"2024-06-02T22:31:55.984481+0000","last_unstale":"2024-06-02T22:32:56.497322+0000","last_undegraded":"2024-06-02T22:32:56.497322+0000","last_fullsized":"2024-06-02T22:32:56.497322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:12.087792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506536+0000","last_change":"2024-06-02T22:31:15.849517+0000","last_active":"2024-06-02T22:32:56.506536+0000","last_peered":"2024-06-02T22:32:56.506536+0000","last_clean":"2024-06-02T22:32:56.506536+0000","last_became_active":"2024-06-02T22:31:15.849092+0000","last_became_peered":"2024-06-02T22:31:15.849092+0000","last_unstale":"2024-06-02T22:32:56.506536+0000","last_undegraded":"2024-06-02T22:32:56.506536+0000","last_fullsized":"2024-06-02T22:32:56.506536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:50.722007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270490+0000","last_change":"2024-06-02T22:31:20.768944+0000","last_active":"2024-06-02T22:34:24.270490+0000","last_peered":"2024-06-02T22:34:24.270490+0000","last_clean":"2024-06-02T22:34:24.270490+0000","last_became_active":"2024-06-02T22:31:20.768275+0000","last_became_peered":"2024-06-02T22:31:20.768275+0000","last_unstale":"2024-06-02T22:34:24.270490+0000","last_undegraded":"2024-06-02T22:34:24.270490+0000","last_fullsized":"2024-06-02T22:34:24.270490+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:05.760188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684133+0000","last_change":"2024-06-02T22:31:33.860760+0000","last_active":"2024-06-02T22:32:56.684133+0000","last_peered":"2024-06-02T22:32:56.684133+0000","last_clean":"2024-06-02T22:32:56.684133+0000","last_became_active":"2024-06-02T22:31:33.860203+0000","last_became_peered":"2024-06-02T22:31:33.860203+0000","last_unstale":"2024-06-02T22:32:56.684133+0000","last_undegraded":"2024-06-02T22:32:56.684133+0000","last_fullsized":"2024-06-02T22:32:56.684133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:59:22.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"99'7","reported_seq":177,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:50.793668+0000","last_change":"2024-06-02T22:31:15.640274+0000","last_active":"2024-06-02T22:34:50.793668+0000","last_peered":"2024-06-02T22:34:50.793668+0000","last_clean":"2024-06-02T22:34:50.793668+0000","last_became_active":"2024-06-02T22:31:15.639879+0000","last_became_peered":"2024-06-02T22:31:15.639879+0000","last_unstale":"2024-06-02T22:34:50.793668+0000","last_undegraded":"2024-06-02T22:34:50.793668+0000","last_fullsized":"2024-06-02T22:34:50.793668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:51:37.947343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268084+0000","last_change":"2024-06-02T22:31:20.767645+0000","last_active":"2024-06-02T22:34:24.268084+0000","last_peered":"2024-06-02T22:34:24.268084+0000","last_clean":"2024-06-02T22:34:24.268084+0000","last_became_active":"2024-06-02T22:31:20.767290+0000","last_became_peered":"2024-06-02T22:31:20.767290+0000","last_unstale":"2024-06-02T22:34:24.268084+0000","last_undegraded":"2024-06-02T22:34:24.268084+0000","last_fullsized":"2024-06-02T22:34:24.268084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:48:10.989940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684431+0000","last_change":"2024-06-02T22:31:34.188667+0000","last_active":"2024-06-02T22:32:56.684431+0000","last_peered":"2024-06-02T22:32:56.684431+0000","last_clean":"2024-06-02T22:32:56.684431+0000","last_became_active":"2024-06-02T22:31:34.187865+0000","last_became_peered":"2024-06-02T22:31:34.187865+0000","last_unstale":"2024-06-02T22:32:56.684431+0000","last_undegraded":"2024-06-02T22:32:56.684431+0000","last_fullsized":"2024-06-02T22:32:56.684431+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:48.544150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.240442+0000","last_change":"2024-06-02T22:31:20.755881+0000","last_active":"2024-06-02T22:34:24.240442+0000","last_peered":"2024-06-02T22:34:24.240442+0000","last_clean":"2024-06-02T22:34:24.240442+0000","last_became_active":"2024-06-02T22:31:20.755481+0000","last_became_peered":"2024-06-02T22:31:20.755481+0000","last_unstale":"2024-06-02T22:34:24.240442+0000","last_undegraded":"2024-06-02T22:34:24.240442+0000","last_fullsized":"2024-06-02T22:34:24.240442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:10:33.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'5","reported_seq":172,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:49.694114+0000","last_change":"2024-06-02T22:31:15.846057+0000","last_active":"2024-06-02T22:34:49.694114+0000","last_peered":"2024-06-02T22:34:49.694114+0000","last_clean":"2024-06-02T22:34:49.694114+0000","last_became_active":"2024-06-02T22:31:15.845097+0000","last_became_peered":"2024-06-02T22:31:15.845097+0000","last_unstale":"2024-06-02T22:34:49.694114+0000","last_undegraded":"2024-06-02T22:34:49.694114+0000","last_fullsized":"2024-06-02T22:34:49.694114+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:22:23.481235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:03.693110+0000","last_change":"2024-06-02T22:31:33.858499+0000","last_active":"2024-06-02T22:33:03.693110+0000","last_peered":"2024-06-02T22:33:03.693110+0000","last_clean":"2024-06-02T22:33:03.693110+0000","last_became_active":"2024-06-02T22:31:33.857914+0000","last_became_peered":"2024-06-02T22:31:33.857914+0000","last_unstale":"2024-06-02T22:33:03.693110+0000","last_undegraded":"2024-06-02T22:33:03.693110+0000","last_fullsized":"2024-06-02T22:33:03.693110+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:50:09.743015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272808+0000","last_change":"2024-06-02T22:31:20.763011+0000","last_active":"2024-06-02T22:34:24.272808+0000","last_peered":"2024-06-02T22:34:24.272808+0000","last_clean":"2024-06-02T22:34:24.272808+0000","last_became_active":"2024-06-02T22:31:20.759450+0000","last_became_peered":"2024-06-02T22:31:20.759450+0000","last_unstale":"2024-06-02T22:34:24.272808+0000","last_undegraded":"2024-06-02T22:34:24.272808+0000","last_fullsized":"2024-06-02T22:34:24.272808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:08:24.748321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'6","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:15.642691+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:15.642313+0000","last_became_peered":"2024-06-02T22:31:15.642313+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:34:32.329387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":368,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510628+0000","last_change":"2024-06-02T22:29:39.376514+0000","last_active":"2024-06-02T22:32:56.510628+0000","last_peered":"2024-06-02T22:32:56.510628+0000","last_clean":"2024-06-02T22:32:56.510628+0000","last_became_active":"2024-06-02T22:29:39.376061+0000","last_became_peered":"2024-06-02T22:29:39.376061+0000","last_unstale":"2024-06-02T22:32:56.510628+0000","last_undegraded":"2024-06-02T22:32:56.510628+0000","last_fullsized":"2024-06-02T22:32:56.510628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_clean_scrub_stamp":"2024-06-02T22:25:41.060756+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:26:05.799761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635473+0000","last_change":"2024-06-02T22:31:34.189204+0000","last_active":"2024-06-02T22:32:56.635473+0000","last_peered":"2024-06-02T22:32:56.635473+0000","last_clean":"2024-06-02T22:32:56.635473+0000","last_became_active":"2024-06-02T22:31:34.188639+0000","last_became_peered":"2024-06-02T22:31:34.188639+0000","last_unstale":"2024-06-02T22:32:56.635473+0000","last_undegraded":"2024-06-02T22:32:56.635473+0000","last_fullsized":"2024-06-02T22:32:56.635473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:03:37.983874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268318+0000","last_change":"2024-06-02T22:31:20.768724+0000","last_active":"2024-06-02T22:34:24.268318+0000","last_peered":"2024-06-02T22:34:24.268318+0000","last_clean":"2024-06-02T22:34:24.268318+0000","last_became_active":"2024-06-02T22:31:20.768328+0000","last_became_peered":"2024-06-02T22:31:20.768328+0000","last_unstale":"2024-06-02T22:34:24.268318+0000","last_undegraded":"2024-06-02T22:34:24.268318+0000","last_fullsized":"2024-06-02T22:34:24.268318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:48.993951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510775+0000","last_change":"2024-06-02T22:31:15.637109+0000","last_active":"2024-06-02T22:32:56.510775+0000","last_peered":"2024-06-02T22:32:56.510775+0000","last_clean":"2024-06-02T22:32:56.510775+0000","last_became_active":"2024-06-02T22:31:15.636511+0000","last_became_peered":"2024-06-02T22:31:15.636511+0000","last_unstale":"2024-06-02T22:32:56.510775+0000","last_undegraded":"2024-06-02T22:32:56.510775+0000","last_fullsized":"2024-06-02T22:32:56.510775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:11:15.838242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678182+0000","last_change":"2024-06-02T22:31:33.861118+0000","last_active":"2024-06-02T22:32:56.678182+0000","last_peered":"2024-06-02T22:32:56.678182+0000","last_clean":"2024-06-02T22:32:56.678182+0000","last_became_active":"2024-06-02T22:31:33.860622+0000","last_became_peered":"2024-06-02T22:31:33.860622+0000","last_unstale":"2024-06-02T22:32:56.678182+0000","last_undegraded":"2024-06-02T22:32:56.678182+0000","last_fullsized":"2024-06-02T22:32:56.678182+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:14.052151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'4","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678341+0000","last_change":"2024-06-02T22:31:56.477226+0000","last_active":"2024-06-02T22:32:56.678341+0000","last_peered":"2024-06-02T22:32:56.678341+0000","last_clean":"2024-06-02T22:32:56.678341+0000","last_became_active":"2024-06-02T22:31:56.476839+0000","last_became_peered":"2024-06-02T22:31:56.476839+0000","last_unstale":"2024-06-02T22:32:56.678341+0000","last_undegraded":"2024-06-02T22:32:56.678341+0000","last_fullsized":"2024-06-02T22:32:56.678341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:12.233878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.267821+0000","last_change":"2024-06-02T22:31:20.771984+0000","last_active":"2024-06-02T22:34:24.267821+0000","last_peered":"2024-06-02T22:34:24.267821+0000","last_clean":"2024-06-02T22:34:24.267821+0000","last_became_active":"2024-06-02T22:31:20.771524+0000","last_became_peered":"2024-06-02T22:31:20.771524+0000","last_unstale":"2024-06-02T22:34:24.267821+0000","last_undegraded":"2024-06-02T22:34:24.267821+0000","last_fullsized":"2024-06-02T22:34:24.267821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:13:25.590377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681347+0000","last_change":"2024-06-02T22:31:34.188564+0000","last_active":"2024-06-02T22:32:56.681347+0000","last_peered":"2024-06-02T22:32:56.681347+0000","last_clean":"2024-06-02T22:32:56.681347+0000","last_became_active":"2024-06-02T22:31:34.187631+0000","last_became_peered":"2024-06-02T22:31:34.187631+0000","last_unstale":"2024-06-02T22:32:56.681347+0000","last_undegraded":"2024-06-02T22:32:56.681347+0000","last_fullsized":"2024-06-02T22:32:56.681347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:23:35.572300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'17","reported_seq":62,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:28.729103+0000","last_change":"2024-06-02T22:31:15.648073+0000","last_active":"2024-06-02T22:33:28.729103+0000","last_peered":"2024-06-02T22:33:28.729103+0000","last_clean":"2024-06-02T22:33:28.729103+0000","last_became_active":"2024-06-02T22:31:15.647573+0000","last_became_peered":"2024-06-02T22:31:15.647573+0000","last_unstale":"2024-06-02T22:33:28.729103+0000","last_undegraded":"2024-06-02T22:33:28.729103+0000","last_fullsized":"2024-06-02T22:33:28.729103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:58.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.263542+0000","last_change":"2024-06-02T22:31:20.764750+0000","last_active":"2024-06-02T22:34:24.263542+0000","last_peered":"2024-06-02T22:34:24.263542+0000","last_clean":"2024-06-02T22:34:24.263542+0000","last_became_active":"2024-06-02T22:31:20.763025+0000","last_became_peered":"2024-06-02T22:31:20.763025+0000","last_unstale":"2024-06-02T22:34:24.263542+0000","last_undegraded":"2024-06-02T22:34:24.263542+0000","last_fullsized":"2024-06-02T22:34:24.263542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677223+0000","last_change":"2024-06-02T22:31:33.845885+0000","last_active":"2024-06-02T22:32:56.677223+0000","last_peered":"2024-06-02T22:32:56.677223+0000","last_clean":"2024-06-02T22:32:56.677223+0000","last_became_active":"2024-06-02T22:31:33.845076+0000","last_became_peered":"2024-06-02T22:31:33.845076+0000","last_unstale":"2024-06-02T22:32:56.677223+0000","last_undegraded":"2024-06-02T22:32:56.677223+0000","last_fullsized":"2024-06-02T22:32:56.677223+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:28:32.849389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'7","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677923+0000","last_change":"2024-06-02T22:31:16.009742+0000","last_active":"2024-06-02T22:32:56.677923+0000","last_peered":"2024-06-02T22:32:56.677923+0000","last_clean":"2024-06-02T22:32:56.677923+0000","last_became_active":"2024-06-02T22:31:16.009462+0000","last_became_peered":"2024-06-02T22:31:16.009462+0000","last_unstale":"2024-06-02T22:32:56.677923+0000","last_undegraded":"2024-06-02T22:32:56.677923+0000","last_fullsized":"2024-06-02T22:32:56.677923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:57.963782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283643+0000","last_change":"2024-06-02T22:31:20.779344+0000","last_active":"2024-06-02T22:34:24.283643+0000","last_peered":"2024-06-02T22:34:24.283643+0000","last_clean":"2024-06-02T22:34:24.283643+0000","last_became_active":"2024-06-02T22:31:20.778586+0000","last_became_peered":"2024-06-02T22:31:20.778586+0000","last_unstale":"2024-06-02T22:34:24.283643+0000","last_undegraded":"2024-06-02T22:34:24.283643+0000","last_fullsized":"2024-06-02T22:34:24.283643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:55:01.213401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677711+0000","last_change":"2024-06-02T22:31:55.986536+0000","last_active":"2024-06-02T22:32:56.677711+0000","last_peered":"2024-06-02T22:32:56.677711+0000","last_clean":"2024-06-02T22:32:56.677711+0000","last_became_active":"2024-06-02T22:31:55.985958+0000","last_became_peered":"2024-06-02T22:31:55.985958+0000","last_unstale":"2024-06-02T22:32:56.677711+0000","last_undegraded":"2024-06-02T22:32:56.677711+0000","last_fullsized":"2024-06-02T22:32:56.677711+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:02:13.317010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637545+0000","last_change":"2024-06-02T22:31:15.844475+0000","last_active":"2024-06-02T22:32:56.637545+0000","last_peered":"2024-06-02T22:32:56.637545+0000","last_clean":"2024-06-02T22:32:56.637545+0000","last_became_active":"2024-06-02T22:31:15.844135+0000","last_became_peered":"2024-06-02T22:31:15.844135+0000","last_unstale":"2024-06-02T22:32:56.637545+0000","last_undegraded":"2024-06-02T22:32:56.637545+0000","last_fullsized":"2024-06-02T22:32:56.637545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:44:29.127186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.195228+0000","last_change":"2024-06-02T22:31:20.752005+0000","last_active":"2024-06-02T22:34:24.195228+0000","last_peered":"2024-06-02T22:34:24.195228+0000","last_clean":"2024-06-02T22:34:24.195228+0000","last_became_active":"2024-06-02T22:31:20.751525+0000","last_became_peered":"2024-06-02T22:31:20.751525+0000","last_unstale":"2024-06-02T22:34:24.195228+0000","last_undegraded":"2024-06-02T22:34:24.195228+0000","last_fullsized":"2024-06-02T22:34:24.195228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:08:35.477470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507234+0000","last_change":"2024-06-02T22:31:33.870374+0000","last_active":"2024-06-02T22:32:56.507234+0000","last_peered":"2024-06-02T22:32:56.507234+0000","last_clean":"2024-06-02T22:32:56.507234+0000","last_became_active":"2024-06-02T22:31:33.869931+0000","last_became_peered":"2024-06-02T22:31:33.869931+0000","last_unstale":"2024-06-02T22:32:56.507234+0000","last_undegraded":"2024-06-02T22:32:56.507234+0000","last_fullsized":"2024-06-02T22:32:56.507234+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:33:11.209183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680278+0000","last_change":"2024-06-02T22:31:15.645570+0000","last_active":"2024-06-02T22:32:56.680278+0000","last_peered":"2024-06-02T22:32:56.680278+0000","last_clean":"2024-06-02T22:32:56.680278+0000","last_became_active":"2024-06-02T22:31:15.645124+0000","last_became_peered":"2024-06-02T22:31:15.645124+0000","last_unstale":"2024-06-02T22:32:56.680278+0000","last_undegraded":"2024-06-02T22:32:56.680278+0000","last_fullsized":"2024-06-02T22:32:56.680278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:11:56.956942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272563+0000","last_change":"2024-06-02T22:31:20.758501+0000","last_active":"2024-06-02T22:34:24.272563+0000","last_peered":"2024-06-02T22:34:24.272563+0000","last_clean":"2024-06-02T22:34:24.272563+0000","last_became_active":"2024-06-02T22:31:20.758097+0000","last_became_peered":"2024-06-02T22:31:20.758097+0000","last_unstale":"2024-06-02T22:34:24.272563+0000","last_undegraded":"2024-06-02T22:34:24.272563+0000","last_fullsized":"2024-06-02T22:34:24.272563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:47.523600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:11.873542+0000","last_change":"2024-06-02T22:31:33.858463+0000","last_active":"2024-06-02T22:33:11.873542+0000","last_peered":"2024-06-02T22:33:11.873542+0000","last_clean":"2024-06-02T22:33:11.873542+0000","last_became_active":"2024-06-02T22:31:33.858001+0000","last_became_peered":"2024-06-02T22:31:33.858001+0000","last_unstale":"2024-06-02T22:33:11.873542+0000","last_undegraded":"2024-06-02T22:33:11.873542+0000","last_fullsized":"2024-06-02T22:33:11.873542+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:50.797150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677176+0000","last_change":"2024-06-02T22:31:15.644144+0000","last_active":"2024-06-02T22:32:56.677176+0000","last_peered":"2024-06-02T22:32:56.677176+0000","last_clean":"2024-06-02T22:32:56.677176+0000","last_became_active":"2024-06-02T22:31:15.643629+0000","last_became_peered":"2024-06-02T22:31:15.643629+0000","last_unstale":"2024-06-02T22:32:56.677176+0000","last_undegraded":"2024-06-02T22:32:56.677176+0000","last_fullsized":"2024-06-02T22:32:56.677176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:45:36.491134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286927+0000","last_change":"2024-06-02T22:32:56.681729+0000","last_active":"2024-06-02T22:34:24.286927+0000","last_peered":"2024-06-02T22:34:24.286927+0000","last_clean":"2024-06-02T22:34:24.286927+0000","last_became_active":"2024-06-02T22:32:56.680934+0000","last_became_peered":"2024-06-02T22:32:56.680934+0000","last_unstale":"2024-06-02T22:34:24.286927+0000","last_undegraded":"2024-06-02T22:34:24.286927+0000","last_fullsized":"2024-06-02T22:34:24.286927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:02.046940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677844+0000","last_change":"2024-06-02T22:31:34.187743+0000","last_active":"2024-06-02T22:32:56.677844+0000","last_peered":"2024-06-02T22:32:56.677844+0000","last_clean":"2024-06-02T22:32:56.677844+0000","last_became_active":"2024-06-02T22:31:34.187241+0000","last_became_peered":"2024-06-02T22:31:34.187241+0000","last_unstale":"2024-06-02T22:32:56.677844+0000","last_undegraded":"2024-06-02T22:32:56.677844+0000","last_fullsized":"2024-06-02T22:32:56.677844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:00.980570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497088+0000","last_change":"2024-06-02T22:31:15.639499+0000","last_active":"2024-06-02T22:32:56.497088+0000","last_peered":"2024-06-02T22:32:56.497088+0000","last_clean":"2024-06-02T22:32:56.497088+0000","last_became_active":"2024-06-02T22:31:15.639078+0000","last_became_peered":"2024-06-02T22:31:15.639078+0000","last_unstale":"2024-06-02T22:32:56.497088+0000","last_undegraded":"2024-06-02T22:32:56.497088+0000","last_fullsized":"2024-06-02T22:32:56.497088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:29.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270728+0000","last_change":"2024-06-02T22:31:20.768079+0000","last_active":"2024-06-02T22:34:24.270728+0000","last_peered":"2024-06-02T22:34:24.270728+0000","last_clean":"2024-06-02T22:34:24.270728+0000","last_became_active":"2024-06-02T22:31:20.767762+0000","last_became_peered":"2024-06-02T22:31:20.767762+0000","last_unstale":"2024-06-02T22:34:24.270728+0000","last_undegraded":"2024-06-02T22:34:24.270728+0000","last_fullsized":"2024-06-02T22:34:24.270728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:50:05.247900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637608+0000","last_change":"2024-06-02T22:31:33.852366+0000","last_active":"2024-06-02T22:32:56.637608+0000","last_peered":"2024-06-02T22:32:56.637608+0000","last_clean":"2024-06-02T22:32:56.637608+0000","last_became_active":"2024-06-02T22:31:33.851836+0000","last_became_peered":"2024-06-02T22:31:33.851836+0000","last_unstale":"2024-06-02T22:32:56.637608+0000","last_undegraded":"2024-06-02T22:32:56.637608+0000","last_fullsized":"2024-06-02T22:32:56.637608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:53.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"99'7","reported_seq":181,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:53.666614+0000","last_change":"2024-06-02T22:31:16.009788+0000","last_active":"2024-06-02T22:34:53.666614+0000","last_peered":"2024-06-02T22:34:53.666614+0000","last_clean":"2024-06-02T22:34:53.666614+0000","last_became_active":"2024-06-02T22:31:16.009413+0000","last_became_peered":"2024-06-02T22:31:16.009413+0000","last_unstale":"2024-06-02T22:34:53.666614+0000","last_undegraded":"2024-06-02T22:34:53.666614+0000","last_fullsized":"2024-06-02T22:34:53.666614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:43:38.985017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.245113+0000","last_change":"2024-06-02T22:31:20.751507+0000","last_active":"2024-06-02T22:34:24.245113+0000","last_peered":"2024-06-02T22:34:24.245113+0000","last_clean":"2024-06-02T22:34:24.245113+0000","last_became_active":"2024-06-02T22:31:20.751179+0000","last_became_peered":"2024-06-02T22:31:20.751179+0000","last_unstale":"2024-06-02T22:34:24.245113+0000","last_undegraded":"2024-06-02T22:34:24.245113+0000","last_fullsized":"2024-06-02T22:34:24.245113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:16.744759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678813+0000","last_change":"2024-06-02T22:31:33.862697+0000","last_active":"2024-06-02T22:32:56.678813+0000","last_peered":"2024-06-02T22:32:56.678813+0000","last_clean":"2024-06-02T22:32:56.678813+0000","last_became_active":"2024-06-02T22:31:33.862148+0000","last_became_peered":"2024-06-02T22:31:33.862148+0000","last_unstale":"2024-06-02T22:32:56.678813+0000","last_undegraded":"2024-06-02T22:32:56.678813+0000","last_fullsized":"2024-06-02T22:32:56.678813+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:15.435992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635478+0000","last_change":"2024-06-02T22:31:15.644121+0000","last_active":"2024-06-02T22:32:56.635478+0000","last_peered":"2024-06-02T22:32:56.635478+0000","last_clean":"2024-06-02T22:32:56.635478+0000","last_became_active":"2024-06-02T22:31:15.643727+0000","last_became_peered":"2024-06-02T22:31:15.643727+0000","last_unstale":"2024-06-02T22:32:56.635478+0000","last_undegraded":"2024-06-02T22:32:56.635478+0000","last_fullsized":"2024-06-02T22:32:56.635478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:17:07.135824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.248444+0000","last_change":"2024-06-02T22:31:20.748366+0000","last_active":"2024-06-02T22:34:24.248444+0000","last_peered":"2024-06-02T22:34:24.248444+0000","last_clean":"2024-06-02T22:34:24.248444+0000","last_became_active":"2024-06-02T22:31:20.748036+0000","last_became_peered":"2024-06-02T22:31:20.748036+0000","last_unstale":"2024-06-02T22:34:24.248444+0000","last_undegraded":"2024-06-02T22:34:24.248444+0000","last_fullsized":"2024-06-02T22:34:24.248444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:48.188964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634752+0000","last_change":"2024-06-02T22:31:33.847227+0000","last_active":"2024-06-02T22:32:56.634752+0000","last_peered":"2024-06-02T22:32:56.634752+0000","last_clean":"2024-06-02T22:32:56.634752+0000","last_became_active":"2024-06-02T22:31:33.846701+0000","last_became_peered":"2024-06-02T22:31:33.846701+0000","last_unstale":"2024-06-02T22:32:56.634752+0000","last_undegraded":"2024-06-02T22:32:56.634752+0000","last_fullsized":"2024-06-02T22:32:56.634752+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:19.436409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684284+0000","last_change":"2024-06-02T22:31:15.648048+0000","last_active":"2024-06-02T22:32:56.684284+0000","last_peered":"2024-06-02T22:32:56.684284+0000","last_clean":"2024-06-02T22:32:56.684284+0000","last_became_active":"2024-06-02T22:31:15.647400+0000","last_became_peered":"2024-06-02T22:31:15.647400+0000","last_unstale":"2024-06-02T22:32:56.684284+0000","last_undegraded":"2024-06-02T22:32:56.684284+0000","last_fullsized":"2024-06-02T22:32:56.684284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:29:23.458912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244856+0000","last_change":"2024-06-02T22:31:20.751545+0000","last_active":"2024-06-02T22:34:24.244856+0000","last_peered":"2024-06-02T22:34:24.244856+0000","last_clean":"2024-06-02T22:34:24.244856+0000","last_became_active":"2024-06-02T22:31:20.751202+0000","last_became_peered":"2024-06-02T22:31:20.751202+0000","last_unstale":"2024-06-02T22:34:24.244856+0000","last_undegraded":"2024-06-02T22:34:24.244856+0000","last_fullsized":"2024-06-02T22:34:24.244856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:06:23.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.243534+0000","last_change":"2024-06-02T22:31:20.752666+0000","last_active":"2024-06-02T22:34:24.243534+0000","last_peered":"2024-06-02T22:34:24.243534+0000","last_clean":"2024-06-02T22:34:24.243534+0000","last_became_active":"2024-06-02T22:31:20.750433+0000","last_became_peered":"2024-06-02T22:31:20.750433+0000","last_unstale":"2024-06-02T22:34:24.243534+0000","last_undegraded":"2024-06-02T22:34:24.243534+0000","last_fullsized":"2024-06-02T22:34:24.243534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:12.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.243802+0000","last_change":"2024-06-02T22:31:20.747426+0000","last_active":"2024-06-02T22:34:24.243802+0000","last_peered":"2024-06-02T22:34:24.243802+0000","last_clean":"2024-06-02T22:34:24.243802+0000","last_became_active":"2024-06-02T22:31:20.746734+0000","last_became_peered":"2024-06-02T22:31:20.746734+0000","last_unstale":"2024-06-02T22:34:24.243802+0000","last_undegraded":"2024-06-02T22:34:24.243802+0000","last_fullsized":"2024-06-02T22:34:24.243802+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:30.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.278184+0000","last_change":"2024-06-02T22:31:20.771277+0000","last_active":"2024-06-02T22:34:24.278184+0000","last_peered":"2024-06-02T22:34:24.278184+0000","last_clean":"2024-06-02T22:34:24.278184+0000","last_became_active":"2024-06-02T22:31:20.770635+0000","last_became_peered":"2024-06-02T22:31:20.770635+0000","last_unstale":"2024-06-02T22:34:24.278184+0000","last_undegraded":"2024-06-02T22:34:24.278184+0000","last_fullsized":"2024-06-02T22:34:24.278184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:03.051044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283965+0000","last_change":"2024-06-02T22:31:20.774709+0000","last_active":"2024-06-02T22:34:24.283965+0000","last_peered":"2024-06-02T22:34:24.283965+0000","last_clean":"2024-06-02T22:34:24.283965+0000","last_became_active":"2024-06-02T22:31:20.774260+0000","last_became_peered":"2024-06-02T22:31:20.774260+0000","last_unstale":"2024-06-02T22:34:24.283965+0000","last_undegraded":"2024-06-02T22:34:24.283965+0000","last_fullsized":"2024-06-02T22:34:24.283965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:25.045695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.280365+0000","last_change":"2024-06-02T22:31:20.774013+0000","last_active":"2024-06-02T22:34:24.280365+0000","last_peered":"2024-06-02T22:34:24.280365+0000","last_clean":"2024-06-02T22:34:24.280365+0000","last_became_active":"2024-06-02T22:31:20.773479+0000","last_became_peered":"2024-06-02T22:31:20.773479+0000","last_unstale":"2024-06-02T22:34:24.280365+0000","last_undegraded":"2024-06-02T22:34:24.280365+0000","last_fullsized":"2024-06-02T22:34:24.280365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:19.583665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.240373+0000","last_change":"2024-06-02T22:31:20.752637+0000","last_active":"2024-06-02T22:34:24.240373+0000","last_peered":"2024-06-02T22:34:24.240373+0000","last_clean":"2024-06-02T22:34:24.240373+0000","last_became_active":"2024-06-02T22:31:20.752279+0000","last_became_peered":"2024-06-02T22:31:20.752279+0000","last_unstale":"2024-06-02T22:34:24.240373+0000","last_undegraded":"2024-06-02T22:34:24.240373+0000","last_fullsized":"2024-06-02T22:34:24.240373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:09:11.124952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244226+0000","last_change":"2024-06-02T22:31:20.752138+0000","last_active":"2024-06-02T22:34:24.244226+0000","last_peered":"2024-06-02T22:34:24.244226+0000","last_clean":"2024-06-02T22:34:24.244226+0000","last_became_active":"2024-06-02T22:31:20.751744+0000","last_became_peered":"2024-06-02T22:31:20.751744+0000","last_unstale":"2024-06-02T22:34:24.244226+0000","last_undegraded":"2024-06-02T22:34:24.244226+0000","last_fullsized":"2024-06-02T22:34:24.244226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:51.702632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275589+0000","last_change":"2024-06-02T22:31:20.769725+0000","last_active":"2024-06-02T22:34:24.275589+0000","last_peered":"2024-06-02T22:34:24.275589+0000","last_clean":"2024-06-02T22:34:24.275589+0000","last_became_active":"2024-06-02T22:31:20.767668+0000","last_became_peered":"2024-06-02T22:31:20.767668+0000","last_unstale":"2024-06-02T22:34:24.275589+0000","last_undegraded":"2024-06-02T22:34:24.275589+0000","last_fullsized":"2024-06-02T22:34:24.275589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:56:57.860195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274811+0000","last_change":"2024-06-02T22:31:20.771863+0000","last_active":"2024-06-02T22:34:24.274811+0000","last_peered":"2024-06-02T22:34:24.274811+0000","last_clean":"2024-06-02T22:34:24.274811+0000","last_became_active":"2024-06-02T22:31:20.771533+0000","last_became_peered":"2024-06-02T22:31:20.771533+0000","last_unstale":"2024-06-02T22:34:24.274811+0000","last_undegraded":"2024-06-02T22:34:24.274811+0000","last_fullsized":"2024-06-02T22:34:24.274811+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:34.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275896+0000","last_change":"2024-06-02T22:31:20.761906+0000","last_active":"2024-06-02T22:34:24.275896+0000","last_peered":"2024-06-02T22:34:24.275896+0000","last_clean":"2024-06-02T22:34:24.275896+0000","last_became_active":"2024-06-02T22:31:20.761571+0000","last_became_peered":"2024-06-02T22:31:20.761571+0000","last_unstale":"2024-06-02T22:34:24.275896+0000","last_undegraded":"2024-06-02T22:34:24.275896+0000","last_fullsized":"2024-06-02T22:34:24.275896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:37.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275349+0000","last_change":"2024-06-02T22:31:20.764292+0000","last_active":"2024-06-02T22:34:24.275349+0000","last_peered":"2024-06-02T22:34:24.275349+0000","last_clean":"2024-06-02T22:34:24.275349+0000","last_became_active":"2024-06-02T22:31:20.763997+0000","last_became_peered":"2024-06-02T22:31:20.763997+0000","last_unstale":"2024-06-02T22:34:24.275349+0000","last_undegraded":"2024-06-02T22:34:24.275349+0000","last_fullsized":"2024-06-02T22:34:24.275349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:44.151687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.277937+0000","last_change":"2024-06-02T22:31:20.773602+0000","last_active":"2024-06-02T22:34:24.277937+0000","last_peered":"2024-06-02T22:34:24.277937+0000","last_clean":"2024-06-02T22:34:24.277937+0000","last_became_active":"2024-06-02T22:31:20.773186+0000","last_became_peered":"2024-06-02T22:31:20.773186+0000","last_unstale":"2024-06-02T22:34:24.277937+0000","last_undegraded":"2024-06-02T22:34:24.277937+0000","last_fullsized":"2024-06-02T22:34:24.277937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:45.238636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242944+0000","last_change":"2024-06-02T22:31:20.750509+0000","last_active":"2024-06-02T22:34:24.242944+0000","last_peered":"2024-06-02T22:34:24.242944+0000","last_clean":"2024-06-02T22:34:24.242944+0000","last_became_active":"2024-06-02T22:31:20.750121+0000","last_became_peered":"2024-06-02T22:31:20.750121+0000","last_unstale":"2024-06-02T22:34:24.242944+0000","last_undegraded":"2024-06-02T22:34:24.242944+0000","last_fullsized":"2024-06-02T22:34:24.242944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:05:24.916621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282802,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74782,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1294,"num_read_kb":730,"num_write":265,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":224346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383741,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":571086,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645379,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36564,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708588,"statfs":{"total":95995035648,"available":95957594112,"internally_reserved":0,"allocated":1257472,"data_stored":1223958,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":574401,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070543,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":570571,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332179,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1167851,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495706,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":566340,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36484,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708668,"statfs":{"total":95995035648,"available":95957676032,"internally_reserved":0,"allocated":1175552,"data_stored":634137,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":567796,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":568053,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182506,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1114112,"data_stored":565517,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32336,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712816,"statfs":{"total":95995035648,"available":95961923584,"internally_reserved":0,"allocated":1187840,"data_stored":636650,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757344,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":1162902,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:34:57.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T22:34:57.644 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:57 smithi031 ceph-mon[31767]: pgmap v450: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:57.644 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:57 smithi031 ceph-mon[31767]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:34:57.898 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:34:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:57 smithi098 ceph-mon[36750]: pgmap v450: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:57 smithi098 ceph-mon[36750]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:34:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:57 smithi178 ceph-mon[36614]: pgmap v450: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:34:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:57 smithi178 ceph-mon[36614]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:34:59.908 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:34:59 smithi031 ceph-mon[31767]: pgmap v451: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:34:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:34:59 smithi098 ceph-mon[36750]: pgmap v451: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:34:59 smithi178 ceph-mon[36614]: pgmap v451: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:00.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 -- 172.21.15.31:0/1369913523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe498104ed0 msgr2=0x7fe498105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 --2- 172.21.15.31:0/1369913523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe498104ed0 0x7fe498105360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe490009f90 tx=0x7fe49000b330 comp rx=0 tx=0).stop 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 -- 172.21.15.31:0/1369913523 shutdown_connections 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 --2- 172.21.15.31:0/1369913523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe498104ed0 0x7fe498105360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 --2- 172.21.15.31:0/1369913523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4981073c0 0x7fe49806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 --2- 172.21.15.31:0/1369913523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe49806a6e0 0x7fe49806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 -- 172.21.15.31:0/1369913523 >> 172.21.15.31:0/1369913523 conn(0x7fe498078340 msgr2=0x7fe498078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 -- 172.21.15.31:0/1369913523 shutdown_connections 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.216+0000 7fe49e600700 1 -- 172.21.15.31:0/1369913523 wait complete. 2024-06-02T22:35:00.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.217+0000 7fe49e600700 1 Processor -- start 2024-06-02T22:35:00.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.217+0000 7fe49e600700 1 -- start start 2024-06-02T22:35:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 0x7fe49819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 0x7fe49819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:00.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe498118dd0 con 0x7fe4981073c0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe498118c50 con 0x7fe49806a6e0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe49e600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe498118f50 con 0x7fe498104ed0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe497400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 0x7fe49819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe497e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe497400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 0x7fe49819f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55844/0 (socket says 172.21.15.31:55844) 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe497e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33406/0 (socket says 172.21.15.31:33406) 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe497400700 1 -- 172.21.15.31:0/2464713048 learned_addr learned my addr 172.21.15.31:0/2464713048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe48ea00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 0x7fe49819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe48ea00700 1 -- 172.21.15.31:0/2464713048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 msgr2=0x7fe49819f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe48ea00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 0x7fe49819f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.218+0000 7fe48ea00700 1 -- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 msgr2=0x7fe4981a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe48ea00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe48ea00700 1 -- 172.21.15.31:0/2464713048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4981a4220 con 0x7fe498104ed0 2024-06-02T22:35:00.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe497e00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe48ea00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 0x7fe49819f7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe48000eb90 tx=0x7fe48000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48000cc90 con 0x7fe498104ed0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4981a4510 con 0x7fe498104ed0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48000ce30 con 0x7fe498104ed0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.219+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480010430 con 0x7fe498104ed0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.220+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4981abd90 con 0x7fe498104ed0 2024-06-02T22:35:00.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.221+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe498069180 con 0x7fe498104ed0 2024-06-02T22:35:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.223+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe480043ae0 con 0x7fe498104ed0 2024-06-02T22:35:00.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.224+0000 7fe494c00700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 0x7fe4780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:00.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.224+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe4800cf710 con 0x7fe498104ed0 2024-06-02T22:35:00.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.224+0000 7fe497400700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 0x7fe4780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:00.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.225+0000 7fe497400700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 0x7fe4780a5160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe488009ce0 tx=0x7fe488009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:00.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.227+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe48009c280 con 0x7fe498104ed0 2024-06-02T22:35:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.449+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4981045c0 con 0x7fe4780a2ca0 2024-06-02T22:35:00.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.478+0000 7fe494c00700 1 -- 172.21.15.31:0/2464713048 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340819 (secure 0 0 0) 0x7fe4981045c0 con 0x7fe4780a2ca0 2024-06-02T22:35:00.480 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 msgr2=0x7fe4780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 0x7fe4780a5160 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe488009ce0 tx=0x7fe488009260 comp rx=0 tx=0).stop 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 msgr2=0x7fe49819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 0x7fe49819f7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe48000eb90 tx=0x7fe48000eea0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 shutdown_connections 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe4780a2ca0 0x7fe4780a5160 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4981073c0 0x7fe4981a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe49806a6e0 0x7fe49819f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 --2- 172.21.15.31:0/2464713048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe498104ed0 0x7fe49819f7a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:00.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 >> 172.21.15.31:0/2464713048 conn(0x7fe498078340 msgr2=0x7fe498103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:00.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 shutdown_connections 2024-06-02T22:35:00.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:00.486+0000 7fe49e600700 1 -- 172.21.15.31:0/2464713048 wait complete. 2024-06-02T22:35:00.488 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-06-02T22:35:01.486 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-06-02T22:35:00.336518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665384,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1445,"num_read_kb":849,"num_write":448,"num_write_kb":3099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1182382,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383424,"kb_used_data":13472,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558400,"statfs":{"total":1151940427776,"available":1151547801600,"internally_reserved":0,"allocated":13795328,"data_stored":8809262,"data_compressed":496710,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006670"},"pg_stats":[{"pgid":"3.3f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.281355+0000","last_change":"2024-06-02T22:31:20.770673+0000","last_active":"2024-06-02T22:34:24.281355+0000","last_peered":"2024-06-02T22:34:24.281355+0000","last_clean":"2024-06-02T22:34:24.281355+0000","last_became_active":"2024-06-02T22:31:20.770000+0000","last_became_peered":"2024-06-02T22:31:20.770000+0000","last_unstale":"2024-06-02T22:34:24.281355+0000","last_undegraded":"2024-06-02T22:34:24.281355+0000","last_fullsized":"2024-06-02T22:34:24.281355+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:16:52.632084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272688+0000","last_change":"2024-06-02T22:31:20.766311+0000","last_active":"2024-06-02T22:34:24.272688+0000","last_peered":"2024-06-02T22:34:24.272688+0000","last_clean":"2024-06-02T22:34:24.272688+0000","last_became_active":"2024-06-02T22:31:20.765960+0000","last_became_peered":"2024-06-02T22:31:20.765960+0000","last_unstale":"2024-06-02T22:34:24.272688+0000","last_undegraded":"2024-06-02T22:34:24.272688+0000","last_fullsized":"2024-06-02T22:34:24.272688+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:30.500082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286775+0000","last_change":"2024-06-02T22:31:20.766005+0000","last_active":"2024-06-02T22:34:24.286775+0000","last_peered":"2024-06-02T22:34:24.286775+0000","last_clean":"2024-06-02T22:34:24.286775+0000","last_became_active":"2024-06-02T22:31:20.762135+0000","last_became_peered":"2024-06-02T22:31:20.762135+0000","last_unstale":"2024-06-02T22:34:24.286775+0000","last_undegraded":"2024-06-02T22:34:24.286775+0000","last_fullsized":"2024-06-02T22:34:24.286775+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:44:10.201470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242463+0000","last_change":"2024-06-02T22:31:20.754293+0000","last_active":"2024-06-02T22:34:24.242463+0000","last_peered":"2024-06-02T22:34:24.242463+0000","last_clean":"2024-06-02T22:34:24.242463+0000","last_became_active":"2024-06-02T22:31:20.753996+0000","last_became_peered":"2024-06-02T22:31:20.753996+0000","last_unstale":"2024-06-02T22:34:24.242463+0000","last_undegraded":"2024-06-02T22:34:24.242463+0000","last_fullsized":"2024-06-02T22:34:24.242463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:25.050471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268677+0000","last_change":"2024-06-02T22:31:20.776227+0000","last_active":"2024-06-02T22:34:24.268677+0000","last_peered":"2024-06-02T22:34:24.268677+0000","last_clean":"2024-06-02T22:34:24.268677+0000","last_became_active":"2024-06-02T22:31:20.775922+0000","last_became_peered":"2024-06-02T22:31:20.775922+0000","last_unstale":"2024-06-02T22:34:24.268677+0000","last_undegraded":"2024-06-02T22:34:24.268677+0000","last_fullsized":"2024-06-02T22:34:24.268677+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:54:49.228748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"99'6","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270517+0000","last_change":"2024-06-02T22:32:56.684643+0000","last_active":"2024-06-02T22:34:24.270517+0000","last_peered":"2024-06-02T22:34:24.270517+0000","last_clean":"2024-06-02T22:34:24.270517+0000","last_became_active":"2024-06-02T22:32:56.684253+0000","last_became_peered":"2024-06-02T22:32:56.684253+0000","last_unstale":"2024-06-02T22:34:24.270517+0000","last_undegraded":"2024-06-02T22:34:24.270517+0000","last_fullsized":"2024-06-02T22:34:24.270517+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:40:57.474007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.237478+0000","last_change":"2024-06-02T22:31:20.748702+0000","last_active":"2024-06-02T22:34:24.237478+0000","last_peered":"2024-06-02T22:34:24.237478+0000","last_clean":"2024-06-02T22:34:24.237478+0000","last_became_active":"2024-06-02T22:31:20.748361+0000","last_became_peered":"2024-06-02T22:31:20.748361+0000","last_unstale":"2024-06-02T22:34:24.237478+0000","last_undegraded":"2024-06-02T22:34:24.237478+0000","last_fullsized":"2024-06-02T22:34:24.237478+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:00.065043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.271709+0000","last_change":"2024-06-02T22:31:20.761647+0000","last_active":"2024-06-02T22:34:24.271709+0000","last_peered":"2024-06-02T22:34:24.271709+0000","last_clean":"2024-06-02T22:34:24.271709+0000","last_became_active":"2024-06-02T22:31:20.758453+0000","last_became_peered":"2024-06-02T22:31:20.758453+0000","last_unstale":"2024-06-02T22:34:24.271709+0000","last_undegraded":"2024-06-02T22:34:24.271709+0000","last_fullsized":"2024-06-02T22:34:24.271709+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:32.586129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.246676+0000","last_change":"2024-06-02T22:31:20.753972+0000","last_active":"2024-06-02T22:34:24.246676+0000","last_peered":"2024-06-02T22:34:24.246676+0000","last_clean":"2024-06-02T22:34:24.246676+0000","last_became_active":"2024-06-02T22:31:20.753667+0000","last_became_peered":"2024-06-02T22:31:20.753667+0000","last_unstale":"2024-06-02T22:34:24.246676+0000","last_undegraded":"2024-06-02T22:34:24.246676+0000","last_fullsized":"2024-06-02T22:34:24.246676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:32:59.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"99'16","reported_seq":61,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.254086+0000","last_change":"2024-06-02T22:31:56.475364+0000","last_active":"2024-06-02T22:34:24.254086+0000","last_peered":"2024-06-02T22:34:24.254086+0000","last_clean":"2024-06-02T22:34:24.254086+0000","last_became_active":"2024-06-02T22:31:56.475086+0000","last_became_peered":"2024-06-02T22:31:56.475086+0000","last_unstale":"2024-06-02T22:34:24.254086+0000","last_undegraded":"2024-06-02T22:34:24.254086+0000","last_fullsized":"2024-06-02T22:34:24.254086+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:01:37.348839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.245175+0000","last_change":"2024-06-02T22:31:20.748745+0000","last_active":"2024-06-02T22:34:24.245175+0000","last_peered":"2024-06-02T22:34:24.245175+0000","last_clean":"2024-06-02T22:34:24.245175+0000","last_became_active":"2024-06-02T22:31:20.747808+0000","last_became_peered":"2024-06-02T22:31:20.747808+0000","last_unstale":"2024-06-02T22:34:24.245175+0000","last_undegraded":"2024-06-02T22:34:24.245175+0000","last_fullsized":"2024-06-02T22:34:24.245175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:29.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242750+0000","last_change":"2024-06-02T22:31:20.754184+0000","last_active":"2024-06-02T22:34:24.242750+0000","last_peered":"2024-06-02T22:34:24.242750+0000","last_clean":"2024-06-02T22:34:24.242750+0000","last_became_active":"2024-06-02T22:31:20.753691+0000","last_became_peered":"2024-06-02T22:31:20.753691+0000","last_unstale":"2024-06-02T22:34:24.242750+0000","last_undegraded":"2024-06-02T22:34:24.242750+0000","last_fullsized":"2024-06-02T22:34:24.242750+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:43.971094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"99'10","reported_seq":55,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.273809+0000","last_change":"2024-06-02T22:31:56.478669+0000","last_active":"2024-06-02T22:34:24.273809+0000","last_peered":"2024-06-02T22:34:24.273809+0000","last_clean":"2024-06-02T22:34:24.273809+0000","last_became_active":"2024-06-02T22:31:56.476440+0000","last_became_peered":"2024-06-02T22:31:56.476440+0000","last_unstale":"2024-06-02T22:34:24.273809+0000","last_undegraded":"2024-06-02T22:34:24.273809+0000","last_fullsized":"2024-06-02T22:34:24.273809+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:17:08.753386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283630+0000","last_change":"2024-06-02T22:31:20.756993+0000","last_active":"2024-06-02T22:34:24.283630+0000","last_peered":"2024-06-02T22:34:24.283630+0000","last_clean":"2024-06-02T22:34:24.283630+0000","last_became_active":"2024-06-02T22:31:20.756518+0000","last_became_peered":"2024-06-02T22:31:20.756518+0000","last_unstale":"2024-06-02T22:34:24.283630+0000","last_undegraded":"2024-06-02T22:34:24.283630+0000","last_fullsized":"2024-06-02T22:34:24.283630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:28.743386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.287050+0000","last_change":"2024-06-02T22:31:20.760152+0000","last_active":"2024-06-02T22:34:24.287050+0000","last_peered":"2024-06-02T22:34:24.287050+0000","last_clean":"2024-06-02T22:34:24.287050+0000","last_became_active":"2024-06-02T22:31:20.759291+0000","last_became_peered":"2024-06-02T22:31:20.759291+0000","last_unstale":"2024-06-02T22:34:24.287050+0000","last_undegraded":"2024-06-02T22:34:24.287050+0000","last_fullsized":"2024-06-02T22:34:24.287050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:30.465537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286297+0000","last_change":"2024-06-02T22:31:20.766881+0000","last_active":"2024-06-02T22:34:24.286297+0000","last_peered":"2024-06-02T22:34:24.286297+0000","last_clean":"2024-06-02T22:34:24.286297+0000","last_became_active":"2024-06-02T22:31:20.766552+0000","last_became_peered":"2024-06-02T22:31:20.766552+0000","last_unstale":"2024-06-02T22:34:24.286297+0000","last_undegraded":"2024-06-02T22:34:24.286297+0000","last_fullsized":"2024-06-02T22:34:24.286297+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:48:58.133220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.281465+0000","last_change":"2024-06-02T22:31:20.770370+0000","last_active":"2024-06-02T22:34:24.281465+0000","last_peered":"2024-06-02T22:34:24.281465+0000","last_clean":"2024-06-02T22:34:24.281465+0000","last_became_active":"2024-06-02T22:31:20.769938+0000","last_became_peered":"2024-06-02T22:31:20.769938+0000","last_unstale":"2024-06-02T22:34:24.281465+0000","last_undegraded":"2024-06-02T22:34:24.281465+0000","last_fullsized":"2024-06-02T22:34:24.281465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:46:59.835221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.251926+0000","last_change":"2024-06-02T22:31:20.762933+0000","last_active":"2024-06-02T22:34:24.251926+0000","last_peered":"2024-06-02T22:34:24.251926+0000","last_clean":"2024-06-02T22:34:24.251926+0000","last_became_active":"2024-06-02T22:31:20.761598+0000","last_became_peered":"2024-06-02T22:31:20.761598+0000","last_unstale":"2024-06-02T22:34:24.251926+0000","last_undegraded":"2024-06-02T22:34:24.251926+0000","last_fullsized":"2024-06-02T22:34:24.251926+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:25:45.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274579+0000","last_change":"2024-06-02T22:31:20.758974+0000","last_active":"2024-06-02T22:34:24.274579+0000","last_peered":"2024-06-02T22:34:24.274579+0000","last_clean":"2024-06-02T22:34:24.274579+0000","last_became_active":"2024-06-02T22:31:20.758583+0000","last_became_peered":"2024-06-02T22:31:20.758583+0000","last_unstale":"2024-06-02T22:34:24.274579+0000","last_undegraded":"2024-06-02T22:34:24.274579+0000","last_fullsized":"2024-06-02T22:34:24.274579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:27:00.333362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677108+0000","last_change":"2024-06-02T22:31:33.865290+0000","last_active":"2024-06-02T22:32:56.677108+0000","last_peered":"2024-06-02T22:32:56.677108+0000","last_clean":"2024-06-02T22:32:56.677108+0000","last_became_active":"2024-06-02T22:31:33.864721+0000","last_became_peered":"2024-06-02T22:31:33.864721+0000","last_unstale":"2024-06-02T22:32:56.677108+0000","last_undegraded":"2024-06-02T22:32:56.677108+0000","last_fullsized":"2024-06-02T22:32:56.677108+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:45.344953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"99'14","reported_seq":188,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:56.806402+0000","last_change":"2024-06-02T22:31:15.645169+0000","last_active":"2024-06-02T22:34:56.806402+0000","last_peered":"2024-06-02T22:34:56.806402+0000","last_clean":"2024-06-02T22:34:56.806402+0000","last_became_active":"2024-06-02T22:31:15.643956+0000","last_became_peered":"2024-06-02T22:31:15.643956+0000","last_unstale":"2024-06-02T22:34:56.806402+0000","last_undegraded":"2024-06-02T22:34:56.806402+0000","last_fullsized":"2024-06-02T22:34:56.806402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:01.560086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274886+0000","last_change":"2024-06-02T22:31:20.759157+0000","last_active":"2024-06-02T22:34:24.274886+0000","last_peered":"2024-06-02T22:34:24.274886+0000","last_clean":"2024-06-02T22:34:24.274886+0000","last_became_active":"2024-06-02T22:31:20.758718+0000","last_became_peered":"2024-06-02T22:31:20.758718+0000","last_unstale":"2024-06-02T22:34:24.274886+0000","last_undegraded":"2024-06-02T22:34:24.274886+0000","last_fullsized":"2024-06-02T22:34:24.274886+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:57.685311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677406+0000","last_change":"2024-06-02T22:31:55.989604+0000","last_active":"2024-06-02T22:32:56.677406+0000","last_peered":"2024-06-02T22:32:56.677406+0000","last_clean":"2024-06-02T22:32:56.677406+0000","last_became_active":"2024-06-02T22:31:55.989177+0000","last_became_peered":"2024-06-02T22:31:55.989177+0000","last_unstale":"2024-06-02T22:32:56.677406+0000","last_undegraded":"2024-06-02T22:32:56.677406+0000","last_fullsized":"2024-06-02T22:32:56.677406+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:48:58.489224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681341+0000","last_change":"2024-06-02T22:31:15.845856+0000","last_active":"2024-06-02T22:32:56.681341+0000","last_peered":"2024-06-02T22:32:56.681341+0000","last_clean":"2024-06-02T22:32:56.681341+0000","last_became_active":"2024-06-02T22:31:15.845025+0000","last_became_peered":"2024-06-02T22:31:15.845025+0000","last_unstale":"2024-06-02T22:32:56.681341+0000","last_undegraded":"2024-06-02T22:32:56.681341+0000","last_fullsized":"2024-06-02T22:32:56.681341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:21:37.491987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.287856+0000","last_change":"2024-06-02T22:31:20.767420+0000","last_active":"2024-06-02T22:34:24.287856+0000","last_peered":"2024-06-02T22:34:24.287856+0000","last_clean":"2024-06-02T22:34:24.287856+0000","last_became_active":"2024-06-02T22:31:20.766768+0000","last_became_peered":"2024-06-02T22:31:20.766768+0000","last_unstale":"2024-06-02T22:34:24.287856+0000","last_undegraded":"2024-06-02T22:34:24.287856+0000","last_fullsized":"2024-06-02T22:34:24.287856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:20.829696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677467+0000","last_change":"2024-06-02T22:31:33.865917+0000","last_active":"2024-06-02T22:32:56.677467+0000","last_peered":"2024-06-02T22:32:56.677467+0000","last_clean":"2024-06-02T22:32:56.677467+0000","last_became_active":"2024-06-02T22:31:33.865466+0000","last_became_peered":"2024-06-02T22:31:33.865466+0000","last_unstale":"2024-06-02T22:32:56.677467+0000","last_undegraded":"2024-06-02T22:32:56.677467+0000","last_fullsized":"2024-06-02T22:32:56.677467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:37.302647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"97'12","reported_seq":58,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497246+0000","last_change":"2024-06-02T22:31:15.639522+0000","last_active":"2024-06-02T22:32:56.497246+0000","last_peered":"2024-06-02T22:32:56.497246+0000","last_clean":"2024-06-02T22:32:56.497246+0000","last_became_active":"2024-06-02T22:31:15.639029+0000","last_became_peered":"2024-06-02T22:31:15.639029+0000","last_unstale":"2024-06-02T22:32:56.497246+0000","last_undegraded":"2024-06-02T22:32:56.497246+0000","last_fullsized":"2024-06-02T22:32:56.497246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:29.388739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.269250+0000","last_change":"2024-06-02T22:31:20.772370+0000","last_active":"2024-06-02T22:34:24.269250+0000","last_peered":"2024-06-02T22:34:24.269250+0000","last_clean":"2024-06-02T22:34:24.269250+0000","last_became_active":"2024-06-02T22:31:20.772041+0000","last_became_peered":"2024-06-02T22:31:20.772041+0000","last_unstale":"2024-06-02T22:34:24.269250+0000","last_undegraded":"2024-06-02T22:34:24.269250+0000","last_fullsized":"2024-06-02T22:34:24.269250+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:27.518648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677454+0000","last_change":"2024-06-02T22:31:55.990609+0000","last_active":"2024-06-02T22:32:56.677454+0000","last_peered":"2024-06-02T22:32:56.677454+0000","last_clean":"2024-06-02T22:32:56.677454+0000","last_became_active":"2024-06-02T22:31:55.990075+0000","last_became_peered":"2024-06-02T22:31:55.990075+0000","last_unstale":"2024-06-02T22:32:56.677454+0000","last_undegraded":"2024-06-02T22:32:56.677454+0000","last_fullsized":"2024-06-02T22:32:56.677454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:55:52.836659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497261+0000","last_change":"2024-06-02T22:31:15.636472+0000","last_active":"2024-06-02T22:32:56.497261+0000","last_peered":"2024-06-02T22:32:56.497261+0000","last_clean":"2024-06-02T22:32:56.497261+0000","last_became_active":"2024-06-02T22:31:15.636078+0000","last_became_peered":"2024-06-02T22:31:15.636078+0000","last_unstale":"2024-06-02T22:32:56.497261+0000","last_undegraded":"2024-06-02T22:32:56.497261+0000","last_fullsized":"2024-06-02T22:32:56.497261+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:18:35.318873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"99'15","reported_seq":60,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.246688+0000","last_change":"2024-06-02T22:31:55.986887+0000","last_active":"2024-06-02T22:34:24.246688+0000","last_peered":"2024-06-02T22:34:24.246688+0000","last_clean":"2024-06-02T22:34:24.246688+0000","last_became_active":"2024-06-02T22:31:55.986468+0000","last_became_peered":"2024-06-02T22:31:55.986468+0000","last_unstale":"2024-06-02T22:34:24.246688+0000","last_undegraded":"2024-06-02T22:34:24.246688+0000","last_fullsized":"2024-06-02T22:34:24.246688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:58:27.696250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677538+0000","last_change":"2024-06-02T22:31:33.847193+0000","last_active":"2024-06-02T22:32:56.677538+0000","last_peered":"2024-06-02T22:32:56.677538+0000","last_clean":"2024-06-02T22:32:56.677538+0000","last_became_active":"2024-06-02T22:31:33.845955+0000","last_became_peered":"2024-06-02T22:31:33.845955+0000","last_unstale":"2024-06-02T22:32:56.677538+0000","last_undegraded":"2024-06-02T22:32:56.677538+0000","last_fullsized":"2024-06-02T22:32:56.677538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:43.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"99'7","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:58.674796+0000","last_change":"2024-06-02T22:31:15.640589+0000","last_active":"2024-06-02T22:34:58.674796+0000","last_peered":"2024-06-02T22:34:58.674796+0000","last_clean":"2024-06-02T22:34:58.674796+0000","last_became_active":"2024-06-02T22:31:15.640216+0000","last_became_peered":"2024-06-02T22:31:15.640216+0000","last_unstale":"2024-06-02T22:34:58.674796+0000","last_undegraded":"2024-06-02T22:34:58.674796+0000","last_fullsized":"2024-06-02T22:34:58.674796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:40:02.375914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244809+0000","last_change":"2024-06-02T22:31:20.753879+0000","last_active":"2024-06-02T22:34:24.244809+0000","last_peered":"2024-06-02T22:34:24.244809+0000","last_clean":"2024-06-02T22:34:24.244809+0000","last_became_active":"2024-06-02T22:31:20.753528+0000","last_became_peered":"2024-06-02T22:31:20.753528+0000","last_unstale":"2024-06-02T22:34:24.244809+0000","last_undegraded":"2024-06-02T22:34:24.244809+0000","last_fullsized":"2024-06-02T22:34:24.244809+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:19.299178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677437+0000","last_change":"2024-06-02T22:31:33.858175+0000","last_active":"2024-06-02T22:32:56.677437+0000","last_peered":"2024-06-02T22:32:56.677437+0000","last_clean":"2024-06-02T22:32:56.677437+0000","last_became_active":"2024-06-02T22:31:33.857712+0000","last_became_peered":"2024-06-02T22:31:33.857712+0000","last_unstale":"2024-06-02T22:32:56.677437+0000","last_undegraded":"2024-06-02T22:32:56.677437+0000","last_fullsized":"2024-06-02T22:32:56.677437+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:30:01.632018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"97'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.501055+0000","last_change":"2024-06-02T22:31:15.639810+0000","last_active":"2024-06-02T22:32:56.501055+0000","last_peered":"2024-06-02T22:32:56.501055+0000","last_clean":"2024-06-02T22:32:56.501055+0000","last_became_active":"2024-06-02T22:31:15.639487+0000","last_became_peered":"2024-06-02T22:31:15.639487+0000","last_unstale":"2024-06-02T22:32:56.501055+0000","last_undegraded":"2024-06-02T22:32:56.501055+0000","last_fullsized":"2024-06-02T22:32:56.501055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:26:48.168636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274921+0000","last_change":"2024-06-02T22:31:20.771988+0000","last_active":"2024-06-02T22:34:24.274921+0000","last_peered":"2024-06-02T22:34:24.274921+0000","last_clean":"2024-06-02T22:34:24.274921+0000","last_became_active":"2024-06-02T22:31:20.771506+0000","last_became_peered":"2024-06-02T22:31:20.771506+0000","last_unstale":"2024-06-02T22:34:24.274921+0000","last_undegraded":"2024-06-02T22:34:24.274921+0000","last_fullsized":"2024-06-02T22:34:24.274921+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:51:10.199149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678363+0000","last_change":"2024-06-02T22:31:33.861319+0000","last_active":"2024-06-02T22:32:56.678363+0000","last_peered":"2024-06-02T22:32:56.678363+0000","last_clean":"2024-06-02T22:32:56.678363+0000","last_became_active":"2024-06-02T22:31:33.860834+0000","last_became_peered":"2024-06-02T22:31:33.860834+0000","last_unstale":"2024-06-02T22:32:56.678363+0000","last_undegraded":"2024-06-02T22:32:56.678363+0000","last_fullsized":"2024-06-02T22:32:56.678363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:28:26.094118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681932+0000","last_change":"2024-06-02T22:31:15.645298+0000","last_active":"2024-06-02T22:32:56.681932+0000","last_peered":"2024-06-02T22:32:56.681932+0000","last_clean":"2024-06-02T22:32:56.681932+0000","last_became_active":"2024-06-02T22:31:15.643278+0000","last_became_peered":"2024-06-02T22:31:15.643278+0000","last_unstale":"2024-06-02T22:32:56.681932+0000","last_undegraded":"2024-06-02T22:32:56.681932+0000","last_fullsized":"2024-06-02T22:32:56.681932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:38:09.548519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270958+0000","last_change":"2024-06-02T22:31:20.769928+0000","last_active":"2024-06-02T22:34:24.270958+0000","last_peered":"2024-06-02T22:34:24.270958+0000","last_clean":"2024-06-02T22:34:24.270958+0000","last_became_active":"2024-06-02T22:31:20.769008+0000","last_became_peered":"2024-06-02T22:31:20.769008+0000","last_unstale":"2024-06-02T22:34:24.270958+0000","last_undegraded":"2024-06-02T22:34:24.270958+0000","last_fullsized":"2024-06-02T22:34:24.270958+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:02.808992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.679464+0000","last_change":"2024-06-02T22:31:33.869072+0000","last_active":"2024-06-02T22:32:56.679464+0000","last_peered":"2024-06-02T22:32:56.679464+0000","last_clean":"2024-06-02T22:32:56.679464+0000","last_became_active":"2024-06-02T22:31:33.868641+0000","last_became_peered":"2024-06-02T22:31:33.868641+0000","last_unstale":"2024-06-02T22:32:56.679464+0000","last_undegraded":"2024-06-02T22:32:56.679464+0000","last_fullsized":"2024-06-02T22:32:56.679464+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:52:29.227798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635017+0000","last_change":"2024-06-02T22:31:15.637656+0000","last_active":"2024-06-02T22:32:56.635017+0000","last_peered":"2024-06-02T22:32:56.635017+0000","last_clean":"2024-06-02T22:32:56.635017+0000","last_became_active":"2024-06-02T22:31:15.637317+0000","last_became_peered":"2024-06-02T22:31:15.637317+0000","last_unstale":"2024-06-02T22:32:56.635017+0000","last_undegraded":"2024-06-02T22:32:56.635017+0000","last_fullsized":"2024-06-02T22:32:56.635017+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:21.307766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.277458+0000","last_change":"2024-06-02T22:31:20.764811+0000","last_active":"2024-06-02T22:34:24.277458+0000","last_peered":"2024-06-02T22:34:24.277458+0000","last_clean":"2024-06-02T22:34:24.277458+0000","last_became_active":"2024-06-02T22:31:20.763605+0000","last_became_peered":"2024-06-02T22:31:20.763605+0000","last_unstale":"2024-06-02T22:34:24.277458+0000","last_undegraded":"2024-06-02T22:34:24.277458+0000","last_fullsized":"2024-06-02T22:34:24.277458+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:57:24.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680118+0000","last_change":"2024-06-02T22:31:33.861450+0000","last_active":"2024-06-02T22:32:56.680118+0000","last_peered":"2024-06-02T22:32:56.680118+0000","last_clean":"2024-06-02T22:32:56.680118+0000","last_became_active":"2024-06-02T22:31:33.860933+0000","last_became_peered":"2024-06-02T22:31:33.860933+0000","last_unstale":"2024-06-02T22:32:56.680118+0000","last_undegraded":"2024-06-02T22:32:56.680118+0000","last_fullsized":"2024-06-02T22:32:56.680118+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:26.480320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"99'6","reported_seq":303,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:55.668790+0000","last_change":"2024-06-02T22:31:15.644469+0000","last_active":"2024-06-02T22:34:55.668790+0000","last_peered":"2024-06-02T22:34:55.668790+0000","last_clean":"2024-06-02T22:34:55.668790+0000","last_became_active":"2024-06-02T22:31:15.644115+0000","last_became_peered":"2024-06-02T22:31:15.644115+0000","last_unstale":"2024-06-02T22:34:55.668790+0000","last_undegraded":"2024-06-02T22:34:55.668790+0000","last_fullsized":"2024-06-02T22:34:55.668790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:44:49.653596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":252,"num_read_kb":252,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.250899+0000","last_change":"2024-06-02T22:31:20.752581+0000","last_active":"2024-06-02T22:34:24.250899+0000","last_peered":"2024-06-02T22:34:24.250899+0000","last_clean":"2024-06-02T22:34:24.250899+0000","last_became_active":"2024-06-02T22:31:20.752102+0000","last_became_peered":"2024-06-02T22:31:20.752102+0000","last_unstale":"2024-06-02T22:34:24.250899+0000","last_undegraded":"2024-06-02T22:34:24.250899+0000","last_fullsized":"2024-06-02T22:34:24.250899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:57.217023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.504594+0000","last_change":"2024-06-02T22:31:33.860102+0000","last_active":"2024-06-02T22:32:56.504594+0000","last_peered":"2024-06-02T22:32:56.504594+0000","last_clean":"2024-06-02T22:32:56.504594+0000","last_became_active":"2024-06-02T22:31:33.859689+0000","last_became_peered":"2024-06-02T22:31:33.859689+0000","last_unstale":"2024-06-02T22:32:56.504594+0000","last_undegraded":"2024-06-02T22:32:56.504594+0000","last_fullsized":"2024-06-02T22:32:56.504594+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:04:36.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.511269+0000","last_change":"2024-06-02T22:31:15.636548+0000","last_active":"2024-06-02T22:32:56.511269+0000","last_peered":"2024-06-02T22:32:56.511269+0000","last_clean":"2024-06-02T22:32:56.511269+0000","last_became_active":"2024-06-02T22:31:15.636097+0000","last_became_peered":"2024-06-02T22:31:15.636097+0000","last_unstale":"2024-06-02T22:32:56.511269+0000","last_undegraded":"2024-06-02T22:32:56.511269+0000","last_fullsized":"2024-06-02T22:32:56.511269+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:26:04.280465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.284491+0000","last_change":"2024-06-02T22:31:20.760290+0000","last_active":"2024-06-02T22:34:24.284491+0000","last_peered":"2024-06-02T22:34:24.284491+0000","last_clean":"2024-06-02T22:34:24.284491+0000","last_became_active":"2024-06-02T22:31:20.759678+0000","last_became_peered":"2024-06-02T22:31:20.759678+0000","last_unstale":"2024-06-02T22:34:24.284491+0000","last_undegraded":"2024-06-02T22:34:24.284491+0000","last_fullsized":"2024-06-02T22:34:24.284491+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:24:46.087094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677637+0000","last_change":"2024-06-02T22:31:33.865919+0000","last_active":"2024-06-02T22:32:56.677637+0000","last_peered":"2024-06-02T22:32:56.677637+0000","last_clean":"2024-06-02T22:32:56.677637+0000","last_became_active":"2024-06-02T22:31:33.865396+0000","last_became_peered":"2024-06-02T22:31:33.865396+0000","last_unstale":"2024-06-02T22:32:56.677637+0000","last_undegraded":"2024-06-02T22:32:56.677637+0000","last_fullsized":"2024-06-02T22:32:56.677637+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:06:09.238985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635370+0000","last_change":"2024-06-02T22:31:15.847154+0000","last_active":"2024-06-02T22:32:56.635370+0000","last_peered":"2024-06-02T22:32:56.635370+0000","last_clean":"2024-06-02T22:32:56.635370+0000","last_became_active":"2024-06-02T22:31:15.846743+0000","last_became_peered":"2024-06-02T22:31:15.846743+0000","last_unstale":"2024-06-02T22:32:56.635370+0000","last_undegraded":"2024-06-02T22:32:56.635370+0000","last_fullsized":"2024-06-02T22:32:56.635370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:00.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244296+0000","last_change":"2024-06-02T22:31:20.748926+0000","last_active":"2024-06-02T22:34:24.244296+0000","last_peered":"2024-06-02T22:34:24.244296+0000","last_clean":"2024-06-02T22:34:24.244296+0000","last_became_active":"2024-06-02T22:31:20.748588+0000","last_became_peered":"2024-06-02T22:31:20.748588+0000","last_unstale":"2024-06-02T22:34:24.244296+0000","last_undegraded":"2024-06-02T22:34:24.244296+0000","last_fullsized":"2024-06-02T22:34:24.244296+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:26:09.876916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506125+0000","last_change":"2024-06-02T22:31:33.859876+0000","last_active":"2024-06-02T22:32:56.506125+0000","last_peered":"2024-06-02T22:32:56.506125+0000","last_clean":"2024-06-02T22:32:56.506125+0000","last_became_active":"2024-06-02T22:31:33.856511+0000","last_became_peered":"2024-06-02T22:31:33.856511+0000","last_unstale":"2024-06-02T22:32:56.506125+0000","last_undegraded":"2024-06-02T22:32:56.506125+0000","last_fullsized":"2024-06-02T22:32:56.506125+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:00.255066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"99'41","reported_seq":366,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:55.669008+0000","last_change":"2024-06-02T22:31:55.992340+0000","last_active":"2024-06-02T22:34:55.669008+0000","last_peered":"2024-06-02T22:34:55.669008+0000","last_clean":"2024-06-02T22:34:55.669008+0000","last_became_active":"2024-06-02T22:31:55.984100+0000","last_became_peered":"2024-06-02T22:31:55.984100+0000","last_unstale":"2024-06-02T22:34:55.669008+0000","last_undegraded":"2024-06-02T22:34:55.669008+0000","last_fullsized":"2024-06-02T22:34:55.669008+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:45:40.557506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66767,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":264,"num_read_kb":198,"num_write":43,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.239021+0000","last_change":"2024-06-02T22:31:20.755532+0000","last_active":"2024-06-02T22:34:24.239021+0000","last_peered":"2024-06-02T22:34:24.239021+0000","last_clean":"2024-06-02T22:34:24.239021+0000","last_became_active":"2024-06-02T22:31:20.755186+0000","last_became_peered":"2024-06-02T22:31:20.755186+0000","last_unstale":"2024-06-02T22:34:24.239021+0000","last_undegraded":"2024-06-02T22:34:24.239021+0000","last_fullsized":"2024-06-02T22:34:24.239021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:24.459712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635671+0000","last_change":"2024-06-02T22:31:33.864513+0000","last_active":"2024-06-02T22:32:56.635671+0000","last_peered":"2024-06-02T22:32:56.635671+0000","last_clean":"2024-06-02T22:32:56.635671+0000","last_became_active":"2024-06-02T22:31:33.864009+0000","last_became_peered":"2024-06-02T22:31:33.864009+0000","last_unstale":"2024-06-02T22:32:56.635671+0000","last_undegraded":"2024-06-02T22:32:56.635671+0000","last_fullsized":"2024-06-02T22:32:56.635671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:36:14.510137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"97'9","reported_seq":31,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678103+0000","last_change":"2024-06-02T22:31:55.994602+0000","last_active":"2024-06-02T22:32:56.678103+0000","last_peered":"2024-06-02T22:32:56.678103+0000","last_clean":"2024-06-02T22:32:56.678103+0000","last_became_active":"2024-06-02T22:31:55.989825+0000","last_became_peered":"2024-06-02T22:31:55.989825+0000","last_unstale":"2024-06-02T22:32:56.678103+0000","last_undegraded":"2024-06-02T22:32:56.678103+0000","last_fullsized":"2024-06-02T22:32:56.678103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:20:50.155888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.269882+0000","last_change":"2024-06-02T22:31:20.777927+0000","last_active":"2024-06-02T22:34:24.269882+0000","last_peered":"2024-06-02T22:34:24.269882+0000","last_clean":"2024-06-02T22:34:24.269882+0000","last_became_active":"2024-06-02T22:31:20.777609+0000","last_became_peered":"2024-06-02T22:31:20.777609+0000","last_unstale":"2024-06-02T22:34:24.269882+0000","last_undegraded":"2024-06-02T22:34:24.269882+0000","last_fullsized":"2024-06-02T22:34:24.269882+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:07.396916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677833+0000","last_change":"2024-06-02T22:31:33.861447+0000","last_active":"2024-06-02T22:32:56.677833+0000","last_peered":"2024-06-02T22:32:56.677833+0000","last_clean":"2024-06-02T22:32:56.677833+0000","last_became_active":"2024-06-02T22:31:33.860836+0000","last_became_peered":"2024-06-02T22:31:33.860836+0000","last_unstale":"2024-06-02T22:32:56.677833+0000","last_undegraded":"2024-06-02T22:32:56.677833+0000","last_fullsized":"2024-06-02T22:32:56.677833+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:21.297872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"97'5","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635188+0000","last_change":"2024-06-02T22:31:15.644306+0000","last_active":"2024-06-02T22:32:56.635188+0000","last_peered":"2024-06-02T22:32:56.635188+0000","last_clean":"2024-06-02T22:32:56.635188+0000","last_became_active":"2024-06-02T22:31:15.643741+0000","last_became_peered":"2024-06-02T22:31:15.643741+0000","last_unstale":"2024-06-02T22:32:56.635188+0000","last_undegraded":"2024-06-02T22:32:56.635188+0000","last_fullsized":"2024-06-02T22:32:56.635188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:53.161633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268768+0000","last_change":"2024-06-02T22:31:20.751551+0000","last_active":"2024-06-02T22:34:24.268768+0000","last_peered":"2024-06-02T22:34:24.268768+0000","last_clean":"2024-06-02T22:34:24.268768+0000","last_became_active":"2024-06-02T22:31:20.751002+0000","last_became_peered":"2024-06-02T22:31:20.751002+0000","last_unstale":"2024-06-02T22:34:24.268768+0000","last_undegraded":"2024-06-02T22:34:24.268768+0000","last_fullsized":"2024-06-02T22:34:24.268768+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T22:40:18.201325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507255+0000","last_change":"2024-06-02T22:31:33.871515+0000","last_active":"2024-06-02T22:32:56.507255+0000","last_peered":"2024-06-02T22:32:56.507255+0000","last_clean":"2024-06-02T22:32:56.507255+0000","last_became_active":"2024-06-02T22:31:33.870756+0000","last_became_peered":"2024-06-02T22:31:33.870756+0000","last_unstale":"2024-06-02T22:32:56.507255+0000","last_undegraded":"2024-06-02T22:32:56.507255+0000","last_fullsized":"2024-06-02T22:32:56.507255+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:12:31.109559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"97'5","reported_seq":178,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:54.703912+0000","last_change":"2024-06-02T22:31:15.638139+0000","last_active":"2024-06-02T22:34:54.703912+0000","last_peered":"2024-06-02T22:34:54.703912+0000","last_clean":"2024-06-02T22:34:54.703912+0000","last_became_active":"2024-06-02T22:31:15.636635+0000","last_became_peered":"2024-06-02T22:31:15.636635+0000","last_unstale":"2024-06-02T22:34:54.703912+0000","last_undegraded":"2024-06-02T22:34:54.703912+0000","last_fullsized":"2024-06-02T22:34:54.703912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:07.195137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.235429+0000","last_change":"2024-06-02T22:31:20.745347+0000","last_active":"2024-06-02T22:34:24.235429+0000","last_peered":"2024-06-02T22:34:24.235429+0000","last_clean":"2024-06-02T22:34:24.235429+0000","last_became_active":"2024-06-02T22:31:20.744990+0000","last_became_peered":"2024-06-02T22:31:20.744990+0000","last_unstale":"2024-06-02T22:34:24.235429+0000","last_undegraded":"2024-06-02T22:34:24.235429+0000","last_fullsized":"2024-06-02T22:34:24.235429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:20.215740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684338+0000","last_change":"2024-06-02T22:31:33.866261+0000","last_active":"2024-06-02T22:32:56.684338+0000","last_peered":"2024-06-02T22:32:56.684338+0000","last_clean":"2024-06-02T22:32:56.684338+0000","last_became_active":"2024-06-02T22:31:33.865863+0000","last_became_peered":"2024-06-02T22:31:33.865863+0000","last_unstale":"2024-06-02T22:32:56.684338+0000","last_undegraded":"2024-06-02T22:32:56.684338+0000","last_fullsized":"2024-06-02T22:32:56.684338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:00:41.670289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"97'17","reported_seq":63,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.496844+0000","last_change":"2024-06-02T22:31:15.848282+0000","last_active":"2024-06-02T22:32:56.496844+0000","last_peered":"2024-06-02T22:32:56.496844+0000","last_clean":"2024-06-02T22:32:56.496844+0000","last_became_active":"2024-06-02T22:31:15.847846+0000","last_became_peered":"2024-06-02T22:31:15.847846+0000","last_unstale":"2024-06-02T22:32:56.496844+0000","last_undegraded":"2024-06-02T22:32:56.496844+0000","last_fullsized":"2024-06-02T22:32:56.496844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:09:12.971908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242845+0000","last_change":"2024-06-02T22:31:20.756682+0000","last_active":"2024-06-02T22:34:24.242845+0000","last_peered":"2024-06-02T22:34:24.242845+0000","last_clean":"2024-06-02T22:34:24.242845+0000","last_became_active":"2024-06-02T22:31:20.756357+0000","last_became_peered":"2024-06-02T22:31:20.756357+0000","last_unstale":"2024-06-02T22:34:24.242845+0000","last_undegraded":"2024-06-02T22:34:24.242845+0000","last_fullsized":"2024-06-02T22:34:24.242845+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:39:53.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635098+0000","last_change":"2024-06-02T22:31:33.858267+0000","last_active":"2024-06-02T22:32:56.635098+0000","last_peered":"2024-06-02T22:32:56.635098+0000","last_clean":"2024-06-02T22:32:56.635098+0000","last_became_active":"2024-06-02T22:31:33.857784+0000","last_became_peered":"2024-06-02T22:31:33.857784+0000","last_unstale":"2024-06-02T22:32:56.635098+0000","last_undegraded":"2024-06-02T22:32:56.635098+0000","last_fullsized":"2024-06-02T22:32:56.635098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:07:11.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"97'2","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497427+0000","last_change":"2024-06-02T22:31:15.637328+0000","last_active":"2024-06-02T22:32:56.497427+0000","last_peered":"2024-06-02T22:32:56.497427+0000","last_clean":"2024-06-02T22:32:56.497427+0000","last_became_active":"2024-06-02T22:31:15.636933+0000","last_became_peered":"2024-06-02T22:31:15.636933+0000","last_unstale":"2024-06-02T22:32:56.497427+0000","last_undegraded":"2024-06-02T22:32:56.497427+0000","last_fullsized":"2024-06-02T22:32:56.497427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:12:40.358884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.239868+0000","last_change":"2024-06-02T22:31:20.752471+0000","last_active":"2024-06-02T22:34:24.239868+0000","last_peered":"2024-06-02T22:34:24.239868+0000","last_clean":"2024-06-02T22:34:24.239868+0000","last_became_active":"2024-06-02T22:31:20.750450+0000","last_became_peered":"2024-06-02T22:31:20.750450+0000","last_unstale":"2024-06-02T22:34:24.239868+0000","last_undegraded":"2024-06-02T22:34:24.239868+0000","last_fullsized":"2024-06-02T22:34:24.239868+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:26:21.467156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497322+0000","last_change":"2024-06-02T22:31:55.984989+0000","last_active":"2024-06-02T22:32:56.497322+0000","last_peered":"2024-06-02T22:32:56.497322+0000","last_clean":"2024-06-02T22:32:56.497322+0000","last_became_active":"2024-06-02T22:31:55.984481+0000","last_became_peered":"2024-06-02T22:31:55.984481+0000","last_unstale":"2024-06-02T22:32:56.497322+0000","last_undegraded":"2024-06-02T22:32:56.497322+0000","last_fullsized":"2024-06-02T22:32:56.497322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:19:12.087792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"97'1","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.506536+0000","last_change":"2024-06-02T22:31:15.849517+0000","last_active":"2024-06-02T22:32:56.506536+0000","last_peered":"2024-06-02T22:32:56.506536+0000","last_clean":"2024-06-02T22:32:56.506536+0000","last_became_active":"2024-06-02T22:31:15.849092+0000","last_became_peered":"2024-06-02T22:31:15.849092+0000","last_unstale":"2024-06-02T22:32:56.506536+0000","last_undegraded":"2024-06-02T22:32:56.506536+0000","last_fullsized":"2024-06-02T22:32:56.506536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:24:50.722007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270490+0000","last_change":"2024-06-02T22:31:20.768944+0000","last_active":"2024-06-02T22:34:24.270490+0000","last_peered":"2024-06-02T22:34:24.270490+0000","last_clean":"2024-06-02T22:34:24.270490+0000","last_became_active":"2024-06-02T22:31:20.768275+0000","last_became_peered":"2024-06-02T22:31:20.768275+0000","last_unstale":"2024-06-02T22:34:24.270490+0000","last_undegraded":"2024-06-02T22:34:24.270490+0000","last_fullsized":"2024-06-02T22:34:24.270490+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:17:05.760188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684133+0000","last_change":"2024-06-02T22:31:33.860760+0000","last_active":"2024-06-02T22:32:56.684133+0000","last_peered":"2024-06-02T22:32:56.684133+0000","last_clean":"2024-06-02T22:32:56.684133+0000","last_became_active":"2024-06-02T22:31:33.860203+0000","last_became_peered":"2024-06-02T22:31:33.860203+0000","last_unstale":"2024-06-02T22:32:56.684133+0000","last_undegraded":"2024-06-02T22:32:56.684133+0000","last_fullsized":"2024-06-02T22:32:56.684133+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:59:22.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"99'7","reported_seq":182,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:55.805283+0000","last_change":"2024-06-02T22:31:15.640274+0000","last_active":"2024-06-02T22:34:55.805283+0000","last_peered":"2024-06-02T22:34:55.805283+0000","last_clean":"2024-06-02T22:34:55.805283+0000","last_became_active":"2024-06-02T22:31:15.639879+0000","last_became_peered":"2024-06-02T22:31:15.639879+0000","last_unstale":"2024-06-02T22:34:55.805283+0000","last_undegraded":"2024-06-02T22:34:55.805283+0000","last_fullsized":"2024-06-02T22:34:55.805283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:51:37.947343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1119,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268084+0000","last_change":"2024-06-02T22:31:20.767645+0000","last_active":"2024-06-02T22:34:24.268084+0000","last_peered":"2024-06-02T22:34:24.268084+0000","last_clean":"2024-06-02T22:34:24.268084+0000","last_became_active":"2024-06-02T22:31:20.767290+0000","last_became_peered":"2024-06-02T22:31:20.767290+0000","last_unstale":"2024-06-02T22:34:24.268084+0000","last_undegraded":"2024-06-02T22:34:24.268084+0000","last_fullsized":"2024-06-02T22:34:24.268084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:48:10.989940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684431+0000","last_change":"2024-06-02T22:31:34.188667+0000","last_active":"2024-06-02T22:32:56.684431+0000","last_peered":"2024-06-02T22:32:56.684431+0000","last_clean":"2024-06-02T22:32:56.684431+0000","last_became_active":"2024-06-02T22:31:34.187865+0000","last_became_peered":"2024-06-02T22:31:34.187865+0000","last_unstale":"2024-06-02T22:32:56.684431+0000","last_undegraded":"2024-06-02T22:32:56.684431+0000","last_fullsized":"2024-06-02T22:32:56.684431+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:40:48.544150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.240442+0000","last_change":"2024-06-02T22:31:20.755881+0000","last_active":"2024-06-02T22:34:24.240442+0000","last_peered":"2024-06-02T22:34:24.240442+0000","last_clean":"2024-06-02T22:34:24.240442+0000","last_became_active":"2024-06-02T22:31:20.755481+0000","last_became_peered":"2024-06-02T22:31:20.755481+0000","last_unstale":"2024-06-02T22:34:24.240442+0000","last_undegraded":"2024-06-02T22:34:24.240442+0000","last_fullsized":"2024-06-02T22:34:24.240442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:10:33.871824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"97'5","reported_seq":177,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:54.703105+0000","last_change":"2024-06-02T22:31:15.846057+0000","last_active":"2024-06-02T22:34:54.703105+0000","last_peered":"2024-06-02T22:34:54.703105+0000","last_clean":"2024-06-02T22:34:54.703105+0000","last_became_active":"2024-06-02T22:31:15.845097+0000","last_became_peered":"2024-06-02T22:31:15.845097+0000","last_unstale":"2024-06-02T22:34:54.703105+0000","last_undegraded":"2024-06-02T22:34:54.703105+0000","last_fullsized":"2024-06-02T22:34:54.703105+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:22:23.481235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:03.693110+0000","last_change":"2024-06-02T22:31:33.858499+0000","last_active":"2024-06-02T22:33:03.693110+0000","last_peered":"2024-06-02T22:33:03.693110+0000","last_clean":"2024-06-02T22:33:03.693110+0000","last_became_active":"2024-06-02T22:31:33.857914+0000","last_became_peered":"2024-06-02T22:31:33.857914+0000","last_unstale":"2024-06-02T22:33:03.693110+0000","last_undegraded":"2024-06-02T22:33:03.693110+0000","last_fullsized":"2024-06-02T22:33:03.693110+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:50:09.743015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272808+0000","last_change":"2024-06-02T22:31:20.763011+0000","last_active":"2024-06-02T22:34:24.272808+0000","last_peered":"2024-06-02T22:34:24.272808+0000","last_clean":"2024-06-02T22:34:24.272808+0000","last_became_active":"2024-06-02T22:31:20.759450+0000","last_became_peered":"2024-06-02T22:31:20.759450+0000","last_unstale":"2024-06-02T22:34:24.272808+0000","last_undegraded":"2024-06-02T22:34:24.272808+0000","last_fullsized":"2024-06-02T22:34:24.272808+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:08:24.748321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'6","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677793+0000","last_change":"2024-06-02T22:31:15.642691+0000","last_active":"2024-06-02T22:32:56.677793+0000","last_peered":"2024-06-02T22:32:56.677793+0000","last_clean":"2024-06-02T22:32:56.677793+0000","last_became_active":"2024-06-02T22:31:15.642313+0000","last_became_peered":"2024-06-02T22:31:15.642313+0000","last_unstale":"2024-06-02T22:32:56.677793+0000","last_undegraded":"2024-06-02T22:32:56.677793+0000","last_fullsized":"2024-06-02T22:32:56.677793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:34:32.329387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":368,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510628+0000","last_change":"2024-06-02T22:29:39.376514+0000","last_active":"2024-06-02T22:32:56.510628+0000","last_peered":"2024-06-02T22:32:56.510628+0000","last_clean":"2024-06-02T22:32:56.510628+0000","last_became_active":"2024-06-02T22:29:39.376061+0000","last_became_peered":"2024-06-02T22:29:39.376061+0000","last_unstale":"2024-06-02T22:32:56.510628+0000","last_undegraded":"2024-06-02T22:32:56.510628+0000","last_fullsized":"2024-06-02T22:32:56.510628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:25:41.060756+0000","last_clean_scrub_stamp":"2024-06-02T22:25:41.060756+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:26:05.799761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635473+0000","last_change":"2024-06-02T22:31:34.189204+0000","last_active":"2024-06-02T22:32:56.635473+0000","last_peered":"2024-06-02T22:32:56.635473+0000","last_clean":"2024-06-02T22:32:56.635473+0000","last_became_active":"2024-06-02T22:31:34.188639+0000","last_became_peered":"2024-06-02T22:31:34.188639+0000","last_unstale":"2024-06-02T22:32:56.635473+0000","last_undegraded":"2024-06-02T22:32:56.635473+0000","last_fullsized":"2024-06-02T22:32:56.635473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:03:37.983874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.268318+0000","last_change":"2024-06-02T22:31:20.768724+0000","last_active":"2024-06-02T22:34:24.268318+0000","last_peered":"2024-06-02T22:34:24.268318+0000","last_clean":"2024-06-02T22:34:24.268318+0000","last_became_active":"2024-06-02T22:31:20.768328+0000","last_became_peered":"2024-06-02T22:31:20.768328+0000","last_unstale":"2024-06-02T22:34:24.268318+0000","last_undegraded":"2024-06-02T22:34:24.268318+0000","last_fullsized":"2024-06-02T22:34:24.268318+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:48.993951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"97'4","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.510775+0000","last_change":"2024-06-02T22:31:15.637109+0000","last_active":"2024-06-02T22:32:56.510775+0000","last_peered":"2024-06-02T22:32:56.510775+0000","last_clean":"2024-06-02T22:32:56.510775+0000","last_became_active":"2024-06-02T22:31:15.636511+0000","last_became_peered":"2024-06-02T22:31:15.636511+0000","last_unstale":"2024-06-02T22:32:56.510775+0000","last_undegraded":"2024-06-02T22:32:56.510775+0000","last_fullsized":"2024-06-02T22:32:56.510775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:11:15.838242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678182+0000","last_change":"2024-06-02T22:31:33.861118+0000","last_active":"2024-06-02T22:32:56.678182+0000","last_peered":"2024-06-02T22:32:56.678182+0000","last_clean":"2024-06-02T22:32:56.678182+0000","last_became_active":"2024-06-02T22:31:33.860622+0000","last_became_peered":"2024-06-02T22:31:33.860622+0000","last_unstale":"2024-06-02T22:32:56.678182+0000","last_undegraded":"2024-06-02T22:32:56.678182+0000","last_fullsized":"2024-06-02T22:32:56.678182+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:44:14.052151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"97'4","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678341+0000","last_change":"2024-06-02T22:31:56.477226+0000","last_active":"2024-06-02T22:32:56.678341+0000","last_peered":"2024-06-02T22:32:56.678341+0000","last_clean":"2024-06-02T22:32:56.678341+0000","last_became_active":"2024-06-02T22:31:56.476839+0000","last_became_peered":"2024-06-02T22:31:56.476839+0000","last_unstale":"2024-06-02T22:32:56.678341+0000","last_undegraded":"2024-06-02T22:32:56.678341+0000","last_fullsized":"2024-06-02T22:32:56.678341+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:12.233878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.267821+0000","last_change":"2024-06-02T22:31:20.771984+0000","last_active":"2024-06-02T22:34:24.267821+0000","last_peered":"2024-06-02T22:34:24.267821+0000","last_clean":"2024-06-02T22:34:24.267821+0000","last_became_active":"2024-06-02T22:31:20.771524+0000","last_became_peered":"2024-06-02T22:31:20.771524+0000","last_unstale":"2024-06-02T22:34:24.267821+0000","last_undegraded":"2024-06-02T22:34:24.267821+0000","last_fullsized":"2024-06-02T22:34:24.267821+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:13:25.590377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.681347+0000","last_change":"2024-06-02T22:31:34.188564+0000","last_active":"2024-06-02T22:32:56.681347+0000","last_peered":"2024-06-02T22:32:56.681347+0000","last_clean":"2024-06-02T22:32:56.681347+0000","last_became_active":"2024-06-02T22:31:34.187631+0000","last_became_peered":"2024-06-02T22:31:34.187631+0000","last_unstale":"2024-06-02T22:32:56.681347+0000","last_undegraded":"2024-06-02T22:32:56.681347+0000","last_fullsized":"2024-06-02T22:32:56.681347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:23:35.572300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"99'17","reported_seq":62,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:28.729103+0000","last_change":"2024-06-02T22:31:15.648073+0000","last_active":"2024-06-02T22:33:28.729103+0000","last_peered":"2024-06-02T22:33:28.729103+0000","last_clean":"2024-06-02T22:33:28.729103+0000","last_became_active":"2024-06-02T22:31:15.647573+0000","last_became_peered":"2024-06-02T22:31:15.647573+0000","last_unstale":"2024-06-02T22:33:28.729103+0000","last_undegraded":"2024-06-02T22:33:28.729103+0000","last_fullsized":"2024-06-02T22:33:28.729103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:58.137635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.263542+0000","last_change":"2024-06-02T22:31:20.764750+0000","last_active":"2024-06-02T22:34:24.263542+0000","last_peered":"2024-06-02T22:34:24.263542+0000","last_clean":"2024-06-02T22:34:24.263542+0000","last_became_active":"2024-06-02T22:31:20.763025+0000","last_became_peered":"2024-06-02T22:31:20.763025+0000","last_unstale":"2024-06-02T22:34:24.263542+0000","last_undegraded":"2024-06-02T22:34:24.263542+0000","last_fullsized":"2024-06-02T22:34:24.263542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:40:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677223+0000","last_change":"2024-06-02T22:31:33.845885+0000","last_active":"2024-06-02T22:32:56.677223+0000","last_peered":"2024-06-02T22:32:56.677223+0000","last_clean":"2024-06-02T22:32:56.677223+0000","last_became_active":"2024-06-02T22:31:33.845076+0000","last_became_peered":"2024-06-02T22:31:33.845076+0000","last_unstale":"2024-06-02T22:32:56.677223+0000","last_undegraded":"2024-06-02T22:32:56.677223+0000","last_fullsized":"2024-06-02T22:32:56.677223+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:28:32.849389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"97'7","reported_seq":53,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677923+0000","last_change":"2024-06-02T22:31:16.009742+0000","last_active":"2024-06-02T22:32:56.677923+0000","last_peered":"2024-06-02T22:32:56.677923+0000","last_clean":"2024-06-02T22:32:56.677923+0000","last_became_active":"2024-06-02T22:31:16.009462+0000","last_became_peered":"2024-06-02T22:31:16.009462+0000","last_unstale":"2024-06-02T22:32:56.677923+0000","last_undegraded":"2024-06-02T22:32:56.677923+0000","last_fullsized":"2024-06-02T22:32:56.677923+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:57.963782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283643+0000","last_change":"2024-06-02T22:31:20.779344+0000","last_active":"2024-06-02T22:34:24.283643+0000","last_peered":"2024-06-02T22:34:24.283643+0000","last_clean":"2024-06-02T22:34:24.283643+0000","last_became_active":"2024-06-02T22:31:20.778586+0000","last_became_peered":"2024-06-02T22:31:20.778586+0000","last_unstale":"2024-06-02T22:34:24.283643+0000","last_undegraded":"2024-06-02T22:34:24.283643+0000","last_fullsized":"2024-06-02T22:34:24.283643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:55:01.213401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":36,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677711+0000","last_change":"2024-06-02T22:31:55.986536+0000","last_active":"2024-06-02T22:32:56.677711+0000","last_peered":"2024-06-02T22:32:56.677711+0000","last_clean":"2024-06-02T22:32:56.677711+0000","last_became_active":"2024-06-02T22:31:55.985958+0000","last_became_peered":"2024-06-02T22:31:55.985958+0000","last_unstale":"2024-06-02T22:32:56.677711+0000","last_undegraded":"2024-06-02T22:32:56.677711+0000","last_fullsized":"2024-06-02T22:32:56.677711+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:02:13.317010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"97'2","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637545+0000","last_change":"2024-06-02T22:31:15.844475+0000","last_active":"2024-06-02T22:32:56.637545+0000","last_peered":"2024-06-02T22:32:56.637545+0000","last_clean":"2024-06-02T22:32:56.637545+0000","last_became_active":"2024-06-02T22:31:15.844135+0000","last_became_peered":"2024-06-02T22:31:15.844135+0000","last_unstale":"2024-06-02T22:32:56.637545+0000","last_undegraded":"2024-06-02T22:32:56.637545+0000","last_fullsized":"2024-06-02T22:32:56.637545+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:44:29.127186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.195228+0000","last_change":"2024-06-02T22:31:20.752005+0000","last_active":"2024-06-02T22:34:24.195228+0000","last_peered":"2024-06-02T22:34:24.195228+0000","last_clean":"2024-06-02T22:34:24.195228+0000","last_became_active":"2024-06-02T22:31:20.751525+0000","last_became_peered":"2024-06-02T22:31:20.751525+0000","last_unstale":"2024-06-02T22:34:24.195228+0000","last_undegraded":"2024-06-02T22:34:24.195228+0000","last_fullsized":"2024-06-02T22:34:24.195228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:08:35.477470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.507234+0000","last_change":"2024-06-02T22:31:33.870374+0000","last_active":"2024-06-02T22:32:56.507234+0000","last_peered":"2024-06-02T22:32:56.507234+0000","last_clean":"2024-06-02T22:32:56.507234+0000","last_became_active":"2024-06-02T22:31:33.869931+0000","last_became_peered":"2024-06-02T22:31:33.869931+0000","last_unstale":"2024-06-02T22:32:56.507234+0000","last_undegraded":"2024-06-02T22:32:56.507234+0000","last_fullsized":"2024-06-02T22:32:56.507234+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:33:11.209183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"97'7","reported_seq":52,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.680278+0000","last_change":"2024-06-02T22:31:15.645570+0000","last_active":"2024-06-02T22:32:56.680278+0000","last_peered":"2024-06-02T22:32:56.680278+0000","last_clean":"2024-06-02T22:32:56.680278+0000","last_became_active":"2024-06-02T22:31:15.645124+0000","last_became_peered":"2024-06-02T22:31:15.645124+0000","last_unstale":"2024-06-02T22:32:56.680278+0000","last_undegraded":"2024-06-02T22:32:56.680278+0000","last_fullsized":"2024-06-02T22:32:56.680278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:11:56.956942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.272563+0000","last_change":"2024-06-02T22:31:20.758501+0000","last_active":"2024-06-02T22:34:24.272563+0000","last_peered":"2024-06-02T22:34:24.272563+0000","last_clean":"2024-06-02T22:34:24.272563+0000","last_became_active":"2024-06-02T22:31:20.758097+0000","last_became_peered":"2024-06-02T22:31:20.758097+0000","last_unstale":"2024-06-02T22:34:24.272563+0000","last_undegraded":"2024-06-02T22:34:24.272563+0000","last_fullsized":"2024-06-02T22:34:24.272563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:55:47.523600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"99'1","reported_seq":30,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:33:11.873542+0000","last_change":"2024-06-02T22:31:33.858463+0000","last_active":"2024-06-02T22:33:11.873542+0000","last_peered":"2024-06-02T22:33:11.873542+0000","last_clean":"2024-06-02T22:33:11.873542+0000","last_became_active":"2024-06-02T22:31:33.858001+0000","last_became_peered":"2024-06-02T22:31:33.858001+0000","last_unstale":"2024-06-02T22:33:11.873542+0000","last_undegraded":"2024-06-02T22:33:11.873542+0000","last_fullsized":"2024-06-02T22:33:11.873542+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:50.797150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"97'3","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677176+0000","last_change":"2024-06-02T22:31:15.644144+0000","last_active":"2024-06-02T22:32:56.677176+0000","last_peered":"2024-06-02T22:32:56.677176+0000","last_clean":"2024-06-02T22:32:56.677176+0000","last_became_active":"2024-06-02T22:31:15.643629+0000","last_became_peered":"2024-06-02T22:31:15.643629+0000","last_unstale":"2024-06-02T22:32:56.677176+0000","last_undegraded":"2024-06-02T22:32:56.677176+0000","last_fullsized":"2024-06-02T22:32:56.677176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:45:36.491134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"99'8","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.286927+0000","last_change":"2024-06-02T22:32:56.681729+0000","last_active":"2024-06-02T22:34:24.286927+0000","last_peered":"2024-06-02T22:34:24.286927+0000","last_clean":"2024-06-02T22:34:24.286927+0000","last_became_active":"2024-06-02T22:32:56.680934+0000","last_became_peered":"2024-06-02T22:32:56.680934+0000","last_unstale":"2024-06-02T22:34:24.286927+0000","last_undegraded":"2024-06-02T22:34:24.286927+0000","last_fullsized":"2024-06-02T22:34:24.286927+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:02.046940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,10],"acting":[9,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.677844+0000","last_change":"2024-06-02T22:31:34.187743+0000","last_active":"2024-06-02T22:32:56.677844+0000","last_peered":"2024-06-02T22:32:56.677844+0000","last_clean":"2024-06-02T22:32:56.677844+0000","last_became_active":"2024-06-02T22:31:34.187241+0000","last_became_peered":"2024-06-02T22:31:34.187241+0000","last_unstale":"2024-06-02T22:32:56.677844+0000","last_undegraded":"2024-06-02T22:32:56.677844+0000","last_fullsized":"2024-06-02T22:32:56.677844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:20:00.980570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"97'4","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.497088+0000","last_change":"2024-06-02T22:31:15.639499+0000","last_active":"2024-06-02T22:32:56.497088+0000","last_peered":"2024-06-02T22:32:56.497088+0000","last_clean":"2024-06-02T22:32:56.497088+0000","last_became_active":"2024-06-02T22:31:15.639078+0000","last_became_peered":"2024-06-02T22:31:15.639078+0000","last_unstale":"2024-06-02T22:32:56.497088+0000","last_undegraded":"2024-06-02T22:32:56.497088+0000","last_fullsized":"2024-06-02T22:32:56.497088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:29.624572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"99'5","reported_seq":44,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.270728+0000","last_change":"2024-06-02T22:31:20.768079+0000","last_active":"2024-06-02T22:34:24.270728+0000","last_peered":"2024-06-02T22:34:24.270728+0000","last_clean":"2024-06-02T22:34:24.270728+0000","last_became_active":"2024-06-02T22:31:20.767762+0000","last_became_peered":"2024-06-02T22:31:20.767762+0000","last_unstale":"2024-06-02T22:34:24.270728+0000","last_undegraded":"2024-06-02T22:34:24.270728+0000","last_fullsized":"2024-06-02T22:34:24.270728+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:50:05.247900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.637608+0000","last_change":"2024-06-02T22:31:33.852366+0000","last_active":"2024-06-02T22:32:56.637608+0000","last_peered":"2024-06-02T22:32:56.637608+0000","last_clean":"2024-06-02T22:32:56.637608+0000","last_became_active":"2024-06-02T22:31:33.851836+0000","last_became_peered":"2024-06-02T22:31:33.851836+0000","last_unstale":"2024-06-02T22:32:56.637608+0000","last_undegraded":"2024-06-02T22:32:56.637608+0000","last_fullsized":"2024-06-02T22:32:56.637608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:50:53.780326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"99'7","reported_seq":186,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:58.674797+0000","last_change":"2024-06-02T22:31:16.009788+0000","last_active":"2024-06-02T22:34:58.674797+0000","last_peered":"2024-06-02T22:34:58.674797+0000","last_clean":"2024-06-02T22:34:58.674797+0000","last_became_active":"2024-06-02T22:31:16.009413+0000","last_became_peered":"2024-06-02T22:31:16.009413+0000","last_unstale":"2024-06-02T22:34:58.674797+0000","last_undegraded":"2024-06-02T22:34:58.674797+0000","last_fullsized":"2024-06-02T22:34:58.674797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:43:38.985017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":134,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.245113+0000","last_change":"2024-06-02T22:31:20.751507+0000","last_active":"2024-06-02T22:34:24.245113+0000","last_peered":"2024-06-02T22:34:24.245113+0000","last_clean":"2024-06-02T22:34:24.245113+0000","last_became_active":"2024-06-02T22:31:20.751179+0000","last_became_peered":"2024-06-02T22:31:20.751179+0000","last_unstale":"2024-06-02T22:34:24.245113+0000","last_undegraded":"2024-06-02T22:34:24.245113+0000","last_fullsized":"2024-06-02T22:34:24.245113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:01:16.744759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.678813+0000","last_change":"2024-06-02T22:31:33.862697+0000","last_active":"2024-06-02T22:32:56.678813+0000","last_peered":"2024-06-02T22:32:56.678813+0000","last_clean":"2024-06-02T22:32:56.678813+0000","last_became_active":"2024-06-02T22:31:33.862148+0000","last_became_peered":"2024-06-02T22:31:33.862148+0000","last_unstale":"2024-06-02T22:32:56.678813+0000","last_undegraded":"2024-06-02T22:32:56.678813+0000","last_fullsized":"2024-06-02T22:32:56.678813+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:53:15.435992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"97'3","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.635478+0000","last_change":"2024-06-02T22:31:15.644121+0000","last_active":"2024-06-02T22:32:56.635478+0000","last_peered":"2024-06-02T22:32:56.635478+0000","last_clean":"2024-06-02T22:32:56.635478+0000","last_became_active":"2024-06-02T22:31:15.643727+0000","last_became_peered":"2024-06-02T22:31:15.643727+0000","last_unstale":"2024-06-02T22:32:56.635478+0000","last_undegraded":"2024-06-02T22:32:56.635478+0000","last_fullsized":"2024-06-02T22:32:56.635478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:17:07.135824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.248444+0000","last_change":"2024-06-02T22:31:20.748366+0000","last_active":"2024-06-02T22:34:24.248444+0000","last_peered":"2024-06-02T22:34:24.248444+0000","last_clean":"2024-06-02T22:34:24.248444+0000","last_became_active":"2024-06-02T22:31:20.748036+0000","last_became_peered":"2024-06-02T22:31:20.748036+0000","last_unstale":"2024-06-02T22:34:24.248444+0000","last_undegraded":"2024-06-02T22:34:24.248444+0000","last_fullsized":"2024-06-02T22:34:24.248444+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:48.188964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.634752+0000","last_change":"2024-06-02T22:31:33.847227+0000","last_active":"2024-06-02T22:32:56.634752+0000","last_peered":"2024-06-02T22:32:56.634752+0000","last_clean":"2024-06-02T22:32:56.634752+0000","last_became_active":"2024-06-02T22:31:33.846701+0000","last_became_peered":"2024-06-02T22:31:33.846701+0000","last_unstale":"2024-06-02T22:32:56.634752+0000","last_undegraded":"2024-06-02T22:32:56.634752+0000","last_fullsized":"2024-06-02T22:32:56.634752+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:32.817507+0000","last_clean_scrub_stamp":"2024-06-02T22:31:32.817507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:19.436409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"97'5","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:32:56.684284+0000","last_change":"2024-06-02T22:31:15.648048+0000","last_active":"2024-06-02T22:32:56.684284+0000","last_peered":"2024-06-02T22:32:56.684284+0000","last_clean":"2024-06-02T22:32:56.684284+0000","last_became_active":"2024-06-02T22:31:15.647400+0000","last_became_peered":"2024-06-02T22:31:15.647400+0000","last_unstale":"2024-06-02T22:32:56.684284+0000","last_undegraded":"2024-06-02T22:32:56.684284+0000","last_fullsized":"2024-06-02T22:32:56.684284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:14.616009+0000","last_clean_scrub_stamp":"2024-06-02T22:31:14.616009+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:29:23.458912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244856+0000","last_change":"2024-06-02T22:31:20.751545+0000","last_active":"2024-06-02T22:34:24.244856+0000","last_peered":"2024-06-02T22:34:24.244856+0000","last_clean":"2024-06-02T22:34:24.244856+0000","last_became_active":"2024-06-02T22:31:20.751202+0000","last_became_peered":"2024-06-02T22:31:20.751202+0000","last_unstale":"2024-06-02T22:34:24.244856+0000","last_undegraded":"2024-06-02T22:34:24.244856+0000","last_fullsized":"2024-06-02T22:34:24.244856+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:06:23.245161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"99'9","reported_seq":48,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.243534+0000","last_change":"2024-06-02T22:31:20.752666+0000","last_active":"2024-06-02T22:34:24.243534+0000","last_peered":"2024-06-02T22:34:24.243534+0000","last_clean":"2024-06-02T22:34:24.243534+0000","last_became_active":"2024-06-02T22:31:20.750433+0000","last_became_peered":"2024-06-02T22:31:20.750433+0000","last_unstale":"2024-06-02T22:34:24.243534+0000","last_undegraded":"2024-06-02T22:34:24.243534+0000","last_fullsized":"2024-06-02T22:34:24.243534+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:08:12.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"99'12","reported_seq":51,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.243802+0000","last_change":"2024-06-02T22:31:20.747426+0000","last_active":"2024-06-02T22:34:24.243802+0000","last_peered":"2024-06-02T22:34:24.243802+0000","last_clean":"2024-06-02T22:34:24.243802+0000","last_became_active":"2024-06-02T22:31:20.746734+0000","last_became_peered":"2024-06-02T22:31:20.746734+0000","last_unstale":"2024-06-02T22:34:24.243802+0000","last_undegraded":"2024-06-02T22:34:24.243802+0000","last_fullsized":"2024-06-02T22:34:24.243802+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:30.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.278184+0000","last_change":"2024-06-02T22:31:20.771277+0000","last_active":"2024-06-02T22:34:24.278184+0000","last_peered":"2024-06-02T22:34:24.278184+0000","last_clean":"2024-06-02T22:34:24.278184+0000","last_became_active":"2024-06-02T22:31:20.770635+0000","last_became_peered":"2024-06-02T22:31:20.770635+0000","last_unstale":"2024-06-02T22:34:24.278184+0000","last_undegraded":"2024-06-02T22:34:24.278184+0000","last_fullsized":"2024-06-02T22:34:24.278184+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:20:03.051044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"99'7","reported_seq":46,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.283965+0000","last_change":"2024-06-02T22:31:20.774709+0000","last_active":"2024-06-02T22:34:24.283965+0000","last_peered":"2024-06-02T22:34:24.283965+0000","last_clean":"2024-06-02T22:34:24.283965+0000","last_became_active":"2024-06-02T22:31:20.774260+0000","last_became_peered":"2024-06-02T22:31:20.774260+0000","last_unstale":"2024-06-02T22:34:24.283965+0000","last_undegraded":"2024-06-02T22:34:24.283965+0000","last_fullsized":"2024-06-02T22:34:24.283965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:25.045695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"99'4","reported_seq":43,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.280365+0000","last_change":"2024-06-02T22:31:20.774013+0000","last_active":"2024-06-02T22:34:24.280365+0000","last_peered":"2024-06-02T22:34:24.280365+0000","last_clean":"2024-06-02T22:34:24.280365+0000","last_became_active":"2024-06-02T22:31:20.773479+0000","last_became_peered":"2024-06-02T22:31:20.773479+0000","last_unstale":"2024-06-02T22:34:24.280365+0000","last_undegraded":"2024-06-02T22:34:24.280365+0000","last_fullsized":"2024-06-02T22:34:24.280365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:53:19.583665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.240373+0000","last_change":"2024-06-02T22:31:20.752637+0000","last_active":"2024-06-02T22:34:24.240373+0000","last_peered":"2024-06-02T22:34:24.240373+0000","last_clean":"2024-06-02T22:34:24.240373+0000","last_became_active":"2024-06-02T22:31:20.752279+0000","last_became_peered":"2024-06-02T22:31:20.752279+0000","last_unstale":"2024-06-02T22:34:24.240373+0000","last_undegraded":"2024-06-02T22:34:24.240373+0000","last_fullsized":"2024-06-02T22:34:24.240373+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:09:11.124952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"99'15","reported_seq":54,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.244226+0000","last_change":"2024-06-02T22:31:20.752138+0000","last_active":"2024-06-02T22:34:24.244226+0000","last_peered":"2024-06-02T22:34:24.244226+0000","last_clean":"2024-06-02T22:34:24.244226+0000","last_became_active":"2024-06-02T22:31:20.751744+0000","last_became_peered":"2024-06-02T22:31:20.751744+0000","last_unstale":"2024-06-02T22:34:24.244226+0000","last_undegraded":"2024-06-02T22:34:24.244226+0000","last_fullsized":"2024-06-02T22:34:24.244226+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:51.702632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"99'2","reported_seq":41,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275589+0000","last_change":"2024-06-02T22:31:20.769725+0000","last_active":"2024-06-02T22:34:24.275589+0000","last_peered":"2024-06-02T22:34:24.275589+0000","last_clean":"2024-06-02T22:34:24.275589+0000","last_became_active":"2024-06-02T22:31:20.767668+0000","last_became_peered":"2024-06-02T22:31:20.767668+0000","last_unstale":"2024-06-02T22:34:24.275589+0000","last_undegraded":"2024-06-02T22:34:24.275589+0000","last_fullsized":"2024-06-02T22:34:24.275589+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:56:57.860195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"99'6","reported_seq":45,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.274811+0000","last_change":"2024-06-02T22:31:20.771863+0000","last_active":"2024-06-02T22:34:24.274811+0000","last_peered":"2024-06-02T22:34:24.274811+0000","last_clean":"2024-06-02T22:34:24.274811+0000","last_became_active":"2024-06-02T22:31:20.771533+0000","last_became_peered":"2024-06-02T22:31:20.771533+0000","last_unstale":"2024-06-02T22:34:24.274811+0000","last_undegraded":"2024-06-02T22:34:24.274811+0000","last_fullsized":"2024-06-02T22:34:24.274811+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:34.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275896+0000","last_change":"2024-06-02T22:31:20.761906+0000","last_active":"2024-06-02T22:34:24.275896+0000","last_peered":"2024-06-02T22:34:24.275896+0000","last_clean":"2024-06-02T22:34:24.275896+0000","last_became_active":"2024-06-02T22:31:20.761571+0000","last_became_peered":"2024-06-02T22:31:20.761571+0000","last_unstale":"2024-06-02T22:34:24.275896+0000","last_undegraded":"2024-06-02T22:34:24.275896+0000","last_fullsized":"2024-06-02T22:34:24.275896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:03:37.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"99'10","reported_seq":49,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.275349+0000","last_change":"2024-06-02T22:31:20.764292+0000","last_active":"2024-06-02T22:34:24.275349+0000","last_peered":"2024-06-02T22:34:24.275349+0000","last_clean":"2024-06-02T22:34:24.275349+0000","last_became_active":"2024-06-02T22:31:20.763997+0000","last_became_peered":"2024-06-02T22:31:20.763997+0000","last_unstale":"2024-06-02T22:34:24.275349+0000","last_undegraded":"2024-06-02T22:34:24.275349+0000","last_fullsized":"2024-06-02T22:34:24.275349+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:27:44.151687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"99'11","reported_seq":50,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.277937+0000","last_change":"2024-06-02T22:31:20.773602+0000","last_active":"2024-06-02T22:34:24.277937+0000","last_peered":"2024-06-02T22:34:24.277937+0000","last_clean":"2024-06-02T22:34:24.277937+0000","last_became_active":"2024-06-02T22:31:20.773186+0000","last_became_peered":"2024-06-02T22:31:20.773186+0000","last_unstale":"2024-06-02T22:34:24.277937+0000","last_undegraded":"2024-06-02T22:34:24.277937+0000","last_fullsized":"2024-06-02T22:34:24.277937+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:25:45.238636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"99'8","reported_seq":47,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-06-02T22:34:24.242944+0000","last_change":"2024-06-02T22:31:20.750509+0000","last_active":"2024-06-02T22:34:24.242944+0000","last_peered":"2024-06-02T22:34:24.242944+0000","last_clean":"2024-06-02T22:34:24.242944+0000","last_became_active":"2024-06-02T22:31:20.750121+0000","last_became_peered":"2024-06-02T22:31:20.750121+0000","last_unstale":"2024-06-02T22:34:24.242944+0000","last_undegraded":"2024-06-02T22:34:24.242944+0000","last_fullsized":"2024-06-02T22:34:24.242944+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T22:31:19.698131+0000","last_clean_scrub_stamp":"2024-06-02T22:31:19.698131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:05:24.916621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282802,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74782,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1319,"num_read_kb":740,"num_write":265,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":224346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383742,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1118208,"data_stored":571086,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645379,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36564,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708588,"statfs":{"total":95995035648,"available":95957594112,"internally_reserved":0,"allocated":1257472,"data_stored":1223958,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808906,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":574401,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070544,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1114112,"data_stored":570571,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1175552,"data_stored":1167851,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495707,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1101824,"data_stored":566340,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36484,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708668,"statfs":{"total":95995035648,"available":95957676032,"internally_reserved":0,"allocated":1175552,"data_stored":634137,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738492,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":567796,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411443,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":568053,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32264,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712888,"statfs":{"total":95995035648,"available":95961997312,"internally_reserved":0,"allocated":1114112,"data_stored":565517,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32336,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712816,"statfs":{"total":95995035648,"available":95961923584,"internally_reserved":0,"allocated":1187840,"data_stored":636650,"data_compressed":32401,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757345,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36492,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708660,"statfs":{"total":95995035648,"available":95957667840,"internally_reserved":0,"allocated":1183744,"data_stored":1162902,"data_compressed":68367,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34324,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35966,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T22:35:01.491 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T22:35:01.491 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T22:35:01.491 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-02T22:35:01.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-02T22:35:01.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:01 smithi031 ceph-mon[31767]: pgmap v452: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:01.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:01 smithi031 ceph-mon[31767]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:35:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:01 smithi098 ceph-mon[36750]: pgmap v452: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:01 smithi098 ceph-mon[36750]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:35:02.013 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:01 smithi178 ceph-mon[36614]: pgmap v452: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:01 smithi178 ceph-mon[36614]: from='client.24922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T22:35:03.861 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:03 smithi031 ceph-mon[31767]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:03 smithi098 ceph-mon[36750]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:03 smithi178 ceph-mon[36614]: pgmap v453: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:04.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.382+0000 7f73e4c00700 1 -- 172.21.15.31:0/3937442998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e0074830 msgr2=0x7f73e0074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:04.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.382+0000 7f73e4c00700 1 --2- 172.21.15.31:0/3937442998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e0074830 0x7f73e0074c10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009990 tx=0x7f73d0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 -- 172.21.15.31:0/3937442998 shutdown_connections 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 --2- 172.21.15.31:0/3937442998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e01133b0 0x7f73e01157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 --2- 172.21.15.31:0/3937442998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e0074830 0x7f73e0074c10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 --2- 172.21.15.31:0/3937442998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 0x7f73e0112e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 -- 172.21.15.31:0/3937442998 >> 172.21.15.31:0/3937442998 conn(0x7f73e00fdeb0 msgr2=0x7f73e01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 -- 172.21.15.31:0/3937442998 shutdown_connections 2024-06-02T22:35:04.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.383+0000 7f73e4c00700 1 -- 172.21.15.31:0/3937442998 wait complete. 2024-06-02T22:35:04.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.384+0000 7f73e4c00700 1 Processor -- start 2024-06-02T22:35:04.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.384+0000 7f73e4c00700 1 -- start start 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 0x7f73e019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e01133b0 0x7f73e01a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0118d20 con 0x7f73e0074830 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0118ba0 con 0x7f73e01133b0 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73e4c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f73e0118ea0 con 0x7f73e0075150 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73df400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51872/0 (socket says 172.21.15.31:51872) 2024-06-02T22:35:04.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73df400700 1 -- 172.21.15.31:0/2326852216 learned_addr learned my addr 172.21.15.31:0/2326852216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:04.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.385+0000 7f73d6a00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 0x7f73e019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:04.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73dfe00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e01133b0 0x7f73e01a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:04.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 -- 172.21.15.31:0/2326852216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 msgr2=0x7f73e019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 0x7f73e019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 -- 172.21.15.31:0/2326852216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e01133b0 msgr2=0x7f73e01a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e01133b0 0x7f73e01a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 -- 172.21.15.31:0/2326852216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e01a4180 con 0x7f73e0074830 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.386+0000 7f73df400700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73d0005910 tx=0x7f73d000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.387+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0027070 con 0x7f73e0074830 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.387+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73d0004650 con 0x7f73e0074830 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.387+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e01a4410 con 0x7f73e0074830 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.387+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d000f460 con 0x7f73e0074830 2024-06-02T22:35:04.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.387+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e01abcf0 con 0x7f73e0074830 2024-06-02T22:35:04.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.388+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e0069180 con 0x7f73e0074830 2024-06-02T22:35:04.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.390+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f73d002a070 con 0x7f73e0074830 2024-06-02T22:35:04.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.392+0000 7f73dcc00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 0x7f73c40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:04.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.393+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f73d00d0300 con 0x7f73e0074830 2024-06-02T22:35:04.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.393+0000 7f73d6a00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 0x7f73c40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:04.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.394+0000 7f73d6a00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 0x7f73c40a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73e0106160 tx=0x7f73c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:04.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.397+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f73d005e850 con 0x7f73e0074830 2024-06-02T22:35:04.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.683+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f73e002dca0 con 0x7f73e0074830 2024-06-02T22:35:04.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.684+0000 7f73dcc00700 1 -- 172.21.15.31:0/2326852216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f73d0013070 con 0x7f73e0074830 2024-06-02T22:35:04.685 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:04.685 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T22:35:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.687+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 msgr2=0x7f73c40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.687+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 0x7f73c40a50e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73e0106160 tx=0x7f73c8009260 comp rx=0 tx=0).stop 2024-06-02T22:35:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.687+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 msgr2=0x7f73e019f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f73d0005910 tx=0x7f73d000bab0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 shutdown_connections 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73c40a2c20 0x7f73c40a50e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73e01133b0 0x7f73e01a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e0074830 0x7f73e019f170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 --2- 172.21.15.31:0/2326852216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e0075150 0x7f73e019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 >> 172.21.15.31:0/2326852216 conn(0x7f73e00fdeb0 msgr2=0x7f73e00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 shutdown_connections 2024-06-02T22:35:04.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:04.688+0000 7f73e4c00700 1 -- 172.21.15.31:0/2326852216 wait complete. 2024-06-02T22:35:05.686 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-02T22:35:05.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:35:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:05 smithi031 ceph-mon[31767]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:05.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:05 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2326852216' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T22:35:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:05 smithi098 ceph-mon[36750]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:05.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:05 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2326852216' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T22:35:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:05 smithi178 ceph-mon[36614]: pgmap v454: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:05 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2326852216' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T22:35:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:07 smithi098 ceph-mon[36750]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:08.054 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:07 smithi031 ceph-mon[31767]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:07 smithi178 ceph-mon[36614]: pgmap v455: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 -- 172.21.15.31:0/1982023435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8824108500 msgr2=0x7f88241088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 --2- 172.21.15.31:0/1982023435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8824108500 0x7f88241088e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8818009990 tx=0x7f8818009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 -- 172.21.15.31:0/1982023435 shutdown_connections 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 --2- 172.21.15.31:0/1982023435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f882406ab30 0x7f882410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 --2- 172.21.15.31:0/1982023435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8824108500 0x7f88241088e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 --2- 172.21.15.31:0/1982023435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406a170 0x7f882406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 -- 172.21.15.31:0/1982023435 >> 172.21.15.31:0/1982023435 conn(0x7f8824078340 msgr2=0x7f8824078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 -- 172.21.15.31:0/1982023435 shutdown_connections 2024-06-02T22:35:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.631+0000 7f882b600700 1 -- 172.21.15.31:0/1982023435 wait complete. 2024-06-02T22:35:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.633+0000 7f882b600700 1 Processor -- start 2024-06-02T22:35:08.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.633+0000 7f882b600700 1 -- start start 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.633+0000 7f882b600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f882b600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 0x7f88241019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f882b600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 0x7f8824101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f882b600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8824112760 con 0x7f882406a170 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f882b600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88241125e0 con 0x7f8824108500 2024-06-02T22:35:08.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f882b600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f88241128e0 con 0x7f882406ab30 2024-06-02T22:35:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8828c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:08.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8829600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 0x7f8824101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8828c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51886/0 (socket says 172.21.15.31:51886) 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8828c00700 1 -- 172.21.15.31:0/1910450753 learned_addr learned my addr 172.21.15.31:0/1910450753 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8823e00700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 0x7f88241019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.634+0000 7f8829600700 1 -- 172.21.15.31:0/1910450753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 msgr2=0x7f88241019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8829600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 0x7f88241019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8829600700 1 -- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 msgr2=0x7f8824101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8829600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8829600700 1 -- 172.21.15.31:0/1910450753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88241a7140 con 0x7f8824108500 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8823e00700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 0x7f88241019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8828c00700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8829600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 0x7f8824101ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f881c00efb0 tx=0x7f881c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:08.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c003a00 con 0x7f8824108500 2024-06-02T22:35:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88241a7430 con 0x7f8824108500 2024-06-02T22:35:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f881c003ba0 con 0x7f8824108500 2024-06-02T22:35:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.635+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881c004850 con 0x7f8824108500 2024-06-02T22:35:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.636+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88241a7970 con 0x7f8824108500 2024-06-02T22:35:08.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.637+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882410a9e0 con 0x7f8824108500 2024-06-02T22:35:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.639+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f881c012050 con 0x7f8824108500 2024-06-02T22:35:08.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.640+0000 7f8821600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 0x7f880c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.640+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f881c0cec30 con 0x7f8824108500 2024-06-02T22:35:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.640+0000 7f8828c00700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 0x7f880c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:08.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.641+0000 7f8828c00700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 0x7f880c0a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f881800b2e0 tx=0x7f8818009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.645+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f881c022060 con 0x7f8824108500 2024-06-02T22:35:08.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.924+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f882410a3c0 con 0x7f8824108500 2024-06-02T22:35:08.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.925+0000 7f8821600700 1 -- 172.21.15.31:0/1910450753 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f881c010040 con 0x7f8824108500 2024-06-02T22:35:08.926 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:08.926 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:35:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 msgr2=0x7f880c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 0x7f880c0a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f881800b2e0 tx=0x7f8818009590 comp rx=0 tx=0).stop 2024-06-02T22:35:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 msgr2=0x7f8824101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:08.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 0x7f8824101ee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f881c00efb0 tx=0x7f881c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 shutdown_connections 2024-06-02T22:35:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f880c0a2c20 0x7f880c0a50e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8824108500 0x7f8824101ee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f882406a170 0x7f8824101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 --2- 172.21.15.31:0/1910450753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406ab30 0x7f88241019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 >> 172.21.15.31:0/1910450753 conn(0x7f8824078340 msgr2=0x7f88240fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.928+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 shutdown_connections 2024-06-02T22:35:08.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:08.929+0000 7f882b600700 1 -- 172.21.15.31:0/1910450753 wait complete. 2024-06-02T22:35:08.931 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:35:09.890 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:09 smithi031 ceph-mon[31767]: pgmap v456: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:09.890 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:09 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1910450753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:09.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:35:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:09 smithi098 ceph-mon[36750]: pgmap v456: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:09 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1910450753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:10.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:09 smithi178 ceph-mon[36614]: pgmap v456: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:10.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:09 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1910450753' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:10.393 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:11.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:11 smithi031 ceph-mon[31767]: pgmap v457: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:11 smithi098 ceph-mon[36750]: pgmap v457: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:11 smithi178 ceph-mon[36614]: pgmap v457: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:12.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.883+0000 7efe26400700 1 -- 172.21.15.31:0/182948514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe20108ac0 msgr2=0x7efe20108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:12.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.883+0000 7efe26400700 1 --2- 172.21.15.31:0/182948514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe20108ac0 0x7efe20108f40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009990 tx=0x7efe0c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 -- 172.21.15.31:0/182948514 shutdown_connections 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 --2- 172.21.15.31:0/182948514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe20115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 --2- 172.21.15.31:0/182948514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2010eac0 0x7efe2010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 --2- 172.21.15.31:0/182948514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe20108ac0 0x7efe20108f40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 -- 172.21.15.31:0/182948514 >> 172.21.15.31:0/182948514 conn(0x7efe20075c60 msgr2=0x7efe201072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 -- 172.21.15.31:0/182948514 shutdown_connections 2024-06-02T22:35:12.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.884+0000 7efe26400700 1 -- 172.21.15.31:0/182948514 wait complete. 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 Processor -- start 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 -- start start 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe20108ac0 0x7efe2019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 0x7efe201a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe20118e10 con 0x7efe20109480 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efe20118c90 con 0x7efe2010eac0 2024-06-02T22:35:12.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.885+0000 7efe26400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe20118f90 con 0x7efe20108ac0 2024-06-02T22:35:12.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58984/0 (socket says 172.21.15.31:58984) 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 -- 172.21.15.31:0/2909543791 learned_addr learned my addr 172.21.15.31:0/2909543791 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1fe00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 0x7efe201a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1f400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe20108ac0 0x7efe2019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 -- 172.21.15.31:0/2909543791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe20108ac0 msgr2=0x7efe2019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe20108ac0 0x7efe2019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 -- 172.21.15.31:0/2909543791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 msgr2=0x7efe201a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 0x7efe201a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1ea00700 1 -- 172.21.15.31:0/2909543791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe201a4270 con 0x7efe20109480 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.886+0000 7efe1fe00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 0x7efe201a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:12.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe1ea00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00bae0 tx=0x7efe0c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c026070 con 0x7efe20109480 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c003d70 con 0x7efe20109480 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe201a4500 con 0x7efe20109480 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c021410 con 0x7efe20109480 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.887+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe201abde0 con 0x7efe20109480 2024-06-02T22:35:12.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.888+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe20069180 con 0x7efe20109480 2024-06-02T22:35:12.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.890+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7efe0c029070 con 0x7efe20109480 2024-06-02T22:35:12.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.892+0000 7efe17e00700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 0x7efe040a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:12.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.892+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efe0c0d0140 con 0x7efe20109480 2024-06-02T22:35:12.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.892+0000 7efe1f400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 0x7efe040a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:12.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.893+0000 7efe1f400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 0x7efe040a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efe10009be0 tx=0x7efe10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:12.896+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efe0c05d850 con 0x7efe20109480 2024-06-02T22:35:13.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.178+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe2002dca0 con 0x7efe20109480 2024-06-02T22:35:13.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.180+0000 7efe17e00700 1 -- 172.21.15.31:0/2909543791 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7efe0c098020 con 0x7efe20109480 2024-06-02T22:35:13.180 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:13.181 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:35:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 msgr2=0x7efe040a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 0x7efe040a50e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efe10009be0 tx=0x7efe10009260 comp rx=0 tx=0).stop 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 msgr2=0x7efe2019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00bae0 tx=0x7efe0c00bb10 comp rx=0 tx=0).stop 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 shutdown_connections 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe040a2c20 0x7efe040a50e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe2010eac0 0x7efe201a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe20108ac0 0x7efe2019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 --2- 172.21.15.31:0/2909543791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe20109480 0x7efe2019f7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 >> 172.21.15.31:0/2909543791 conn(0x7efe20075c60 msgr2=0x7efe200761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 shutdown_connections 2024-06-02T22:35:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:13.183+0000 7efe26400700 1 -- 172.21.15.31:0/2909543791 wait complete. 2024-06-02T22:35:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:35:13.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:13 smithi031 ceph-mon[31767]: pgmap v458: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:13.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:13 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2909543791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:13 smithi098 ceph-mon[36750]: pgmap v458: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:13 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2909543791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:14.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:35:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:13 smithi178 ceph-mon[36614]: pgmap v458: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:13 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2909543791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:14.502 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:15 smithi098 ceph-mon[36750]: pgmap v459: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:15.964 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:15 smithi031 ceph-mon[31767]: pgmap v459: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:15 smithi178 ceph-mon[36614]: pgmap v459: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 -- 172.21.15.31:0/2402960744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 msgr2=0x7f2a7c113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 --2- 172.21.15.31:0/2402960744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c113120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b0a0 tx=0x7f2a6400b3b0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 -- 172.21.15.31:0/2402960744 shutdown_connections 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 --2- 172.21.15.31:0/2402960744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c113660 0x7f2a7c115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 --2- 172.21.15.31:0/2402960744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 --2- 172.21.15.31:0/2402960744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c113120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 -- 172.21.15.31:0/2402960744 >> 172.21.15.31:0/2402960744 conn(0x7f2a7c0795f0 msgr2=0x7f2a7c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 -- 172.21.15.31:0/2402960744 shutdown_connections 2024-06-02T22:35:16.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.791+0000 7f2a82600700 1 -- 172.21.15.31:0/2402960744 wait complete. 2024-06-02T22:35:16.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.792+0000 7f2a82600700 1 Processor -- start 2024-06-02T22:35:16.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.792+0000 7f2a82600700 1 -- start start 2024-06-02T22:35:16.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:16.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c113660 0x7f2a7c1a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c118db0 con 0x7f2a7c074fe0 2024-06-02T22:35:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c118c30 con 0x7f2a7c0746c0 2024-06-02T22:35:16.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a82600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c118f30 con 0x7f2a7c113660 2024-06-02T22:35:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a7b400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a72a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a7b400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47898/0 (socket says 172.21.15.31:47898) 2024-06-02T22:35:16.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.793+0000 7f2a7b400700 1 -- 172.21.15.31:0/1365978992 learned_addr learned my addr 172.21.15.31:0/1365978992 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a7be00700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c113660 0x7f2a7c1a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 -- 172.21.15.31:0/1365978992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c113660 msgr2=0x7f2a7c1a3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c113660 0x7f2a7c1a3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 -- 172.21.15.31:0/1365978992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 msgr2=0x7f2a7c19f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 -- 172.21.15.31:0/1365978992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c1a42b0 con 0x7f2a7c074fe0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a7b400700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.794+0000 7f2a72a00700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c19f7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b070 tx=0x7f2a64004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.795+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64021070 con 0x7f2a7c074fe0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.795+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a64007b80 con 0x7f2a7c074fe0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.795+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1a4540 con 0x7f2a7c074fe0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.795+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64005040 con 0x7f2a7c074fe0 2024-06-02T22:35:16.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.795+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1abe20 con 0x7f2a7c074fe0 2024-06-02T22:35:16.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.796+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c069180 con 0x7f2a7c074fe0 2024-06-02T22:35:16.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.798+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2a64024070 con 0x7f2a7c074fe0 2024-06-02T22:35:16.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.799+0000 7f2a78c00700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 0x7f2a600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:16.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.799+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2a6400f020 con 0x7f2a7c074fe0 2024-06-02T22:35:16.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.800+0000 7f2a7b400700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 0x7f2a600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:16.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.800+0000 7f2a7b400700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 0x7f2a600a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c011590 tx=0x7f2a6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:16.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:16.802+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a6402b020 con 0x7f2a7c074fe0 2024-06-02T22:35:17.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.039+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a7c1abff0 con 0x7f2a7c074fe0 2024-06-02T22:35:17.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.044+0000 7f2a78c00700 1 -- 172.21.15.31:0/1365978992 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7f2a6409d6e0 con 0x7f2a7c074fe0 2024-06-02T22:35:17.045 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:17.045 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:35:17.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.047+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 msgr2=0x7f2a600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:17.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.047+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 0x7f2a600a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c011590 tx=0x7f2a6c009260 comp rx=0 tx=0).stop 2024-06-02T22:35:17.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.047+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 msgr2=0x7f2a7c19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:17.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.047+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c19f7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b070 tx=0x7f2a64004d00 comp rx=0 tx=0).stop 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 shutdown_connections 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2a600a2c20 0x7f2a600a50e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a7c113660 0x7f2a7c1a3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a7c0746c0 0x7f2a7c19f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 --2- 172.21.15.31:0/1365978992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a7c074fe0 0x7f2a7c19f7e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 >> 172.21.15.31:0/1365978992 conn(0x7f2a7c0795f0 msgr2=0x7f2a7c112500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 shutdown_connections 2024-06-02T22:35:17.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:17.048+0000 7f2a82600700 1 -- 172.21.15.31:0/1365978992 wait complete. 2024-06-02T22:35:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:17 smithi098 ceph-mon[36750]: pgmap v460: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:17 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1365978992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:35:17.972 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:17 smithi031 ceph-mon[31767]: pgmap v460: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:17.972 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:17 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1365978992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:35:18.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:35:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:17 smithi178 ceph-mon[36614]: pgmap v460: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:17 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1365978992' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:35:18.528 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:19 smithi098 ceph-mon[36750]: pgmap v461: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:19 smithi178 ceph-mon[36614]: pgmap v461: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:19 smithi031 ceph-mon[31767]: pgmap v461: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:21.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 -- 172.21.15.31:0/716912250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6481046a0 msgr2=0x7fd648104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:21.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 --2- 172.21.15.31:0/716912250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6481046a0 0x7fd648104b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd634009990 tx=0x7fd634009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 -- 172.21.15.31:0/716912250 shutdown_connections 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 --2- 172.21.15.31:0/716912250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd648105060 0x7fd648111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 --2- 172.21.15.31:0/716912250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd64810a6a0 0x7fd64810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 --2- 172.21.15.31:0/716912250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6481046a0 0x7fd648104b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.102+0000 7fd64d200700 1 -- 172.21.15.31:0/716912250 >> 172.21.15.31:0/716912250 conn(0x7fd648100170 msgr2=0x7fd648102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.103+0000 7fd64d200700 1 -- 172.21.15.31:0/716912250 shutdown_connections 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.103+0000 7fd64d200700 1 -- 172.21.15.31:0/716912250 wait complete. 2024-06-02T22:35:21.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.104+0000 7fd64d200700 1 Processor -- start 2024-06-02T22:35:21.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 -- start start 2024-06-02T22:35:21.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 0x7fd64819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:21.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:21.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd64810a6a0 0x7fd64819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:21.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd648114a30 con 0x7fd64810a6a0 2024-06-02T22:35:21.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481148b0 con 0x7fd648105060 2024-06-02T22:35:21.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.105+0000 7fd64d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd648114bb0 con 0x7fd6481046a0 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 0x7fd64819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd646800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd64810a6a0 0x7fd64819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 0x7fd64819ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37376/0 (socket says 172.21.15.31:37376) 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47764/0 (socket says 172.21.15.31:47764) 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645e00700 1 -- 172.21.15.31:0/3916896411 learned_addr learned my addr 172.21.15.31:0/3916896411 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 -- 172.21.15.31:0/3916896411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 msgr2=0x7fd64819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 0x7fd64819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 -- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd64810a6a0 msgr2=0x7fd64819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd64810a6a0 0x7fd64819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.106+0000 7fd645400700 1 -- 172.21.15.31:0/3916896411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64819fe50 con 0x7fd648105060 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd645400700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6340098e0 tx=0x7fd63400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634027070 con 0x7fd648105060 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd634003b60 con 0x7fd648105060 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6481a00e0 con 0x7fd648105060 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634022d50 con 0x7fd648105060 2024-06-02T22:35:21.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.107+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6481a79c0 con 0x7fd648105060 2024-06-02T22:35:21.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.109+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd648105de0 con 0x7fd648105060 2024-06-02T22:35:21.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.110+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd63402a070 con 0x7fd648105060 2024-06-02T22:35:21.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.112+0000 7fd63ea00700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 0x7fd62c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:21.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.112+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd6340d0310 con 0x7fd648105060 2024-06-02T22:35:21.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.112+0000 7fd645e00700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 0x7fd62c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:21.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.113+0000 7fd645e00700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 0x7fd62c0a50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd638009ca0 tx=0x7fd638009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:21.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.116+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd63405e850 con 0x7fd648105060 2024-06-02T22:35:21.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.396+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd64802dca0 con 0x7fd648105060 2024-06-02T22:35:21.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.398+0000 7fd63ea00700 1 -- 172.21.15.31:0/3916896411 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7fd634013070 con 0x7fd648105060 2024-06-02T22:35:21.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:35:21.399 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:35:21.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 msgr2=0x7fd62c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:21.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 0x7fd62c0a50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd638009ca0 tx=0x7fd638009260 comp rx=0 tx=0).stop 2024-06-02T22:35:21.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 msgr2=0x7fd64819b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:21.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6340098e0 tx=0x7fd63400b8a0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 shutdown_connections 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd62c0a2c20 0x7fd62c0a50e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd64810a6a0 0x7fd64819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6481046a0 0x7fd64819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 --2- 172.21.15.31:0/3916896411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd648105060 0x7fd64819b380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 >> 172.21.15.31:0/3916896411 conn(0x7fd648100170 msgr2=0x7fd6481006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 shutdown_connections 2024-06-02T22:35:21.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:21.401+0000 7fd64d200700 1 -- 172.21.15.31:0/3916896411 wait complete. 2024-06-02T22:35:21.403 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:35:21.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:21 smithi098 ceph-mon[36750]: pgmap v462: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:21.965 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:21 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3916896411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:22.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:21 smithi178 ceph-mon[36614]: pgmap v462: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:22.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:21 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3916896411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:22.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:21 smithi031 ceph-mon[31767]: pgmap v462: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:22.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:21 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3916896411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:35:22.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T22:31:23.645237+0000', 'modified': '2024-06-02T22:32:54.555737+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24517, 'mds_1': 24505, 'mds_2': 24503, 'mds_3': 24499, 'mds_4': 24484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24431': {'gid': 24431, 'name': 'j', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.31:6835/2351522534', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2351522534}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2351522534}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/1728134779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 1728134779}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 1728134779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/2455073763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 2455073763}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 2455073763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6837/511134673', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 511134673}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 511134673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/262655409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 262655409}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 262655409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 34, 'addr': '172.21.15.178:6837/2069330007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 2069330007}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 2069330007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.178:6839/4016839880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 4016839880}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 4016839880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 29, 'addr': '172.21.15.98:6839/2003931119', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2003931119}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2003931119}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 30, 'addr': '172.21.15.31:6839/4188521464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6838', 'nonce': 4188521464}, {'type': 'v1', 'addr': '172.21.15.31:6839', 'nonce': 4188521464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.31:6841/3282614730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6840', 'nonce': 3282614730}, {'type': 'v1', 'addr': '172.21.15.31:6841', 'nonce': 3282614730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24517, 'qdb_cluster': [24484, 24505, 24499, 24503, 24517]} 2024-06-02T22:35:22.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-02T22:35:22.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-02T22:35:22.753 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:23 smithi098 ceph-mon[36750]: pgmap v463: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:23 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:35:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:23 smithi178 ceph-mon[36614]: pgmap v463: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:23 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:35:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:23 smithi031 ceph-mon[31767]: pgmap v463: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:23 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 -- 172.21.15.31:0/152790801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87081084f0 msgr2=0x7f87081088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 --2- 172.21.15.31:0/152790801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87081084f0 0x7f87081088d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009990 tx=0x7f86f8009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 -- 172.21.15.31:0/152790801 shutdown_connections 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 --2- 172.21.15.31:0/152790801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f870806b3c0 0x7f870810f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 --2- 172.21.15.31:0/152790801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87081084f0 0x7f87081088d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 --2- 172.21.15.31:0/152790801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806aa00 0x7f870806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 -- 172.21.15.31:0/152790801 >> 172.21.15.31:0/152790801 conn(0x7f8708078300 msgr2=0x7f8708078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 -- 172.21.15.31:0/152790801 shutdown_connections 2024-06-02T22:35:25.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.165+0000 7f870f200700 1 -- 172.21.15.31:0/152790801 wait complete. 2024-06-02T22:35:25.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.166+0000 7f870f200700 1 Processor -- start 2024-06-02T22:35:25.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 -- start start 2024-06-02T22:35:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 0x7f870819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87081084f0 0x7f870819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8708112750 con 0x7f870806b3c0 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87081125d0 con 0x7f87081084f0 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f870f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f87081128d0 con 0x7f870806aa00 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37396/0 (socket says 172.21.15.31:37396) 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.167+0000 7f8707e00700 1 -- 172.21.15.31:0/3425607982 learned_addr learned my addr 172.21.15.31:0/3425607982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707400700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 0x7f870819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f870d200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87081084f0 0x7f870819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 -- 172.21.15.31:0/3425607982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87081084f0 msgr2=0x7f870819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87081084f0 0x7f870819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 -- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 msgr2=0x7f870819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 0x7f870819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 -- 172.21.15.31:0/3425607982 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870819fe10 con 0x7f870806aa00 2024-06-02T22:35:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707400700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 0x7f870819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.168+0000 7f8707e00700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.169+0000 7f8704c00700 1 -- 172.21.15.31:0/3425607982 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8027070 con 0x7f870806aa00 2024-06-02T22:35:25.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.169+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87081a00a0 con 0x7f870806aa00 2024-06-02T22:35:25.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.169+0000 7f8704c00700 1 -- 172.21.15.31:0/3425607982 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f8003d70 con 0x7f870806aa00 2024-06-02T22:35:25.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.169+0000 7f8704c00700 1 -- 172.21.15.31:0/3425607982 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f800f6c0 con 0x7f870806aa00 2024-06-02T22:35:25.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.169+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87081a7980 con 0x7f870806aa00 2024-06-02T22:35:25.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.172+0000 7f8704c00700 1 -- 172.21.15.31:0/3425607982 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f86f802a070 con 0x7f870806aa00 2024-06-02T22:35:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.173+0000 7f8719c37b80 1 Processor -- start 2024-06-02T22:35:25.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 -- start start 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 0x56000edae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 0x56000edbb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56000ecbd9c0 con 0x56000edae560 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56000ed00ab0 con 0x56000edb92b0 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8719c37b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56000ecbb8a0 con 0x56000ed2adf0 2024-06-02T22:35:25.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.174+0000 7f8704c00700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 0x7f86ec0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 0x56000edae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 0x56000edae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53650/0 (socket says 172.21.15.31:53650) 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707e00700 1 -- 172.21.15.31:0/2216884218 learned_addr learned my addr 172.21.15.31:0/2216884218 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 0x56000edbb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f870d200700 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f870d200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 0x7f86ec0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 -- 172.21.15.31:0/2216884218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 msgr2=0x56000edae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 -- 172.21.15.31:0/2216884218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 msgr2=0x56000edae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 0x56000edae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8707400700 1 -- 172.21.15.31:0/2216884218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000eca8f40 con 0x56000edb92b0 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.175+0000 7f8704c00700 1 -- 172.21.15.31:0/3425607982 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f86f80d0510 con 0x7f870806aa00 2024-06-02T22:35:25.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.176+0000 7f8707400700 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 0x56000edbb6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86f400bc30 tx=0x7f86f400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c599dd06dabab47 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.176+0000 7f86fd600700 1 -- 172.21.15.31:0/2216884218 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4015070 con 0x56000edb92b0 2024-06-02T22:35:25.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.176+0000 7f870d200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 0x7f86ec0a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ec0 tx=0x7f870000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.176+0000 7f86fd600700 1 -- 172.21.15.31:0/2216884218 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4004d10 con 0x56000edb92b0 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.176+0000 7f86fd600700 1 -- 172.21.15.31:0/2216884218 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4011440 con 0x56000edb92b0 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 -- 172.21.15.31:0/2216884218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 msgr2=0x56000edbb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 0x56000edbb6a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f86f400bc30 tx=0x7f86f400bf40 comp rx=0 tx=0).stop 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 -- 172.21.15.31:0/2216884218 shutdown_connections 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edb92b0 0x56000edbb6a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 --2- 172.21.15.31:0/2216884218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edae560 0x56000edae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 -- 172.21.15.31:0/2216884218 >> 172.21.15.31:0/2216884218 conn(0x56000ecdb120 msgr2=0x56000edaa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 -- 172.21.15.31:0/2216884218 shutdown_connections 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.177+0000 7f8719c37b80 1 -- 172.21.15.31:0/2216884218 wait complete. 2024-06-02T22:35:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.178+0000 7f8719c37b80 1 -- start start 2024-06-02T22:35:25.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.178+0000 7f8719c37b80 1 Processor -- start 2024-06-02T22:35:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000ed2adf0 0x56000edb8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56000ec9cf10 con 0x56000edb92b0 2024-06-02T22:35:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56000ecfca70 con 0x56000ed2adf0 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56000edbbf70 con 0x56000edae560 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8719c37b80 10 client.0 _ll_register_callbacks cb 0x56000ec9a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8707400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f870d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8707400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37410/0 (socket says 172.21.15.31:37410) 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8707400700 1 -- 172.21.15.31:0/1344448238 learned_addr learned my addr 172.21.15.31:0/1344448238 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.179+0000 7f8707e00700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000ed2adf0 0x56000edb8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 -- 172.21.15.31:0/1344448238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000ed2adf0 msgr2=0x56000edb8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000ed2adf0 0x56000edb8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 -- 172.21.15.31:0/1344448238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 msgr2=0x56000edb6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 -- 172.21.15.31:0/1344448238 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000ec4f880 con 0x56000edae560 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8707400700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86f400f640 tx=0x7f86f40055b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81cf438895a4be0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f86f2000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4015070 con 0x56000edae560 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f4004d10 con 0x56000edae560 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.180+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f86f4004960 con 0x56000edae560 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.181+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86f402d050 con 0x56000edae560 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.181+0000 7f8719c37b80 10 client.24964 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.181+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56000edc6680 con 0x56000edae560 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.181+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4004d10 con 0x56000edae560 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f86f4003680 con 0x56000edae560 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 10 client.24964 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 10 client.24964 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 20 client.24964 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000edc8880 0x56000edc9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 4 client.24964 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 --> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56000ed0dfb0 con 0x56000edc8880 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.182+0000 7f8707e00700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000edc8880 0x56000edc9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.183+0000 7f8707e00700 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000edc8880 0x56000edc9cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d84c3519853dc0c server_cookie=69be22a75cb36fa1 in_seq=0 out_seq=0 2024-06-02T22:35:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.183+0000 7f86f2000700 10 client.24964 ms_handle_connect on v2:172.21.15.178:6836/2069330007 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.183+0000 7f86f2000700 1 -- 172.21.15.31:0/1344448238 <== mds.4 v2:172.21.15.178:6836/2069330007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56000ed0dfb0 con 0x56000edc8880 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.183+0000 7f86f2000700 10 client.24964 handle_command_reply: tid=0 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 client.24964 shutdown 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 msgr2=0x56000edb5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86f400f640 tx=0x7f86f40055b0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 shutdown_connections 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000edc8880 0x56000edc9cf0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000ed2adf0 0x56000edb8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 --2- 172.21.15.31:0/1344448238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000edae560 0x56000edb5d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 >> 172.21.15.31:0/1344448238 conn(0x56000ecdb120 msgr2=0x56000eda96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f86f2000700 0 client.24964 ms_handle_reset on v2:172.21.15.178:6836/2069330007 2024-06-02T22:35:25.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 shutdown_connections 2024-06-02T22:35:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 1 -- 172.21.15.31:0/1344448238 wait complete. 2024-06-02T22:35:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.184+0000 7f8719c37b80 20 client.24964 trim_cache size 0 max 16384 2024-06-02T22:35:25.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 Processor -- start 2024-06-02T22:35:25.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 -- start start 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56000edc8030 con 0x56000edb92b0 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56000edc8700 con 0x56000edae560 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.208+0000 7f8719c37b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56000edc8dd0 con 0x56000ed2adf0 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f870d200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37416/0 (socket says 172.21.15.31:37416) 2024-06-02T22:35:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 -- 172.21.15.31:0/3253228954 learned_addr learned my addr 172.21.15.31:0/3253228954 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707400700 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 -- 172.21.15.31:0/3253228954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 msgr2=0x56000edb6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 -- 172.21.15.31:0/3253228954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 msgr2=0x56000edba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edba6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 -- 172.21.15.31:0/3253228954 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000edb6bf0 con 0x56000ed2adf0 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.209+0000 7f8707e00700 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86f80993e0 tx=0x7f86f80a0040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f3542e146d36bb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f86fcc00700 1 -- 172.21.15.31:0/3253228954 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80b5070 con 0x56000ed2adf0 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f86fcc00700 1 -- 172.21.15.31:0/3253228954 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f80a55f0 con 0x56000ed2adf0 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f86fcc00700 1 -- 172.21.15.31:0/3253228954 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80a30b0 con 0x56000ed2adf0 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 -- 172.21.15.31:0/3253228954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 msgr2=0x56000edbb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86f80993e0 tx=0x7f86f80a0040 comp rx=0 tx=0).stop 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 -- 172.21.15.31:0/3253228954 shutdown_connections 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edbb730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 --2- 172.21.15.31:0/3253228954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 -- 172.21.15.31:0/3253228954 >> 172.21.15.31:0/3253228954 conn(0x56000ecdb120 msgr2=0x56000edb4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.210+0000 7f8719c37b80 1 -- 172.21.15.31:0/3253228954 shutdown_connections 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.211+0000 7f8719c37b80 1 -- 172.21.15.31:0/3253228954 wait complete. 2024-06-02T22:35:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.211+0000 7f8719c37b80 1 -- start start 2024-06-02T22:35:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.211+0000 7f8719c37b80 1 Processor -- start 2024-06-02T22:35:25.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edaff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56000edc9b70 con 0x56000edb92b0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56000edc94a0 con 0x56000edae560 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56000edca240 con 0x56000ed2adf0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8719c37b80 10 client.0 _ll_register_callbacks cb 0x56000ec9a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edaff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edaff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37422/0 (socket says 172.21.15.31:37422) 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707e00700 1 -- 172.21.15.31:0/4163884128 learned_addr learned my addr 172.21.15.31:0/4163884128 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f870d200700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 -- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 msgr2=0x56000edaff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edaff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 -- 172.21.15.31:0/4163884128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 msgr2=0x56000edb09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.212+0000 7f8707400700 1 -- 172.21.15.31:0/4163884128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000edd21e0 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f8707400700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb04b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86f4003a80 tx=0x7f86f40056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a8385dff787b631 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f86f2000700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4015040 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86f80a55f0 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f86f4020040 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86f4003680 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f8719c37b80 10 client.24953 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.213+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56000edd3480 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f80a55f0 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f86f4004960 con 0x56000edae560 2024-06-02T22:35:25.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 10 client.24953 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:25.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 10 client.24953 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:35:25.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 20 client.24953 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:25.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000ee38120 0x56000ee36e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:25.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 4 client.24953 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:35:25.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.214+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 --> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] -- command(tid 0: {"prefix": "status"}) -- 0x56000ed08530 con 0x56000ee38120 2024-06-02T22:35:25.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f8707e00700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000ee38120 0x56000ee36e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:25.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f8707e00700 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000ee38120 0x56000ee36e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3e75dde65e9fdb7f server_cookie=38e1f0b90f7efe1f in_seq=0 out_seq=0 2024-06-02T22:35:25.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f86f2000700 10 client.24953 ms_handle_connect on v2:172.21.15.178:6836/2069330007 2024-06-02T22:35:25.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f86f2000700 1 -- 172.21.15.31:0/4163884128 <== mds.4 v2:172.21.15.178:6836/2069330007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56000ed08530 con 0x56000ee38120 2024-06-02T22:35:25.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f86f2000700 10 client.24953 handle_command_reply: tid=0 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.215+0000 7f8719c37b80 1 client.24953 shutdown 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 msgr2=0x56000edb04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb04b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86f4003a80 tx=0x7f86f40056d0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 shutdown_connections 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x56000ee38120 0x56000ee36e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56000edb92b0 0x56000edb09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56000ed2adf0 0x56000edaff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 --2- 172.21.15.31:0/4163884128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56000edae560 0x56000edb04b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f86f2000700 0 client.24953 ms_handle_reset on v2:172.21.15.178:6836/2069330007 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 >> 172.21.15.31:0/4163884128 conn(0x56000ecdb120 msgr2=0x56000eda8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 shutdown_connections 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 1 -- 172.21.15.31:0/4163884128 wait complete. 2024-06-02T22:35:25.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.216+0000 7f8719c37b80 20 client.24953 trim_cache size 0 max 16384 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 4, 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24484, 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 155.75948670400001, 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:35:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 284.33258330400002 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 msgr2=0x7f86ec0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 0x7f86ec0a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8700009ec0 tx=0x7f870000b040 comp rx=0 tx=0).stop 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 msgr2=0x7f870819ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f800bab0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 shutdown_connections 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86ec0a2c20 0x7f86ec0a50e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87081084f0 0x7f870819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f870806aa00 0x7f870819ae00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 --2- 172.21.15.31:0/3425607982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f870806b3c0 0x7f870819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 >> 172.21.15.31:0/3425607982 conn(0x7f8708078300 msgr2=0x7f870810d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 shutdown_connections 2024-06-02T22:35:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:25.217+0000 7f870f200700 1 -- 172.21.15.31:0/3425607982 wait complete. 2024-06-02T22:35:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:25 smithi178 ceph-mon[36614]: pgmap v464: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:35:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:35:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:35:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:25 smithi031 ceph-mon[31767]: pgmap v464: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:35:26.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:35:26.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:35:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:25 smithi098 ceph-mon[36750]: pgmap v464: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:35:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:35:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:35:26.346 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-02T22:35:26.828 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:27.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:27 smithi031 ceph-mon[31767]: pgmap v465: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:27 smithi178 ceph-mon[36614]: pgmap v465: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:27 smithi098 ceph-mon[36750]: pgmap v465: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 -- 172.21.15.31:0/2206064992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 msgr2=0x7fd3c010aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 --2- 172.21.15.31:0/2206064992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c010aa50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009920 tx=0x7fd3b0009c30 comp rx=0 tx=0).stop 2024-06-02T22:35:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 -- 172.21.15.31:0/2206064992 shutdown_connections 2024-06-02T22:35:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 --2- 172.21.15.31:0/2206064992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 0x7fd3c0111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 --2- 172.21.15.31:0/2206064992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c010aa50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 --2- 172.21.15.31:0/2206064992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 -- 172.21.15.31:0/2206064992 >> 172.21.15.31:0/2206064992 conn(0x7fd3c0100070 msgr2=0x7fd3c0102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 -- 172.21.15.31:0/2206064992 shutdown_connections 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.206+0000 7fd3c5400700 1 -- 172.21.15.31:0/2206064992 wait complete. 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.208+0000 7fd3c5400700 1 Processor -- start 2024-06-02T22:35:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.208+0000 7fd3c5400700 1 -- start start 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 0x7fd3c019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0114930 con 0x7fd3c01045c0 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01147b0 con 0x7fd3c010a670 2024-06-02T22:35:29.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c5400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0114ab0 con 0x7fd3c0104f80 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53706/0 (socket says 172.21.15.31:53706) 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 -- 172.21.15.31:0/1662380287 learned_addr learned my addr 172.21.15.31:0/1662380287 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 0x7fd3c019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 -- 172.21.15.31:0/1662380287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 msgr2=0x7fd3c019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 0x7fd3c019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 -- 172.21.15.31:0/1662380287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 msgr2=0x7fd3c019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.209+0000 7fd3bfe00700 1 -- 172.21.15.31:0/1662380287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c019fd90 con 0x7fd3c01045c0 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0000c00 tx=0x7fd3b000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3bd600700 1 -- 172.21.15.31:0/1662380287 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0027070 con 0x7fd3c01045c0 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c01a0020 con 0x7fd3c01045c0 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3bd600700 1 -- 172.21.15.31:0/1662380287 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b0005660 con 0x7fd3c01045c0 2024-06-02T22:35:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3bd600700 1 -- 172.21.15.31:0/1662380287 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0004930 con 0x7fd3c01045c0 2024-06-02T22:35:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.210+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c01a7900 con 0x7fd3c01045c0 2024-06-02T22:35:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.215+0000 7fd3bd600700 1 -- 172.21.15.31:0/1662380287 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd3b002a070 con 0x7fd3c01045c0 2024-06-02T22:35:29.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.216+0000 7fd3bd600700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 0x7fd3a40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.216+0000 7fd3d1461b80 1 Processor -- start 2024-06-02T22:35:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 -- start start 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3bd600700 1 -- 172.21.15.31:0/1662380287 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd3b00cfd80 con 0x7fd3c01045c0 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 0x7fd3a40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f47435910 0x558f47435d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f473429c0 con 0x558f473afdf0 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558f47385ab0 con 0x558f4743e520 2024-06-02T22:35:29.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558f473408a0 con 0x558f47435910 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3c4a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.217+0000 7fd3c4a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47840/0 (socket says 172.21.15.31:47840) 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53718/0 (socket says 172.21.15.31:53718) 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3c4a00700 1 -- 172.21.15.31:0/3660416596 learned_addr learned my addr 172.21.15.31:0/3660416596 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3b7400700 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f47435910 0x558f47435d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 0x7fd3a40a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0109d60 tx=0x7fd3a80099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 -- 172.21.15.31:0/3660416596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f47435910 msgr2=0x558f47435d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f47435910 0x558f47435d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 -- 172.21.15.31:0/3660416596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 msgr2=0x558f47440910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 -- 172.21.15.31:0/3660416596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f4732df40 con 0x558f473afdf0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.218+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0029000 tx=0x7fd3b0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1085fe1257bf3b73 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.219+0000 7fd3b5600700 1 -- 172.21.15.31:0/3660416596 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b009c980 con 0x558f473afdf0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.219+0000 7fd3b5600700 1 -- 172.21.15.31:0/3660416596 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b009c280 con 0x558f473afdf0 2024-06-02T22:35:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.219+0000 7fd3b5600700 1 -- 172.21.15.31:0/3660416596 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b009a660 con 0x558f473afdf0 2024-06-02T22:35:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.219+0000 7fd3d1461b80 1 -- 172.21.15.31:0/3660416596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 msgr2=0x558f474353d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.219+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0029000 tx=0x7fd3b0009c30 comp rx=0 tx=0).stop 2024-06-02T22:35:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 -- 172.21.15.31:0/3660416596 shutdown_connections 2024-06-02T22:35:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f47440910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f474353d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/3660416596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f47435910 0x558f47435d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 -- 172.21.15.31:0/3660416596 >> 172.21.15.31:0/3660416596 conn(0x558f47360120 msgr2=0x558f4742f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 -- 172.21.15.31:0/3660416596 shutdown_connections 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 -- 172.21.15.31:0/3660416596 wait complete. 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.220+0000 7fd3d1461b80 1 -- start start 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 Processor -- start 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f47321f10 con 0x558f47435910 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558f47381a70 con 0x558f4743e520 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558f47440f40 con 0x558f473afdf0 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3d1461b80 10 client.0 _ll_register_callbacks cb 0x558f4731f6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:29.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37462/0 (socket says 172.21.15.31:37462) 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3b7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.221+0000 7fd3bfe00700 1 -- 172.21.15.31:0/2409070373 learned_addr learned my addr 172.21.15.31:0/2409070373 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 -- 172.21.15.31:0/2409070373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 msgr2=0x558f4743b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 -- 172.21.15.31:0/2409070373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 msgr2=0x558f4743af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 -- 172.21.15.31:0/2409070373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f472d4880 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000fbe0 tx=0x7fd3b00a0720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e37626d736d9ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3ae000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.222+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00b9020 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd3b00bc0c0 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b009c280 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3b0085050 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3d1461b80 10 client.24982 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558f4744b5a0 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b009c280 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3b00a49d0 con 0x558f473afdf0 2024-06-02T22:35:29.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.223+0000 7fd3d1461b80 10 client.24982 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3d1461b80 10 client.24982 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3d1461b80 20 client.24982 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f4744d790 0x558f4744ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3d1461b80 4 client.24982 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 --> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f47392fb0 con 0x558f4744d790 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.224+0000 7fd3b7400700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f4744d790 0x558f4744ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.225+0000 7fd3b7400700 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f4744d790 0x558f4744ec00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=85e9f7ee6f830b59 server_cookie=2cf858b1952d293c in_seq=0 out_seq=0 2024-06-02T22:35:29.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.225+0000 7fd3ae000700 10 client.24982 ms_handle_connect on v2:172.21.15.178:6838/4016839880 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3ae000700 1 -- 172.21.15.31:0/2409070373 <== mds.3 v2:172.21.15.178:6838/4016839880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558f47392fb0 con 0x558f4744d790 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3ae000700 10 client.24982 handle_command_reply: tid=0 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 client.24982 shutdown 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 msgr2=0x558f4743dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000fbe0 tx=0x7fd3b00a0720 comp rx=0 tx=0).stop 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 shutdown_connections 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f4744d790 0x558f4744ec00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f4743dc50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/2409070373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3ae000700 0 client.24982 ms_handle_reset on v2:172.21.15.178:6838/4016839880 2024-06-02T22:35:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.226+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 >> 172.21.15.31:0/2409070373 conn(0x558f47360120 msgr2=0x558f4742f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.227+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 shutdown_connections 2024-06-02T22:35:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.227+0000 7fd3d1461b80 1 -- 172.21.15.31:0/2409070373 wait complete. 2024-06-02T22:35:29.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.227+0000 7fd3d1461b80 20 client.24982 trim_cache size 0 max 16384 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.249+0000 7fd3d1461b80 1 Processor -- start 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 -- start start 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f47434110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f4744cf40 con 0x558f47435910 2024-06-02T22:35:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558f4744d610 con 0x558f4743e520 2024-06-02T22:35:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558f4744dce0 con 0x558f473afdf0 2024-06-02T22:35:29.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3b7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3b7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53728/0 (socket says 172.21.15.31:53728) 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3b7400700 1 -- 172.21.15.31:0/1771933119 learned_addr learned my addr 172.21.15.31:0/1771933119 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f47434110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.250+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 -- 172.21.15.31:0/1771933119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 msgr2=0x558f47434110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f47434110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 -- 172.21.15.31:0/1771933119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 msgr2=0x558f4743ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 -- 172.21.15.31:0/1771933119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f47439500 con 0x558f47435910 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:29.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f47434110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x558f47430540 tx=0x7fd3a801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec23281a3fe429 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b4c00700 1 -- 172.21.15.31:0/1771933119 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a801d070 con 0x558f47435910 2024-06-02T22:35:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b4c00700 1 -- 172.21.15.31:0/1771933119 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a8019be0 con 0x558f47435910 2024-06-02T22:35:29.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.251+0000 7fd3b4c00700 1 -- 172.21.15.31:0/1771933119 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8017440 con 0x558f47435910 2024-06-02T22:35:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1771933119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 msgr2=0x558f4743c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x558f47430540 tx=0x7fd3a801c000 comp rx=0 tx=0).stop 2024-06-02T22:35:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1771933119 shutdown_connections 2024-06-02T22:35:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f4743e520 0x558f4743ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f473afdf0 0x558f47434110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1771933119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f47435910 0x558f4743c780 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1771933119 >> 172.21.15.31:0/1771933119 conn(0x558f47360120 msgr2=0x558f47439880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1771933119 shutdown_connections 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.252+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1771933119 wait complete. 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 -- start start 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 Processor -- start 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 0x558f47437760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f4743e520 0x558f47437ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558f4744ea80 con 0x558f473afdf0 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558f4744e3b0 con 0x558f47435910 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.253+0000 7fd3d1461b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558f4744f150 con 0x558f4743e520 2024-06-02T22:35:29.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3d1461b80 10 client.0 _ll_register_callbacks cb 0x558f4731f6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3bfe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53734/0 (socket says 172.21.15.31:53734) 2024-06-02T22:35:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3bfe00700 1 -- 172.21.15.31:0/1051402103 learned_addr learned my addr 172.21.15.31:0/1051402103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 0x558f47437760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3c4a00700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f4743e520 0x558f47437ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 -- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f4743e520 msgr2=0x558f47437ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f4743e520 0x558f47437ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 -- 172.21.15.31:0/1051402103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 msgr2=0x558f47437220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3b7400700 1 -- 172.21.15.31:0/1051402103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f474570c0 con 0x558f47435910 2024-06-02T22:35:29.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.254+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3b7400700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 0x558f47437760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x558f4742fe40 tx=0x7fd3a801ae70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92a8f98cdcd63f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3ae000700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a802a4e0 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a8019be0 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd3a802f040 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3a802a680 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3d1461b80 10 client.24971 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.255+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558f474583f0 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a8019be0 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3a80233f0 con 0x558f47435910 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 10 client.24971 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 10 client.24971 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 20 client.24971 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f474c5580 0x558f474c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 4 client.24971 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.256+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 --> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] -- command(tid 0: {"prefix": "status"}) -- 0x558f4738d530 con 0x558f474c5580 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f474c5580 0x558f474c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3bfe00700 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f474c5580 0x558f474c4290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=55b72cfc02f9535d server_cookie=f3af6795b2b97f75 in_seq=0 out_seq=0 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3ae000700 10 client.24971 ms_handle_connect on v2:172.21.15.178:6838/4016839880 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3ae000700 1 -- 172.21.15.31:0/1051402103 <== mds.3 v2:172.21.15.178:6838/4016839880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558f4738d530 con 0x558f474c5580 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3ae000700 10 client.24971 handle_command_reply: tid=0 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3d1461b80 1 client.24971 shutdown 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 msgr2=0x558f47437760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.257+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 0x558f47437760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x558f4742fe40 tx=0x7fd3a801ae70 comp rx=0 tx=0).stop 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 shutdown_connections 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x558f474c5580 0x558f474c4290 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558f4743e520 0x558f47437ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558f473afdf0 0x558f47437220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 --2- 172.21.15.31:0/1051402103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558f47435910 0x558f47437760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3ae000700 0 client.24971 ms_handle_reset on v2:172.21.15.178:6838/4016839880 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 >> 172.21.15.31:0/1051402103 conn(0x558f47360120 msgr2=0x558f47435cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 shutdown_connections 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 1 -- 172.21.15.31:0/1051402103 wait complete. 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.258+0000 7fd3d1461b80 20 client.24971 trim_cache size 0 max 16384 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 3, 2024-06-02T22:35:29.261 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24499, 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 160.811140024, 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 282.65770788999998 2024-06-02T22:35:29.262 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 msgr2=0x7fd3a40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 0x7fd3a40a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0109d60 tx=0x7fd3a80099e0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 msgr2=0x7fd3c019ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0000c00 tx=0x7fd3b000fa70 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 shutdown_connections 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3a40a2ca0 0x7fd3a40a5160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3c010a670 0x7fd3c019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3c01045c0 0x7fd3c019ad80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 --2- 172.21.15.31:0/1662380287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c0104f80 0x7fd3c019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 >> 172.21.15.31:0/1662380287 conn(0x7fd3c0100070 msgr2=0x7fd3c0101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 shutdown_connections 2024-06-02T22:35:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:29.259+0000 7fd3c5400700 1 -- 172.21.15.31:0/1662380287 wait complete. 2024-06-02T22:35:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:29 smithi178 ceph-mon[36614]: pgmap v466: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:30.106 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:29 smithi031 ceph-mon[31767]: pgmap v466: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:30.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-02T22:35:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:29 smithi098 ceph-mon[36750]: pgmap v466: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:30.651 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:32.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:31 smithi178 ceph-mon[36614]: pgmap v467: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:31 smithi031 ceph-mon[31767]: pgmap v467: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:31 smithi098 ceph-mon[36750]: pgmap v467: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 -- 172.21.15.31:0/3952914897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 msgr2=0x7f014010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 --2- 172.21.15.31:0/3952914897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014010f320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0138009f90 tx=0x7f013800b330 comp rx=0 tx=0).stop 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 -- 172.21.15.31:0/3952914897 shutdown_connections 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 --2- 172.21.15.31:0/3952914897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014010f320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 --2- 172.21.15.31:0/3952914897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f01401088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 --2- 172.21.15.31:0/3952914897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 0x7f014006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 -- 172.21.15.31:0/3952914897 >> 172.21.15.31:0/3952914897 conn(0x7f0140078340 msgr2=0x7f0140078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 -- 172.21.15.31:0/3952914897 shutdown_connections 2024-06-02T22:35:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.181+0000 7f0146400700 1 -- 172.21.15.31:0/3952914897 wait complete. 2024-06-02T22:35:33.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.182+0000 7f0146400700 1 Processor -- start 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.182+0000 7f0146400700 1 -- start start 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 0x7f014019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0140112760 con 0x7f0140108500 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f01401125e0 con 0x7f014006ab30 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f0146400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f01401128e0 con 0x7f014006a170 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f013fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f013f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 0x7f014019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f013fe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39350/0 (socket says 172.21.15.31:39350) 2024-06-02T22:35:33.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f013fe00700 1 -- 172.21.15.31:0/97867361 learned_addr learned my addr 172.21.15.31:0/97867361 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:33.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.183+0000 7f013ea00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 -- 172.21.15.31:0/97867361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 msgr2=0x7f014019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 0x7f014019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 -- 172.21.15.31:0/97867361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 msgr2=0x7f014019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 -- 172.21.15.31:0/97867361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014019fdd0 con 0x7f0140108500 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013ea00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:33.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f013fe00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0138004f30 tx=0x7f0138009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f0137e00700 1 -- 172.21.15.31:0/97867361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138021070 con 0x7f0140108500 2024-06-02T22:35:33.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.184+0000 7f0137e00700 1 -- 172.21.15.31:0/97867361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0138007b40 con 0x7f0140108500 2024-06-02T22:35:33.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.185+0000 7f0137e00700 1 -- 172.21.15.31:0/97867361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01380052a0 con 0x7f0140108500 2024-06-02T22:35:33.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.185+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01401a0060 con 0x7f0140108500 2024-06-02T22:35:33.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.185+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01401a7940 con 0x7f0140108500 2024-06-02T22:35:33.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.188+0000 7f0137e00700 1 -- 172.21.15.31:0/97867361 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0138024070 con 0x7f0140108500 2024-06-02T22:35:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.189+0000 7f0150d66b80 1 Processor -- start 2024-06-02T22:35:33.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.189+0000 7f0150d66b80 1 -- start start 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c0594cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0595630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5564c04a39c0 con 0x5564c059b460 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c04e6ab0 con 0x5564c059ab40 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0150d66b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5564c04a18a0 con 0x5564c05951f0 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0137e00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 0x7f01240a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f013ea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f013ea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:51688/0 (socket says 172.21.15.31:51688) 2024-06-02T22:35:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f0137e00700 1 -- 172.21.15.31:0/97867361 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f013800f020 con 0x7f0140108500 2024-06-02T22:35:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f013ea00700 1 -- 172.21.15.31:0/142875073 learned_addr learned my addr 172.21.15.31:0/142875073 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f013f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c0594cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.190+0000 7f013ea00700 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0595630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013fe00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 0x7f01240a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 -- 172.21.15.31:0/142875073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 msgr2=0x5564c0595630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0595630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 -- 172.21.15.31:0/142875073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 msgr2=0x5564c059af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 -- 172.21.15.31:0/142875073 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c048ef40 con 0x5564c059b460 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.191+0000 7f013f400700 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c0594cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0130009cc0 tx=0x7f01300058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74193f167ad17a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.192+0000 7f013fe00700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 0x7f01240a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f013809cc70 tx=0x7f0138009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.192+0000 7f0134c00700 1 -- 172.21.15.31:0/142875073 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130011ce0 con 0x5564c059b460 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.192+0000 7f0134c00700 1 -- 172.21.15.31:0/142875073 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0130004530 con 0x5564c059b460 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.192+0000 7f0134c00700 1 -- 172.21.15.31:0/142875073 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130005280 con 0x5564c059b460 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- 172.21.15.31:0/142875073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 msgr2=0x5564c0594cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c0594cb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0130009cc0 tx=0x7f01300058e0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- 172.21.15.31:0/142875073 shutdown_connections 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0595630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 --2- 172.21.15.31:0/142875073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c0594cb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- 172.21.15.31:0/142875073 >> 172.21.15.31:0/142875073 conn(0x5564c04c1120 msgr2=0x5564c058ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- 172.21.15.31:0/142875073 shutdown_connections 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- 172.21.15.31:0/142875073 wait complete. 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.193+0000 7f0150d66b80 1 -- start start 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 Processor -- start 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 0x5564c059e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059b460 0x5564c059e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5564c0482f10 con 0x5564c05951f0 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c04e2a70 con 0x5564c059b460 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5564c05a1e40 con 0x5564c059ab40 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.194+0000 7f0150d66b80 10 client.0 _ll_register_callbacks cb 0x5564c047c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 0x5564c059e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39360/0 (socket says 172.21.15.31:39360) 2024-06-02T22:35:33.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 -- 172.21.15.31:0/1647884452 learned_addr learned my addr 172.21.15.31:0/1647884452 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:33.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059b460 0x5564c059e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 -- 172.21.15.31:0/1647884452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 msgr2=0x5564c059e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 0x5564c059e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 -- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059b460 msgr2=0x5564c059e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059b460 0x5564c059e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013ea00700 1 -- 172.21.15.31:0/1647884452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c0435880 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.195+0000 7f013f400700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 0x5564c059e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.196+0000 7f013ea00700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f012c012b90 tx=0x7f012c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28af68c3857ee72 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.196+0000 7f0129600700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.196+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c003ba0 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.196+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f012c003d40 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.196+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0130004530 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f012c02c050 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 10 client.14889 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564c05ac5f0 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0130004530 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f012c021040 con 0x5564c05951f0 2024-06-02T22:35:33.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 10 client.14889 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 10 client.14889 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 20 client.14889 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c05aebe0 0x5564c05b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 4 client.14889 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.197+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 --> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564c04f3fb0 con 0x5564c05aebe0 2024-06-02T22:35:33.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.198+0000 7f013f400700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c05aebe0 0x5564c05b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.198+0000 7f013f400700 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c05aebe0 0x5564c05b0050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=886ca8a289b63df4 server_cookie=61d793af18e4ea31 in_seq=0 out_seq=0 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.198+0000 7f0129600700 10 client.14889 ms_handle_connect on v2:172.21.15.98:6838/2003931119 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.199+0000 7f0129600700 1 -- 172.21.15.31:0/1647884452 <== mds.2 v2:172.21.15.98:6838/2003931119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5564c04f3fb0 con 0x5564c05aebe0 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.199+0000 7f0129600700 10 client.14889 handle_command_reply: tid=0 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 client.14889 shutdown 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 msgr2=0x5564c05a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f012c012b90 tx=0x7f012c0047c0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 shutdown_connections 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059b460 0x5564c059e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c05aebe0 0x5564c05b0050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c05951f0 0x5564c05a1140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0129600700 0 client.14889 ms_handle_reset on v2:172.21.15.98:6838/2003931119 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 --2- 172.21.15.31:0/1647884452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c059ab40 0x5564c059e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 >> 172.21.15.31:0/1647884452 conn(0x5564c04c1120 msgr2=0x5564c0589740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 shutdown_connections 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 1 -- 172.21.15.31:0/1647884452 wait complete. 2024-06-02T22:35:33.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.200+0000 7f0150d66b80 20 client.14889 trim_cache size 0 max 16384 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.224+0000 7f0150d66b80 1 Processor -- start 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.224+0000 7f0150d66b80 1 -- start start 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0594cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5564c05ae390 con 0x5564c059b460 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c05aea60 con 0x5564c059ab40 2024-06-02T22:35:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f0150d66b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5564c05af130 con 0x5564c05951f0 2024-06-02T22:35:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39364/0 (socket says 172.21.15.31:39364) 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 -- 172.21.15.31:0/3779600929 learned_addr learned my addr 172.21.15.31:0/3779600929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0594cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 -- 172.21.15.31:0/3779600929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 msgr2=0x5564c0594cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0594cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 -- 172.21.15.31:0/3779600929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 msgr2=0x5564c059dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013ea00700 1 -- 172.21.15.31:0/3779600929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c0595940 con 0x5564c059b460 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.225+0000 7f013f400700 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.226+0000 7f013ea00700 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f012c02a040 tx=0x7f012c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a530670784b9554d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.226+0000 7f012be00700 1 -- 172.21.15.31:0/3779600929 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c00f660 con 0x5564c059b460 2024-06-02T22:35:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.226+0000 7f012be00700 1 -- 172.21.15.31:0/3779600929 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c00f800 con 0x5564c059b460 2024-06-02T22:35:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.226+0000 7f012be00700 1 -- 172.21.15.31:0/3779600929 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c0237b0 con 0x5564c059b460 2024-06-02T22:35:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 -- 172.21.15.31:0/3779600929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 msgr2=0x5564c058a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f012c02a040 tx=0x7f012c016040 comp rx=0 tx=0).stop 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 -- 172.21.15.31:0/3779600929 shutdown_connections 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059b460 0x5564c058a0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05951f0 0x5564c0594cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3779600929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c059ab40 0x5564c059dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.227+0000 7f0150d66b80 1 -- 172.21.15.31:0/3779600929 >> 172.21.15.31:0/3779600929 conn(0x5564c04c1120 msgr2=0x5564c059cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.228+0000 7f0150d66b80 1 -- 172.21.15.31:0/3779600929 shutdown_connections 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.228+0000 7f0150d66b80 1 -- 172.21.15.31:0/3779600929 wait complete. 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.228+0000 7f0150d66b80 1 -- start start 2024-06-02T22:35:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.228+0000 7f0150d66b80 1 Processor -- start 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c05951f0 0x5564c05b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05aebe0 0x5564c05b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5564c05afed0 con 0x5564c059ab40 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564c05af800 con 0x5564c05951f0 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5564c05b05a0 con 0x5564c05aebe0 2024-06-02T22:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f0150d66b80 10 client.0 _ll_register_callbacks cb 0x5564c047c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f013f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f013ea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c05951f0 0x5564c05b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f013f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39372/0 (socket says 172.21.15.31:39372) 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f013f400700 1 -- 172.21.15.31:0/3132912232 learned_addr learned my addr 172.21.15.31:0/3132912232 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.229+0000 7f013ea00700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05aebe0 0x5564c05b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 -- 172.21.15.31:0/3132912232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05aebe0 msgr2=0x5564c05b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05aebe0 0x5564c05b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 -- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c05951f0 msgr2=0x5564c05b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c05951f0 0x5564c05b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 -- 172.21.15.31:0/3132912232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c05b4c80 con 0x5564c059ab40 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f013f400700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0130009cc0 tx=0x7f0130011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3c606818cd2d9a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f0129600700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:35:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300093d0 con 0x5564c059ab40 2024-06-02T22:35:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.230+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0130003680 con 0x5564c059ab40 2024-06-02T22:35:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c00f800 con 0x5564c059ab40 2024-06-02T22:35:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f013003a050 con 0x5564c059ab40 2024-06-02T22:35:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 10 client.14895 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564c061aef0 con 0x5564c059ab40 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c00f800 con 0x5564c059ab40 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0130018070 con 0x5564c059ab40 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 10 client.14895 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 10 client.14895 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.231+0000 7f0150d66b80 20 client.14895 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c061f860 0x5564c061e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f0150d66b80 4 client.14895 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 --> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] -- command(tid 0: {"prefix": "status"}) -- 0x5564c04ee530 con 0x5564c061f860 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f013ea00700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c061f860 0x5564c061e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f013ea00700 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c061f860 0x5564c061e570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7bb6f09d6003ed2c server_cookie=74c8088c9e341e25 in_seq=0 out_seq=0 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.232+0000 7f0129600700 10 client.14895 ms_handle_connect on v2:172.21.15.98:6838/2003931119 2024-06-02T22:35:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0129600700 1 -- 172.21.15.31:0/3132912232 <== mds.2 v2:172.21.15.98:6838/2003931119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5564c04ee530 con 0x5564c061f860 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0129600700 10 client.14895 handle_command_reply: tid=0 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 client.14895 shutdown 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 msgr2=0x5564c05b9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0130009cc0 tx=0x7f0130011e70 comp rx=0 tx=0).stop 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 shutdown_connections 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564c05aebe0 0x5564c05b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564c05951f0 0x5564c05b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5564c061f860 0x5564c061e570 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 --2- 172.21.15.31:0/3132912232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5564c059ab40 0x5564c05b9bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 >> 172.21.15.31:0/3132912232 conn(0x5564c04c1120 msgr2=0x5564c059cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0129600700 0 client.14895 ms_handle_reset on v2:172.21.15.98:6838/2003931119 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 shutdown_connections 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 1 -- 172.21.15.31:0/3132912232 wait complete. 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.233+0000 7f0150d66b80 20 client.14895 trim_cache size 0 max 16384 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 2, 2024-06-02T22:35:33.237 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24503, 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 165.79602002999999, 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 273.88089576599998 2024-06-02T22:35:33.238 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 msgr2=0x7f01240a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 0x7f01240a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f013809cc70 tx=0x7f0138009040 comp rx=0 tx=0).stop 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 msgr2=0x7f014019f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0138004f30 tx=0x7f0138009b90 comp rx=0 tx=0).stop 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 shutdown_connections 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01240a2ca0 0x7f01240a5160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0140108500 0x7f014019f690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014006a170 0x7f014019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 --2- 172.21.15.31:0/97867361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014006ab30 0x7f014019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 >> 172.21.15.31:0/97867361 conn(0x7f0140078340 msgr2=0x7f014010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.234+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 shutdown_connections 2024-06-02T22:35:33.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:33.235+0000 7f0146400700 1 -- 172.21.15.31:0/97867361 wait complete. 2024-06-02T22:35:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:33 smithi178 ceph-mon[36614]: pgmap v468: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:33 smithi031 ceph-mon[31767]: pgmap v468: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:34.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.g status 2024-06-02T22:35:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:33 smithi098 ceph-mon[36750]: pgmap v468: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:34.715 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:35 smithi178 ceph-mon[36614]: pgmap v469: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:35 smithi031 ceph-mon[31767]: pgmap v469: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:35 smithi098 ceph-mon[36750]: pgmap v469: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 -- 172.21.15.31:0/1348508270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 msgr2=0x7fc35010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 --2- 172.21.15.31:0/1348508270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35010e7f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc340009990 tx=0x7fc340009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 -- 172.21.15.31:0/1348508270 shutdown_connections 2024-06-02T22:35:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 --2- 172.21.15.31:0/1348508270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc35010ed30 0x7fc350111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 --2- 172.21.15.31:0/1348508270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc350101180 0x7fc350101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 --2- 172.21.15.31:0/1348508270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35010e7f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 -- 172.21.15.31:0/1348508270 >> 172.21.15.31:0/1348508270 conn(0x7fc3500fce40 msgr2=0x7fc3500ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 -- 172.21.15.31:0/1348508270 shutdown_connections 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:36.999+0000 7fc357200700 1 -- 172.21.15.31:0/1348508270 wait complete. 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.001+0000 7fc357200700 1 Processor -- start 2024-06-02T22:35:37.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.001+0000 7fc357200700 1 -- start start 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 0x7fc35019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc35010ed30 0x7fc35019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114980 con 0x7fc35010ed30 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114800 con 0x7fc350101b30 2024-06-02T22:35:37.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc357200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114b00 con 0x7fc350101180 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc355e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 0x7fc35019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc355400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc355e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 0x7fc35019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:60684/0 (socket says 172.21.15.31:60684) 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc356800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc35010ed30 0x7fc35019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.002+0000 7fc355e00700 1 -- 172.21.15.31:0/3740793983 learned_addr learned my addr 172.21.15.31:0/3740793983 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 -- 172.21.15.31:0/3740793983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 msgr2=0x7fc35019ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 0x7fc35019ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 -- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc35010ed30 msgr2=0x7fc35019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc35010ed30 0x7fc35019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 -- 172.21.15.31:0/3740793983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35019fe20 con 0x7fc350101b30 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc355400700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35019b350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3400059d0 tx=0x7fc34000bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc34aa00700 1 -- 172.21.15.31:0/3740793983 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340027070 con 0x7fc350101b30 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.003+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3501a00b0 con 0x7fc350101b30 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.004+0000 7fc34aa00700 1 -- 172.21.15.31:0/3740793983 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc340003d70 con 0x7fc350101b30 2024-06-02T22:35:37.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.004+0000 7fc34aa00700 1 -- 172.21.15.31:0/3740793983 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340022e30 con 0x7fc350101b30 2024-06-02T22:35:37.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.004+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a7990 con 0x7fc350101b30 2024-06-02T22:35:37.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.007+0000 7fc34aa00700 1 -- 172.21.15.31:0/3740793983 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc34002a070 con 0x7fc350101b30 2024-06-02T22:35:37.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.008+0000 7fc363136b80 1 Processor -- start 2024-06-02T22:35:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.008+0000 7fc363136b80 1 -- start start 2024-06-02T22:35:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc34aa00700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 0x7fc3380a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc34aa00700 1 -- 172.21.15.31:0/3740793983 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc3400d0180 con 0x7fc350101b30 2024-06-02T22:35:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e974363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97436d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e9744a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc356800700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 0x7fc3380a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557e973439c0 con 0x557e97436910 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557e97386ab0 con 0x557e97447d30 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc363136b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557e973418a0 con 0x557e973b0df0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc355400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97436d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc355400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97436d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39386/0 (socket says 172.21.15.31:39386) 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc355400700 1 -- 172.21.15.31:0/2341064940 learned_addr learned my addr 172.21.15.31:0/2341064940 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.009+0000 7fc355e00700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e974363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc356800700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e9744a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 -- 172.21.15.31:0/2341064940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 msgr2=0x557e9744a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e9744a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 -- 172.21.15.31:0/2341064940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 msgr2=0x557e97436d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97436d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 -- 172.21.15.31:0/2341064940 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9732ef40 con 0x557e973b0df0 2024-06-02T22:35:37.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc356800700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e9744a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc356800700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 0x7fc3380a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009ec0 tx=0x7fc34c00fc40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.010+0000 7fc355e00700 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e974363d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc344009d10 tx=0x7fc344011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5280187d65cd6eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.011+0000 7fc33f400700 1 -- 172.21.15.31:0/2341064940 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344004250 con 0x557e973b0df0 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.011+0000 7fc33f400700 1 -- 172.21.15.31:0/2341064940 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc344004d10 con 0x557e973b0df0 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.011+0000 7fc33f400700 1 -- 172.21.15.31:0/2341064940 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440056e0 con 0x557e973b0df0 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.011+0000 7fc363136b80 1 -- 172.21.15.31:0/2341064940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 msgr2=0x557e974363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.011+0000 7fc363136b80 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e974363d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc344009d10 tx=0x7fc344011720 comp rx=0 tx=0).stop 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 -- 172.21.15.31:0/2341064940 shutdown_connections 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e9744a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e974363d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 --2- 172.21.15.31:0/2341064940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97436d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 -- 172.21.15.31:0/2341064940 >> 172.21.15.31:0/2341064940 conn(0x557e97361120 msgr2=0x557e974307d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 -- 172.21.15.31:0/2341064940 shutdown_connections 2024-06-02T22:35:37.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 -- 172.21.15.31:0/2341064940 wait complete. 2024-06-02T22:35:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.012+0000 7fc363136b80 1 -- start start 2024-06-02T22:35:37.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 Processor -- start 2024-06-02T22:35:37.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e974447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 0x557e97444ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557e97322f10 con 0x557e97447d30 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557e97382a70 con 0x557e973b0df0 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557e9744a940 con 0x557e97436910 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.013+0000 7fc363136b80 10 client.0 _ll_register_callbacks cb 0x557e973206d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e974447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:51758/0 (socket says 172.21.15.31:51758) 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 -- 172.21.15.31:0/3628649561 learned_addr learned my addr 172.21.15.31:0/3628649561 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc356800700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 0x557e97444ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 -- 172.21.15.31:0/3628649561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 msgr2=0x557e974447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e974447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 -- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 msgr2=0x557e97444ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 0x557e97444ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc355e00700 1 -- 172.21.15.31:0/3628649561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e972d5880 con 0x557e973b0df0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.014+0000 7fc356800700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 0x557e97444ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc355e00700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc344009340 tx=0x7fc3440097f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c0919ff232c98b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc333e00700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344026020 con 0x557e973b0df0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc3440052e0 con 0x557e973b0df0 2024-06-02T22:35:37.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc344004d10 con 0x557e973b0df0 2024-06-02T22:35:37.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc344031050 con 0x557e973b0df0 2024-06-02T22:35:37.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc363136b80 10 client.25001 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:37.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.015+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557e97455070 con 0x557e973b0df0 2024-06-02T22:35:37.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc344004d10 con 0x557e973b0df0 2024-06-02T22:35:37.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc344018070 con 0x557e973b0df0 2024-06-02T22:35:37.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 10 client.25001 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 10 client.25001 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 20 client.25001 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974574d0 0x557e97458940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 4 client.25001 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 --> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e97393fb0 con 0x557e974574d0 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.016+0000 7fc355400700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974574d0 0x557e97458940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.017+0000 7fc355400700 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974574d0 0x557e97458940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3431df319ba191a5 server_cookie=f9bbf48a5e7b61d6 in_seq=0 out_seq=0 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.017+0000 7fc333e00700 10 client.25001 ms_handle_connect on v2:172.21.15.31:6838/4188521464 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc333e00700 1 -- 172.21.15.31:0/3628649561 <== mds.1 v2:172.21.15.31:6838/4188521464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557e97393fb0 con 0x557e974574d0 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc333e00700 10 client.25001 handle_command_reply: tid=0 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 client.25001 shutdown 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 msgr2=0x557e974474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc344009340 tx=0x7fc3440097f0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 shutdown_connections 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974574d0 0x557e97458940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97447d30 0x557e97444ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e973b0df0 0x557e974474a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 --2- 172.21.15.31:0/3628649561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e974447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc333e00700 0 client.25001 ms_handle_reset on v2:172.21.15.31:6838/4188521464 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.018+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 >> 172.21.15.31:0/3628649561 conn(0x557e97361120 msgr2=0x557e974303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.019+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 shutdown_connections 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.019+0000 7fc363136b80 1 -- 172.21.15.31:0/3628649561 wait complete. 2024-06-02T22:35:37.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.019+0000 7fc363136b80 20 client.25001 trim_cache size 0 max 16384 2024-06-02T22:35:37.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 Processor -- start 2024-06-02T22:35:37.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 -- start start 2024-06-02T22:35:37.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e97444d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e97441f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557e97456c80 con 0x557e97436910 2024-06-02T22:35:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557e97457350 con 0x557e97447d30 2024-06-02T22:35:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.043+0000 7fc363136b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557e97457a20 con 0x557e973b0df0 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e97444d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc356800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e97441f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39394/0 (socket says 172.21.15.31:39394) 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355400700 1 -- 172.21.15.31:0/2489668119 learned_addr learned my addr 172.21.15.31:0/2489668119 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 -- 172.21.15.31:0/2489668119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 msgr2=0x557e97441f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e97441f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 -- 172.21.15.31:0/2489668119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 msgr2=0x557e97441a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 -- 172.21.15.31:0/2489668119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e97436700 con 0x557e973b0df0 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355400700 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.044+0000 7fc355e00700 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e97444d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c60 tx=0x7fc344011ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd12a59bd235fc3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc33ea00700 1 -- 172.21.15.31:0/2489668119 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344026070 con 0x557e973b0df0 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc33ea00700 1 -- 172.21.15.31:0/2489668119 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc344022400 con 0x557e973b0df0 2024-06-02T22:35:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc33ea00700 1 -- 172.21.15.31:0/2489668119 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344022980 con 0x557e973b0df0 2024-06-02T22:35:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 -- 172.21.15.31:0/2489668119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 msgr2=0x557e97444d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e97444d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c60 tx=0x7fc344011ba0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 -- 172.21.15.31:0/2489668119 shutdown_connections 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e97441f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e973b0df0 0x557e97444d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 --2- 172.21.15.31:0/2489668119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e97436910 0x557e97441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.045+0000 7fc363136b80 1 -- 172.21.15.31:0/2489668119 >> 172.21.15.31:0/2489668119 conn(0x557e97361120 msgr2=0x557e97443090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.046+0000 7fc363136b80 1 -- 172.21.15.31:0/2489668119 shutdown_connections 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.046+0000 7fc363136b80 1 -- 172.21.15.31:0/2489668119 wait complete. 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.046+0000 7fc363136b80 1 -- start start 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.046+0000 7fc363136b80 1 Processor -- start 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e973b0df0 0x557e974622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e974417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557e974587c0 con 0x557e973b0df0 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557e974580f0 con 0x557e97447d30 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557e97458e90 con 0x557e97436910 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc363136b80 10 client.0 _ll_register_callbacks cb 0x557e973206d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc355400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc355400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:60714/0 (socket says 172.21.15.31:60714) 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc355400700 1 -- 172.21.15.31:0/1480368743 learned_addr learned my addr 172.21.15.31:0/1480368743 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc355e00700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e973b0df0 0x557e974622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.047+0000 7fc356800700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e974417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 -- 172.21.15.31:0/1480368743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 msgr2=0x557e974417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e974417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 -- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e973b0df0 msgr2=0x557e974622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:37.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e973b0df0 0x557e974622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 -- 172.21.15.31:0/1480368743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e97441d90 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc356800700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e974417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc355400700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3400a4d30 tx=0x7fc3400047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486bdb9ea090e833 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc333e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3400b4070 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc344022400 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.048+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc34009a980 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc34009c680 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 10 client.25024 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557e97460b30 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc344022400 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc3400a1bc0 con 0x557e97436910 2024-06-02T22:35:37.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 10 client.25024 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 10 client.25024 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 20 client.25024 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974c76a0 0x557e974c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 4 client.25024 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 --> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] -- command(tid 0: {"prefix": "status"}) -- 0x557e9738e530 con 0x557e974c76a0 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.049+0000 7fc355e00700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974c76a0 0x557e974c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.050+0000 7fc355e00700 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974c76a0 0x557e974c63b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b271e0d4dafac0cd server_cookie=846617068350629 in_seq=0 out_seq=0 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.050+0000 7fc333e00700 10 client.25024 ms_handle_connect on v2:172.21.15.31:6838/4188521464 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.050+0000 7fc333e00700 1 -- 172.21.15.31:0/1480368743 <== mds.1 v2:172.21.15.31:6838/4188521464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557e9738e530 con 0x557e974c76a0 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.050+0000 7fc333e00700 10 client.25024 handle_command_reply: tid=0 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.050+0000 7fc363136b80 1 client.25024 shutdown 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 msgr2=0x557e97441290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3400a4d30 tx=0x7fc3400047c0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 shutdown_connections 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557e97447d30 0x557e974417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x557e974c76a0 0x557e974c63b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557e973b0df0 0x557e974622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 --2- 172.21.15.31:0/1480368743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557e97436910 0x557e97441290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc333e00700 0 client.25024 ms_handle_reset on v2:172.21.15.31:6838/4188521464 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 >> 172.21.15.31:0/1480368743 conn(0x557e97361120 msgr2=0x557e97445c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 shutdown_connections 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 1 -- 172.21.15.31:0/1480368743 wait complete. 2024-06-02T22:35:37.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.051+0000 7fc363136b80 20 client.25024 trim_cache size 0 max 16384 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 1, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24505, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 170.62417062700001, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:35:37.055 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 285.63801387000001 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 msgr2=0x7fc3380a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 0x7fc3380a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009ec0 tx=0x7fc34c00fc40 comp rx=0 tx=0).stop 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 msgr2=0x7fc35019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35019b350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3400059d0 tx=0x7fc34000bab0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 shutdown_connections 2024-06-02T22:35:37.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3380a2c20 0x7fc3380a50e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc35010ed30 0x7fc35019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc350101180 0x7fc35019ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 --2- 172.21.15.31:0/3740793983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc350101b30 0x7fc35019b350 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 >> 172.21.15.31:0/3740793983 conn(0x7fc3500fce40 msgr2=0x7fc3500ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 shutdown_connections 2024-06-02T22:35:37.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:37.052+0000 7fc357200700 1 -- 172.21.15.31:0/3740793983 wait complete. 2024-06-02T22:35:37.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:37 smithi031 ceph-mon[31767]: pgmap v470: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:38.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:37 smithi178 ceph-mon[36614]: pgmap v470: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:38.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-06-02T22:35:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:37 smithi098 ceph-mon[36750]: pgmap v470: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:38.555 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:39.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:39 smithi031 ceph-mon[31767]: pgmap v471: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:39 smithi178 ceph-mon[36614]: pgmap v471: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:39 smithi098 ceph-mon[36750]: pgmap v471: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:40.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 -- 172.21.15.31:0/4219168360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 msgr2=0x7f58f410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:40.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 --2- 172.21.15.31:0/4219168360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f410f310 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58f000b0a0 tx=0x7f58f000b3b0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 -- 172.21.15.31:0/4219168360 shutdown_connections 2024-06-02T22:35:40.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 --2- 172.21.15.31:0/4219168360 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f410f310 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 --2- 172.21.15.31:0/4219168360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f41084d0 0x7f58f41088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 --2- 172.21.15.31:0/4219168360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f406aa00 0x7f58f406ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 -- 172.21.15.31:0/4219168360 >> 172.21.15.31:0/4219168360 conn(0x7f58f4078330 msgr2=0x7f58f4078740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 -- 172.21.15.31:0/4219168360 shutdown_connections 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.987+0000 7f58fc800700 1 -- 172.21.15.31:0/4219168360 wait complete. 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.989+0000 7f58fc800700 1 Processor -- start 2024-06-02T22:35:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.989+0000 7f58fc800700 1 -- start start 2024-06-02T22:35:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f406aa00 0x7f58f419e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f41084d0 0x7f58f4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4112770 con 0x7f58f406b3a0 2024-06-02T22:35:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41125f0 con 0x7f58f41084d0 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fc800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41128f0 con 0x7f58f406aa00 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37668/0 (socket says 172.21.15.31:37668) 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9400700 1 -- 172.21.15.31:0/2212914587 learned_addr learned my addr 172.21.15.31:0/2212914587 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f406aa00 0x7f58f419e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58fa800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f41084d0 0x7f58f4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9400700 1 -- 172.21.15.31:0/2212914587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f406aa00 msgr2=0x7f58f419e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.990+0000 7f58f9400700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f406aa00 0x7f58f419e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58f9400700 1 -- 172.21.15.31:0/2212914587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f41084d0 msgr2=0x7f58f4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58f9400700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f41084d0 0x7f58f4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58f9400700 1 -- 172.21.15.31:0/2212914587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f41991b0 con 0x7f58f406b3a0 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58f9400700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58e400eb30 tx=0x7f58e400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58eea00700 1 -- 172.21.15.31:0/2212914587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e400cbd0 con 0x7f58f406b3a0 2024-06-02T22:35:40.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58eea00700 1 -- 172.21.15.31:0/2212914587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58e4004500 con 0x7f58f406b3a0 2024-06-02T22:35:40.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58eea00700 1 -- 172.21.15.31:0/2212914587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4010430 con 0x7f58f406b3a0 2024-06-02T22:35:40.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f41994a0 con 0x7f58f406b3a0 2024-06-02T22:35:40.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.991+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a5710 con 0x7f58f406b3a0 2024-06-02T22:35:40.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.996+0000 7f58eea00700 1 -- 172.21.15.31:0/2212914587 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f58e4003f00 con 0x7f58f406b3a0 2024-06-02T22:35:40.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.997+0000 7f59070c3b80 1 Processor -- start 2024-06-02T22:35:40.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.997+0000 7f59070c3b80 1 -- start start 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b55630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f85a639c0 con 0x555f85b5b460 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58eea00700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 0x7f58dc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f85aa6ab0 con 0x555f85b5ab40 2024-06-02T22:35:40.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f59070c3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555f85a618a0 con 0x555f85b551f0 2024-06-02T22:35:40.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58fa800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37676/0 (socket says 172.21.15.31:37676) 2024-06-02T22:35:40.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58f9e00700 1 -- 172.21.15.31:0/2983456513 learned_addr learned my addr 172.21.15.31:0/2983456513 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:40.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58fa800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 0x7f58dc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58eea00700 1 -- 172.21.15.31:0/2212914587 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f58e40cf710 con 0x7f58f406b3a0 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.998+0000 7f58f9400700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b55630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 -- 172.21.15.31:0/2983456513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 msgr2=0x555f85b55630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b55630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 -- 172.21.15.31:0/2983456513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 msgr2=0x555f85b5af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 -- 172.21.15.31:0/2983456513 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f85a4ef40 con 0x555f85b5b460 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9400700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b55630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58fa800700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:40.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58f9e00700 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ca0 tx=0x7f58e8011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4cac16343f046 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:41.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58e3400700 1 -- 172.21.15.31:0/2983456513 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011d80 con 0x555f85b5b460 2024-06-02T22:35:41.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58e3400700 1 -- 172.21.15.31:0/2983456513 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58e8004d10 con 0x555f85b5b460 2024-06-02T22:35:41.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:40.999+0000 7f58e3400700 1 -- 172.21.15.31:0/2983456513 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8019690 con 0x555f85b5b460 2024-06-02T22:35:41.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.000+0000 7f59070c3b80 1 -- 172.21.15.31:0/2983456513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 msgr2=0x555f85b54cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.000+0000 7f58fa800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 0x7f58dc0a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009e60 tx=0x7f58f0006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.000+0000 7f59070c3b80 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ca0 tx=0x7f58e8011440 comp rx=0 tx=0).stop 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 -- 172.21.15.31:0/2983456513 shutdown_connections 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b55630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 --2- 172.21.15.31:0/2983456513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b54cb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 -- 172.21.15.31:0/2983456513 >> 172.21.15.31:0/2983456513 conn(0x555f85a81120 msgr2=0x555f85b4ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 -- 172.21.15.31:0/2983456513 shutdown_connections 2024-06-02T22:35:41.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 -- 172.21.15.31:0/2983456513 wait complete. 2024-06-02T22:35:41.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.001+0000 7f59070c3b80 1 -- start start 2024-06-02T22:35:41.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 Processor -- start 2024-06-02T22:35:41.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 0x555f85b610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b5b460 0x555f85b5e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f85a42f10 con 0x555f85b551f0 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f85aa2a70 con 0x555f85b5ab40 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555f85b61e40 con 0x555f85b5b460 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.002+0000 7f59070c3b80 10 client.0 _ll_register_callbacks cb 0x555f85a3c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 0x555f85b610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 0x555f85b610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37680/0 (socket says 172.21.15.31:37680) 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9e00700 1 -- 172.21.15.31:0/438477761 learned_addr learned my addr 172.21.15.31:0/438477761 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58fa800700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b5b460 0x555f85b5e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 -- 172.21.15.31:0/438477761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b5b460 msgr2=0x555f85b5e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b5b460 0x555f85b5e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 -- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 msgr2=0x555f85b610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 0x555f85b610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 -- 172.21.15.31:0/438477761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f859f5880 con 0x555f85b5ab40 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58f9400700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5e430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58e40cce20 tx=0x7f58e409b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d06e7946c825b0a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.003+0000 7f58d7e00700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e409c280 con 0x555f85b5ab40 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f58e401fdd0 con 0x555f85b5ab40 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58e8004d10 con 0x555f85b5ab40 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58e40ae490 con 0x555f85b5ab40 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f59070c3b80 10 client.25019 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:41.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555f85b70920 con 0x555f85b5ab40 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58e8004d10 con 0x555f85b5ab40 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.004+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58e40b07d0 con 0x555f85b5ab40 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 10 client.25019 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 10 client.25019 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 20 client.25019 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85b72f00 0x555f85b74370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 4 client.25019 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f85ab3fb0 con 0x555f85b72f00 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.005+0000 7f58f9e00700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85b72f00 0x555f85b74370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.006+0000 7f58f9e00700 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85b72f00 0x555f85b74370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7ae58672faefc4 server_cookie=c7a05a8742b09d47 in_seq=0 out_seq=0 2024-06-02T22:35:41.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.006+0000 7f58d7e00700 10 client.25019 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:35:41.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f58d7e00700 1 -- 172.21.15.31:0/438477761 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555f85ab3fb0 con 0x555f85b72f00 2024-06-02T22:35:41.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f58d7e00700 10 client.25019 handle_command_reply: tid=0 2024-06-02T22:35:41.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 client.25019 shutdown 2024-06-02T22:35:41.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 msgr2=0x555f85b5e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5e430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f58e40cce20 tx=0x7f58e409b7b0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 shutdown_connections 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b5b460 0x555f85b5e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b551f0 0x555f85b610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85b72f00 0x555f85b74370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 --2- 172.21.15.31:0/438477761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b5e430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 >> 172.21.15.31:0/438477761 conn(0x555f85a81120 msgr2=0x555f85b49740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f58d7e00700 0 client.25019 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 shutdown_connections 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 1 -- 172.21.15.31:0/438477761 wait complete. 2024-06-02T22:35:41.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.007+0000 7f59070c3b80 20 client.25019 trim_cache size 0 max 16384 2024-06-02T22:35:41.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.031+0000 7f59070c3b80 1 Processor -- start 2024-06-02T22:35:41.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 -- start start 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b4a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b5cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f85b726b0 con 0x555f85b5b460 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f85b72d80 con 0x555f85b5ab40 2024-06-02T22:35:41.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f59070c3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555f85b73450 con 0x555f85b551f0 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f58fa800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b5cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f58f9400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b4a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b54cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39480/0 (socket says 172.21.15.31:39480) 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.032+0000 7f58f9e00700 1 -- 172.21.15.31:0/734718251 learned_addr learned my addr 172.21.15.31:0/734718251 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 -- 172.21.15.31:0/734718251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 msgr2=0x555f85b54cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b54cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 -- 172.21.15.31:0/734718251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 msgr2=0x555f85b5cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b5cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 -- 172.21.15.31:0/734718251 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f85b58e50 con 0x555f85b5ab40 2024-06-02T22:35:41.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58f9400700 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b4a0e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58e4097fe0 tx=0x7f58e409a090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08fbf00184dfee4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:41.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.033+0000 7f58e2a00700 1 -- 172.21.15.31:0/734718251 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40a9070 con 0x555f85b5ab40 2024-06-02T22:35:41.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f58e2a00700 1 -- 172.21.15.31:0/734718251 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58e409c280 con 0x555f85b5ab40 2024-06-02T22:35:41.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f58e2a00700 1 -- 172.21.15.31:0/734718251 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40cf3f0 con 0x555f85b5ab40 2024-06-02T22:35:41.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 -- 172.21.15.31:0/734718251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 msgr2=0x555f85b4a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b4a0e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58e4097fe0 tx=0x7f58e409a090 comp rx=0 tx=0).stop 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 -- 172.21.15.31:0/734718251 shutdown_connections 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b5cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b551f0 0x555f85b54cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 --2- 172.21.15.31:0/734718251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b5ab40 0x555f85b4a0e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 -- 172.21.15.31:0/734718251 >> 172.21.15.31:0/734718251 conn(0x555f85a81120 msgr2=0x555f85b5e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.034+0000 7f59070c3b80 1 -- 172.21.15.31:0/734718251 shutdown_connections 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.035+0000 7f59070c3b80 1 -- 172.21.15.31:0/734718251 wait complete. 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.035+0000 7f59070c3b80 1 -- start start 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.035+0000 7f59070c3b80 1 Processor -- start 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 0x555f85b64100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b64640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 0x555f85b7d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x555f85b741f0 con 0x555f85b5b460 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f85b73b20 con 0x555f85b551f0 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555f85b748c0 con 0x555f85b64b80 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f59070c3b80 10 client.0 _ll_register_callbacks cb 0x555f85a3c330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f58fa800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 0x555f85b7d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f58f9e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 0x555f85b64100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f58fa800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 0x555f85b7d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39496/0 (socket says 172.21.15.31:39496) 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f58fa800700 1 -- 172.21.15.31:0/983048765 learned_addr learned my addr 172.21.15.31:0/983048765 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.036+0000 7f58f9400700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b64640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 -- 172.21.15.31:0/983048765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 msgr2=0x555f85b7d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 0x555f85b7d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 -- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 msgr2=0x555f85b64640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b64640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 -- 172.21.15.31:0/983048765 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f85b4a3f0 con 0x555f85b551f0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58f9e00700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 0x555f85b64100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ca0 tx=0x7f58e8011f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=795db98c0b0c0b34 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58d7e00700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8005490 con 0x555f85b551f0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f58e8003680 con 0x555f85b551f0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.037+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58e409c280 con 0x555f85b551f0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58e803a050 con 0x555f85b551f0 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 10 client.25025 fetch_fsmap learned FSMap version 29 2024-06-02T22:35:41.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555f85be3740 con 0x555f85b551f0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58e409c280 con 0x555f85b551f0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58e8019850 con 0x555f85b551f0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 10 client.25025 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 10 client.25025 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 20 client.25025 populate_metadata read hostname 'smithi031' 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85be80c0 0x555f85be6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 4 client.25025 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "status"}) -- 0x555f85aae530 con 0x555f85be80c0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.038+0000 7f58f9400700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85be80c0 0x555f85be6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.039+0000 7f58f9400700 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85be80c0 0x555f85be6dd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c53ef83240d568 server_cookie=44ad8967277ab9d1 in_seq=0 out_seq=0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.039+0000 7f58d7e00700 10 client.25025 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.039+0000 7f58d7e00700 1 -- 172.21.15.31:0/983048765 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555f85aae530 con 0x555f85be80c0 2024-06-02T22:35:41.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.039+0000 7f58d7e00700 10 client.25025 handle_command_reply: tid=0 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.039+0000 7f59070c3b80 1 client.25025 shutdown 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 msgr2=0x555f85b64100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 0x555f85b64100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ca0 tx=0x7f58e8011f80 comp rx=0 tx=0).stop 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 shutdown_connections 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555f85b64b80 0x555f85b7d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x555f85be80c0 0x555f85be6dd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f85b551f0 0x555f85b64100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 --2- 172.21.15.31:0/983048765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x555f85b5b460 0x555f85b64640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f58d7e00700 0 client.25025 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 >> 172.21.15.31:0/983048765 conn(0x555f85a81120 msgr2=0x555f85b4fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 shutdown_connections 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 1 -- 172.21.15.31:0/983048765 wait complete. 2024-06-02T22:35:41.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.040+0000 7f59070c3b80 20 client.25025 trim_cache size 0 max 16384 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24517, 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 257.28267684399998, 2024-06-02T22:35:41.043 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 284.66903332099997 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 msgr2=0x7f58dc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 0x7f58dc0a5160 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009e60 tx=0x7f58f0006210 comp rx=0 tx=0).stop 2024-06-02T22:35:41.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 msgr2=0x7f58f419ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58e400eb30 tx=0x7f58e400ee40 comp rx=0 tx=0).stop 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 shutdown_connections 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58dc0a2ca0 0x7f58dc0a5160 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58f41084d0 0x7f58f4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f406aa00 0x7f58f419e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 --2- 172.21.15.31:0/2212914587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58f406b3a0 0x7f58f419ed80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 >> 172.21.15.31:0/2212914587 conn(0x7f58f4078330 msgr2=0x7f58f40ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 shutdown_connections 2024-06-02T22:35:41.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:41.041+0000 7f58fc800700 1 -- 172.21.15.31:0/2212914587 wait complete. 2024-06-02T22:35:41.887 INFO:tasks.cephadm:Setup complete, yielding 2024-06-02T22:35:41.888 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T22:35:41.899 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:35:41.899 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-02T22:35:42.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:41 smithi178 ceph-mon[36614]: pgmap v472: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:41 smithi031 ceph-mon[31767]: pgmap v472: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:41 smithi098 ceph-mon[36750]: pgmap v472: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:42.337 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:43 smithi178 ceph-mon[36614]: pgmap v473: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:43 smithi031 ceph-mon[31767]: pgmap v473: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:43 smithi098 ceph-mon[36750]: pgmap v473: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 -- 172.21.15.31:0/665963201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078090 msgr2=0x7fec6c078510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 --2- 172.21.15.31:0/665963201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078090 0x7fec6c078510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009990 tx=0x7fec5c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 -- 172.21.15.31:0/665963201 shutdown_connections 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 --2- 172.21.15.31:0/665963201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c078a50 0x7fec6c0792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 --2- 172.21.15.31:0/665963201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c076e40 0x7fec6c077260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 --2- 172.21.15.31:0/665963201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078090 0x7fec6c078510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 -- 172.21.15.31:0/665963201 >> 172.21.15.31:0/665963201 conn(0x7fec6c0ffca0 msgr2=0x7fec6c1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 -- 172.21.15.31:0/665963201 shutdown_connections 2024-06-02T22:35:44.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.822+0000 7fec74600700 1 -- 172.21.15.31:0/665963201 wait complete. 2024-06-02T22:35:44.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.823+0000 7fec74600700 1 Processor -- start 2024-06-02T22:35:44.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 -- start start 2024-06-02T22:35:44.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c076e40 0x7fec6c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:44.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:44.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078a50 0x7fec6c1a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c114780 con 0x7fec6c078a50 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c114600 con 0x7fec6c078090 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec74600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c114900 con 0x7fec6c076e40 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec72600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078a50 0x7fec6c1a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec71200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec71c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c076e40 0x7fec6c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec71200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:45386/0 (socket says 172.21.15.31:45386) 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.824+0000 7fec71200700 1 -- 172.21.15.31:0/2660241522 learned_addr learned my addr 172.21.15.31:0/2660241522 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 -- 172.21.15.31:0/2660241522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c076e40 msgr2=0x7fec6c19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c076e40 0x7fec6c19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 -- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078a50 msgr2=0x7fec6c1a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:44.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078a50 0x7fec6c1a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:44.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 -- 172.21.15.31:0/2660241522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c1a6980 con 0x7fec6c078090 2024-06-02T22:35:44.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec71200700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005910 tx=0x7fec5c00bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:44.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.825+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c026070 con 0x7fec6c078090 2024-06-02T22:35:44.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.826+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec5c003d70 con 0x7fec6c078090 2024-06-02T22:35:44.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.826+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c1a6c10 con 0x7fec6c078090 2024-06-02T22:35:44.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.826+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c021670 con 0x7fec6c078090 2024-06-02T22:35:44.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.826+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c1a70c0 con 0x7fec6c078090 2024-06-02T22:35:44.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.827+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c069180 con 0x7fec6c078090 2024-06-02T22:35:44.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.829+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fec5c029070 con 0x7fec6c078090 2024-06-02T22:35:44.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.830+0000 7fec6a000700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 0x7fec540a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:44.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.830+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fec5c0d06c0 con 0x7fec6c078090 2024-06-02T22:35:44.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.831+0000 7fec71c00700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 0x7fec540a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:44.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.831+0000 7fec71c00700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 0x7fec540a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec6c1a0210 tx=0x7fec60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:44.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:44.833+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fec5c030080 con 0x7fec6c078090 2024-06-02T22:35:45.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.083+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fec6c0628d0 con 0x7fec540a2ca0 2024-06-02T22:35:45.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.085+0000 7fec6a000700 1 -- 172.21.15.31:0/2660241522 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fec6c0628d0 con 0x7fec540a2ca0 2024-06-02T22:35:45.085 INFO:teuthology.orchestra.run.smithi031.stdout:Backend: cephadm 2024-06-02T22:35:45.085 INFO:teuthology.orchestra.run.smithi031.stdout:Available: Yes 2024-06-02T22:35:45.085 INFO:teuthology.orchestra.run.smithi031.stdout:Paused: No 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 msgr2=0x7fec540a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 0x7fec540a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec6c1a0210 tx=0x7fec60009260 comp rx=0 tx=0).stop 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 msgr2=0x7fec6c19f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005910 tx=0x7fec5c00bb90 comp rx=0 tx=0).stop 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 shutdown_connections 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fec540a2ca0 0x7fec540a5160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:45.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec6c078a50 0x7fec6c1a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec6c076e40 0x7fec6c19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 --2- 172.21.15.31:0/2660241522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec6c078090 0x7fec6c19f270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.089+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 >> 172.21.15.31:0/2660241522 conn(0x7fec6c0ffca0 msgr2=0x7fec6c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.090+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 shutdown_connections 2024-06-02T22:35:45.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:45.090+0000 7fec74600700 1 -- 172.21.15.31:0/2660241522 wait complete. 2024-06-02T22:35:46.025 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:45 smithi031 ceph-mon[31767]: pgmap v474: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:46.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:45 smithi178 ceph-mon[36614]: pgmap v474: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:46.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-02T22:35:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:45 smithi098 ceph-mon[36750]: pgmap v474: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:46.560 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:46.988 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:46 smithi031 ceph-mon[31767]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:47.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:46 smithi178 ceph-mon[36614]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:47.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:46 smithi098 ceph-mon[36750]: from='client.25031 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:47 smithi178 ceph-mon[36614]: pgmap v475: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:48.068 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:47 smithi031 ceph-mon[31767]: pgmap v475: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:47 smithi098 ceph-mon[36750]: pgmap v475: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 -- 172.21.15.31:0/1375325603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280109d30 msgr2=0x7fd28010a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 --2- 172.21.15.31:0/1375325603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280109d30 0x7fd28010a190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0099c0 tx=0x7fd26c009cd0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 -- 172.21.15.31:0/1375325603 shutdown_connections 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 --2- 172.21.15.31:0/1375325603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd28010a6d0 0x7fd280110f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 --2- 172.21.15.31:0/1375325603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd280108b30 0x7fd280108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 --2- 172.21.15.31:0/1375325603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280109d30 0x7fd28010a190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 -- 172.21.15.31:0/1375325603 >> 172.21.15.31:0/1375325603 conn(0x7fd280077b00 msgr2=0x7fd280079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 -- 172.21.15.31:0/1375325603 shutdown_connections 2024-06-02T22:35:48.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.942+0000 7fd287e00700 1 -- 172.21.15.31:0/1375325603 wait complete. 2024-06-02T22:35:48.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.943+0000 7fd287e00700 1 Processor -- start 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.943+0000 7fd287e00700 1 -- start start 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 0x7fd28019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 0x7fd2801a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd280114740 con 0x7fd280108b30 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2801145c0 con 0x7fd280109d30 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd287e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd2801148c0 con 0x7fd28010a6d0 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd285400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd285e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 0x7fd2801a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd284a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 0x7fd28019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd285e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 0x7fd2801a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39532/0 (socket says 172.21.15.31:39532) 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd285400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37736/0 (socket says 172.21.15.31:37736) 2024-06-02T22:35:48.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.944+0000 7fd285e00700 1 -- 172.21.15.31:0/1764888256 learned_addr learned my addr 172.21.15.31:0/1764888256 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:48.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 -- 172.21.15.31:0/1764888256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 msgr2=0x7fd2801a6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:48.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 0x7fd2801a6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 -- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 msgr2=0x7fd28019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 -- 172.21.15.31:0/1764888256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2801a6960 con 0x7fd280109d30 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd285400700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd284a00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 0x7fd28019f250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0098e0 tx=0x7fd26c009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c027070 con 0x7fd280109d30 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd26c022470 con 0x7fd280109d30 2024-06-02T22:35:48.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c009e60 con 0x7fd280109d30 2024-06-02T22:35:48.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.945+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2801a6bf0 con 0x7fd280109d30 2024-06-02T22:35:48.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.946+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2801a6ff0 con 0x7fd280109d30 2024-06-02T22:35:48.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.947+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28002dca0 con 0x7fd280109d30 2024-06-02T22:35:48.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.949+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd26c02a070 con 0x7fd280109d30 2024-06-02T22:35:48.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.950+0000 7fd27e000700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 0x7fd2640a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:48.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.950+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd26c0d0150 con 0x7fd280109d30 2024-06-02T22:35:48.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.950+0000 7fd285400700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 0x7fd2640a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:48.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.951+0000 7fd285400700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 0x7fd2640a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd2801a01f0 tx=0x7fd270009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:48.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:48.952+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd26c013070 con 0x7fd280109d30 2024-06-02T22:35:49.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.197+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd2800628d0 con 0x7fd2640a2ca0 2024-06-02T22:35:49.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.220+0000 7fd27e000700 1 -- 172.21.15.31:0/1764888256 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fd2800628d0 con 0x7fd2640a2ca0 2024-06-02T22:35:49.221 INFO:teuthology.orchestra.run.smithi031.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T22:35:49.221 INFO:teuthology.orchestra.run.smithi031.stdout:mds.a smithi031 running (4m) 2m ago 4m 24.8M - 19.0.0-2946-g3d89accf b045ac545f82 2511ce9313f8 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.b smithi098 running (4m) 2m ago 4m 16.4M - 19.0.0-2946-g3d89accf b045ac545f82 c3a6a2fb06c7 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.c smithi178 running (5m) 2m ago 5m 17.5M - 19.0.0-2946-g3d89accf b045ac545f82 337a3ba9741f 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.d smithi031 running (5m) 2m ago 5m 12.9M - 19.0.0-2946-g3d89accf b045ac545f82 db78413fcb65 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.e smithi098 running (5m) 2m ago 5m 15.2M - 19.0.0-2946-g3d89accf b045ac545f82 6467bcb6935a 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.f smithi178 running (5m) 2m ago 5m 19.2M - 19.0.0-2946-g3d89accf b045ac545f82 d30353754129 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.g smithi031 running (4m) 2m ago 4m 16.4M - 19.0.0-2946-g3d89accf b045ac545f82 6df0c493ca23 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.h smithi098 running (5m) 2m ago 5m 16.0M - 19.0.0-2946-g3d89accf b045ac545f82 daf652c1ae34 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.i smithi178 running (5m) 2m ago 5m 18.9M - 19.0.0-2946-g3d89accf b045ac545f82 66a611c848eb 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.j smithi031 running (5m) 2m ago 5m 14.8M - 19.0.0-2946-g3d89accf b045ac545f82 4fdbd2d526f9 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.k smithi098 running (5m) 2m ago 5m 13.7M - 19.0.0-2946-g3d89accf b045ac545f82 4ff0d8065575 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mds.l smithi178 running (5m) 2m ago 5m 16.2M - 19.0.0-2946-g3d89accf b045ac545f82 fc4473041aee 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.x smithi031 *:9283,8765 running (13m) 2m ago 13m 516M - 19.0.0-2946-g3d89accf b045ac545f82 1c55eec3fbd5 2024-06-02T22:35:49.222 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.y smithi098 *:8443,8765 running (11m) 2m ago 11m 453M - 19.0.0-2946-g3d89accf b045ac545f82 641c20844e4d 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:mgr.z smithi178 *:8443,8765 running (11m) 2m ago 11m 456M - 19.0.0-2946-g3d89accf b045ac545f82 3bdf1f1f5e3e 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:mon.a smithi031 running (14m) 2m ago 14m 48.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 5ed4a58e04a6 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:mon.b smithi098 running (11m) 2m ago 11m 42.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 480b3f60b0f5 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:mon.c smithi178 running (11m) 2m ago 11m 43.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 0db558e3df7c 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 smithi031 running (11m) 2m ago 11m 47.3M 4273M 19.0.0-2946-g3d89accf b045ac545f82 19fa8304113a 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 smithi098 running (10m) 2m ago 10m 57.9M 4272M 19.0.0-2946-g3d89accf b045ac545f82 54487b007583 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 smithi178 running (10m) 2m ago 10m 45.7M 4272M 19.0.0-2946-g3d89accf b045ac545f82 770ec441a93e 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 smithi031 running (9m) 2m ago 9m 55.1M 4273M 19.0.0-2946-g3d89accf b045ac545f82 985758f104b4 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 smithi098 running (9m) 2m ago 9m 55.5M 4272M 19.0.0-2946-g3d89accf b045ac545f82 af175ccf4b21 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 smithi178 running (8m) 2m ago 8m 55.8M 4272M 19.0.0-2946-g3d89accf b045ac545f82 50d8b9e03ef0 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 smithi031 running (8m) 2m ago 8m 41.4M 4273M 19.0.0-2946-g3d89accf b045ac545f82 8739b8559632 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 smithi098 running (7m) 2m ago 7m 44.0M 4272M 19.0.0-2946-g3d89accf b045ac545f82 7d484908dd82 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.8 smithi178 running (7m) 2m ago 7m 53.0M 4272M 19.0.0-2946-g3d89accf b045ac545f82 c98c08109731 2024-06-02T22:35:49.223 INFO:teuthology.orchestra.run.smithi031.stdout:osd.9 smithi031 running (6m) 2m ago 6m 55.4M 4273M 19.0.0-2946-g3d89accf b045ac545f82 ea87695e7861 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd.10 smithi098 running (6m) 2m ago 6m 56.9M 4272M 19.0.0-2946-g3d89accf b045ac545f82 84a10dca0c6d 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stdout:osd.11 smithi178 running (5m) 2m ago 5m 42.6M 4272M 19.0.0-2946-g3d89accf b045ac545f82 1e1b9b2f713f 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 msgr2=0x7fd2640a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 0x7fd2640a5160 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd2801a01f0 tx=0x7fd270009260 comp rx=0 tx=0).stop 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 msgr2=0x7fd28019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 0x7fd28019f250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0098e0 tx=0x7fd26c009580 comp rx=0 tx=0).stop 2024-06-02T22:35:49.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 shutdown_connections 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd2640a2ca0 0x7fd2640a5160 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd28010a6d0 0x7fd2801a6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd280108b30 0x7fd28019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 --2- 172.21.15.31:0/1764888256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd280109d30 0x7fd28019f250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 >> 172.21.15.31:0/1764888256 conn(0x7fd280077b00 msgr2=0x7fd28010d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 shutdown_connections 2024-06-02T22:35:49.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:49.224+0000 7fd287e00700 1 -- 172.21.15.31:0/1764888256 wait complete. 2024-06-02T22:35:49.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:49 smithi031 ceph-mon[31767]: pgmap v476: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:49 smithi178 ceph-mon[36614]: pgmap v476: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:50.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-02T22:35:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:49 smithi098 ceph-mon[36750]: pgmap v476: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:50.639 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:51.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:50 smithi178 ceph-mon[36614]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:51.114 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:50 smithi098 ceph-mon[36750]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:51.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:50 smithi031 ceph-mon[31767]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:51 smithi178 ceph-mon[36614]: pgmap v477: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:52.069 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:51 smithi031 ceph-mon[31767]: pgmap v477: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:51 smithi098 ceph-mon[36750]: pgmap v477: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:35:52.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.949+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3366462584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 msgr2=0x7fd3b8075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.949+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3366462584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b8075370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009990 tx=0x7fd3a0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3366462584 shutdown_connections 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3366462584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b810a3d0 0x7fd3b810c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3366462584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b80764c0 0x7fd3b8074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3366462584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b8075370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3366462584 >> 172.21.15.31:0/3366462584 conn(0x7fd3b80fda60 msgr2=0x7fd3b80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3366462584 shutdown_connections 2024-06-02T22:35:52.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.950+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3366462584 wait complete. 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.951+0000 7fd3bdc00700 1 Processor -- start 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.951+0000 7fd3bdc00700 1 -- start start 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 0x7fd3b819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8110330 con 0x7fd3b810a3d0 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b81101b0 con 0x7fd3b80764c0 2024-06-02T22:35:52.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3bdc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b81104b0 con 0x7fd3b8074ef0 2024-06-02T22:35:52.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3b7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:52.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3b7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59660/0 (socket says 172.21.15.31:59660) 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3b6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3b7400700 1 -- 172.21.15.31:0/3046039815 learned_addr learned my addr 172.21.15.31:0/3046039815 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.952+0000 7fd3ae000700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 0x7fd3b819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 -- 172.21.15.31:0/3046039815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 msgr2=0x7fd3b819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 -- 172.21.15.31:0/3046039815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 msgr2=0x7fd3b819af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 0x7fd3b819af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 -- 172.21.15.31:0/3046039815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b81a25e0 con 0x7fd3b810a3d0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3ae000700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 0x7fd3b819af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3b7400700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000c3a0 tx=0x7fd3b000c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00092e0 con 0x7fd3b810a3d0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b81a2870 con 0x7fd3b810a3d0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b000cb90 con 0x7fd3b810a3d0 2024-06-02T22:35:52.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00047f0 con 0x7fd3b810a3d0 2024-06-02T22:35:52.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.953+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b81a2db0 con 0x7fd3b810a3d0 2024-06-02T22:35:52.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.955+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b8069180 con 0x7fd3b810a3d0 2024-06-02T22:35:52.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.957+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fd3b001a020 con 0x7fd3b810a3d0 2024-06-02T22:35:52.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.958+0000 7fd3afe00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 0x7fd3980a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:52.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.958+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd3b00ceca0 con 0x7fd3b810a3d0 2024-06-02T22:35:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.958+0000 7fd3b6a00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 0x7fd3980a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:52.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.959+0000 7fd3b6a00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 0x7fd3980a5160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80768a0 tx=0x7fd3a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:52.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:52.963+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd3b0010040 con 0x7fd3b810a3d0 2024-06-02T22:35:53.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.208+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd3b80628d0 con 0x7fd3980a2ca0 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.221+0000 7fd3afe00700 1 -- 172.21.15.31:0/3046039815 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd3b80628d0 con 0x7fd3980a2ca0 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stdout:mds.all 12/12 2m ago 5m smithi031=a;smithi031=d;smithi031=g;smithi031=j;smithi098=b;smithi098=e;smithi098=h;smithi098=k;smithi178=c;smithi178=f;smithi178=i;smithi178=l;count:12 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stdout:mgr 3/3 2m ago 11m smithi031=x;smithi098=y;smithi178=z;count:3 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stdout:mon 3/3 2m ago 12m smithi031:172.21.15.31=a;smithi098:172.21.15.98=b;smithi178:172.21.15.178=c;count:3 2024-06-02T22:35:53.221 INFO:teuthology.orchestra.run.smithi031.stdout:osd 12 2m ago - 2024-06-02T22:35:53.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.224+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 msgr2=0x7fd3980a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:53.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.224+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 0x7fd3980a5160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80768a0 tx=0x7fd3a8009260 comp rx=0 tx=0).stop 2024-06-02T22:35:53.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.224+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 msgr2=0x7fd3b81a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.224+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000c3a0 tx=0x7fd3b000c6b0 comp rx=0 tx=0).stop 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 shutdown_connections 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd3980a2ca0 0x7fd3980a5160 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3b810a3d0 0x7fd3b81a1f40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3b8074ef0 0x7fd3b819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 --2- 172.21.15.31:0/3046039815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd3b80764c0 0x7fd3b819af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 >> 172.21.15.31:0/3046039815 conn(0x7fd3b80fda60 msgr2=0x7fd3b81062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 shutdown_connections 2024-06-02T22:35:53.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:53.225+0000 7fd3bdc00700 1 -- 172.21.15.31:0/3046039815 wait complete. 2024-06-02T22:35:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:53 smithi178 ceph-mon[36614]: pgmap v478: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:53 smithi031 ceph-mon[31767]: pgmap v478: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:53 smithi098 ceph-mon[36750]: pgmap v478: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:35:54.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-02T22:35:54.701 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:55.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:54 smithi178 ceph-mon[36614]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:55.094 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:54 smithi031 ceph-mon[31767]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:55.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:54 smithi098 ceph-mon[36750]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:55 smithi178 ceph-mon[36614]: pgmap v479: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:55 smithi031 ceph-mon[31767]: pgmap v479: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:55 smithi098 ceph-mon[36750]: pgmap v479: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:35:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 -- 172.21.15.31:0/957074193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8401036e0 msgr2=0x7fc840105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 --2- 172.21.15.31:0/957074193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8401036e0 0x7fc840105b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009990 tx=0x7fc82c009ca0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 -- 172.21.15.31:0/957074193 shutdown_connections 2024-06-02T22:35:57.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 --2- 172.21.15.31:0/957074193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 0x7fc840106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 --2- 172.21.15.31:0/957074193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc840100d70 0x7fc8401031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 --2- 172.21.15.31:0/957074193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8401036e0 0x7fc840105b70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 -- 172.21.15.31:0/957074193 >> 172.21.15.31:0/957074193 conn(0x7fc8400fc9b0 msgr2=0x7fc8400fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.107+0000 7fc846c00700 1 -- 172.21.15.31:0/957074193 shutdown_connections 2024-06-02T22:35:57.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.108+0000 7fc846c00700 1 -- 172.21.15.31:0/957074193 wait complete. 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 Processor -- start 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 -- start start 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840100d70 0x7fc84019ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 0x7fc8401a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc840114680 con 0x7fc8401036e0 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc840114500 con 0x7fc840100d70 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc846c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc840114800 con 0x7fc8401060b0 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.109+0000 7fc83f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59674/0 (socket says 172.21.15.31:59674) 2024-06-02T22:35:57.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 -- 172.21.15.31:0/832884159 learned_addr learned my addr 172.21.15.31:0/832884159 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:35:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83fe00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840100d70 0x7fc84019ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc844c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 0x7fc8401a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 -- 172.21.15.31:0/832884159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 msgr2=0x7fc8401a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 0x7fc8401a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 -- 172.21.15.31:0/832884159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840100d70 msgr2=0x7fc84019ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840100d70 0x7fc84019ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 -- 172.21.15.31:0/832884159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8401a6930 con 0x7fc8401036e0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.110+0000 7fc83f400700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005910 tx=0x7fc82c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.111+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c026070 con 0x7fc8401036e0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.111+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc82c00f460 con 0x7fc8401036e0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.111+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8401a6bc0 con 0x7fc8401036e0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.111+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c021670 con 0x7fc8401036e0 2024-06-02T22:35:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.111+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8401a7120 con 0x7fc8401036e0 2024-06-02T22:35:57.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.112+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc840069180 con 0x7fc8401036e0 2024-06-02T22:35:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.115+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc82c029070 con 0x7fc8401036e0 2024-06-02T22:35:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.116+0000 7fc83cc00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 0x7fc8240a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:35:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.116+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc82c0d0350 con 0x7fc8401036e0 2024-06-02T22:35:57.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.116+0000 7fc83fe00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 0x7fc8240a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:35:57.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.117+0000 7fc83fe00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 0x7fc8240a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc8401a01c0 tx=0x7fc830009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:35:57.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.121+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc82c013070 con 0x7fc8401036e0 2024-06-02T22:35:57.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.358+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc8400628d0 con 0x7fc8240a2ca0 2024-06-02T22:35:57.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.361+0000 7fc83cc00700 1 -- 172.21.15.31:0/832884159 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc8400628d0 con 0x7fc8240a2ca0 2024-06-02T22:35:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:HOST ADDR LABELS STATUS 2024-06-02T22:35:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031 172.21.15.31 2024-06-02T22:35:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:smithi098 172.21.15.98 2024-06-02T22:35:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:smithi178 172.21.15.178 2024-06-02T22:35:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:3 hosts in cluster 2024-06-02T22:35:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 msgr2=0x7fc8240a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 0x7fc8240a5160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc8401a01c0 tx=0x7fc830009260 comp rx=0 tx=0).stop 2024-06-02T22:35:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 msgr2=0x7fc84019f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:35:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005910 tx=0x7fc82c00bb90 comp rx=0 tx=0).stop 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 shutdown_connections 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc8240a2ca0 0x7fc8240a5160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8401060b0 0x7fc8401a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc840100d70 0x7fc84019ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 --2- 172.21.15.31:0/832884159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8401036e0 0x7fc84019f220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:35:57.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 >> 172.21.15.31:0/832884159 conn(0x7fc8400fc9b0 msgr2=0x7fc840101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:35:57.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 shutdown_connections 2024-06-02T22:35:57.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:35:57.365+0000 7fc846c00700 1 -- 172.21.15.31:0/832884159 wait complete. 2024-06-02T22:35:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:57 smithi031 ceph-mon[31767]: pgmap v480: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:58.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:57 smithi098 ceph-mon[36750]: pgmap v480: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:57 smithi178 ceph-mon[36614]: pgmap v480: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:35:58.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-02T22:35:58.861 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:35:59.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:58 smithi031 ceph-mon[31767]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:58 smithi098 ceph-mon[36750]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:35:59.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:58 smithi178 ceph-mon[36614]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:35:59 smithi031 ceph-mon[31767]: pgmap v481: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:35:59 smithi098 ceph-mon[36750]: pgmap v481: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:35:59 smithi178 ceph-mon[36614]: pgmap v481: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 -- 172.21.15.31:0/1975789262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc37010a6e0 msgr2=0x7fc370110f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 --2- 172.21.15.31:0/1975789262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc37010a6e0 0x7fc370110f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc36800b0d0 tx=0x7fc36800b3e0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 -- 172.21.15.31:0/1975789262 shutdown_connections 2024-06-02T22:36:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 --2- 172.21.15.31:0/1975789262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc37010a6e0 0x7fc370110f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 --2- 172.21.15.31:0/1975789262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc370108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 --2- 172.21.15.31:0/1975789262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc370109d40 0x7fc37010a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 -- 172.21.15.31:0/1975789262 >> 172.21.15.31:0/1975789262 conn(0x7fc370077b10 msgr2=0x7fc370079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 -- 172.21.15.31:0/1975789262 shutdown_connections 2024-06-02T22:36:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.472+0000 7fc376800700 1 -- 172.21.15.31:0/1975789262 wait complete. 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.474+0000 7fc376800700 1 Processor -- start 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.474+0000 7fc376800700 1 -- start start 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc370109d40 0x7fc37019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37010a6e0 0x7fc3701a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc370114710 con 0x7fc370109d40 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc370114590 con 0x7fc370108b40 2024-06-02T22:36:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc376800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc370114890 con 0x7fc37010a6e0 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36ea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc370109d40 0x7fc37019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:49776/0 (socket says 172.21.15.31:49776) 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 -- 172.21.15.31:0/2988838277 learned_addr learned my addr 172.21.15.31:0/2988838277 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36fe00700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37010a6e0 0x7fc3701a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 -- 172.21.15.31:0/2988838277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37010a6e0 msgr2=0x7fc3701a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37010a6e0 0x7fc3701a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 -- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc370109d40 msgr2=0x7fc37019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.475+0000 7fc36f400700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc370109d40 0x7fc37019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc36f400700 1 -- 172.21.15.31:0/2988838277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3701a68e0 con 0x7fc370108b40 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc36f400700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e970 tx=0x7fc36000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360004220 con 0x7fc370108b40 2024-06-02T22:36:01.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3701a6bd0 con 0x7fc370108b40 2024-06-02T22:36:01.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3600043c0 con 0x7fc370108b40 2024-06-02T22:36:01.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360003dc0 con 0x7fc370108b40 2024-06-02T22:36:01.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.476+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3701a7160 con 0x7fc370108b40 2024-06-02T22:36:01.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.478+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc370069180 con 0x7fc370108b40 2024-06-02T22:36:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.480+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc36000c7e0 con 0x7fc370108b40 2024-06-02T22:36:01.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.481+0000 7fc367e00700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 0x7fc3540a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:01.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.481+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc3600cf690 con 0x7fc370108b40 2024-06-02T22:36:01.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.482+0000 7fc36ea00700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 0x7fc3540a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.482+0000 7fc36ea00700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 0x7fc3540a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3701a0170 tx=0x7fc35c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:01.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.483+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc36009c290 con 0x7fc370108b40 2024-06-02T22:36:01.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.723+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc3700628d0 con 0x7fc3540a2c20 2024-06-02T22:36:01.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.726+0000 7fc367e00700 1 -- 172.21.15.31:0/2988838277 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc3700628d0 con 0x7fc3540a2c20 2024-06-02T22:36:01.725 INFO:teuthology.orchestra.run.smithi031.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-02T22:36:01.725 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53310008400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-06-02T22:36:01.725 INFO:teuthology.orchestra.run.smithi031.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-06-02T22:36:01.726 INFO:teuthology.orchestra.run.smithi031.stdout:smithi178 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130029480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-06-02T22:36:01.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 msgr2=0x7fc3540a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:01.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 0x7fc3540a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3701a0170 tx=0x7fc35c009260 comp rx=0 tx=0).stop 2024-06-02T22:36:01.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 msgr2=0x7fc37019ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:01.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc36000e970 tx=0x7fc36000ec80 comp rx=0 tx=0).stop 2024-06-02T22:36:01.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 shutdown_connections 2024-06-02T22:36:01.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc3540a2c20 0x7fc3540a50e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc37010a6e0 0x7fc3701a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc370108b40 0x7fc37019ec60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 --2- 172.21.15.31:0/2988838277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc370109d40 0x7fc37019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:01.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.729+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 >> 172.21.15.31:0/2988838277 conn(0x7fc370077b10 msgr2=0x7fc37010cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:01.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.730+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 shutdown_connections 2024-06-02T22:36:01.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:01.730+0000 7fc376800700 1 -- 172.21.15.31:0/2988838277 wait complete. 2024-06-02T22:36:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:01 smithi031 ceph-mon[31767]: pgmap v482: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:01 smithi098 ceph-mon[36750]: pgmap v482: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:01 smithi178 ceph-mon[36614]: pgmap v482: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:02.535 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T22:36:02.546 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:36:02.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T22:36:03.032 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:03.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:02 smithi031 ceph-mon[31767]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:03.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:02 smithi098 ceph-mon[36750]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:03.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:02 smithi178 ceph-mon[36614]: from='client.25055 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:03 smithi031 ceph-mon[31767]: pgmap v483: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:03 smithi098 ceph-mon[36750]: pgmap v483: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:03 smithi178 ceph-mon[36614]: pgmap v483: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.730+0000 7f3cbaa00700 1 -- 172.21.15.31:0/987101395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4077470 msgr2=0x7f3cb40792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:05.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.730+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/987101395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4077470 0x7f3cb40792d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009f90 tx=0x7f3cac00b330 comp rx=0 tx=0).stop 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.730+0000 7f3cbaa00700 1 -- 172.21.15.31:0/987101395 shutdown_connections 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.730+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/987101395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4077470 0x7f3cb40792d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.731+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/987101395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4078520 0x7f3cb4078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.731+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/987101395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4076ab0 0x7f3cb4076f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.731+0000 7f3cbaa00700 1 -- 172.21.15.31:0/987101395 >> 172.21.15.31:0/987101395 conn(0x7f3cb40ffc50 msgr2=0x7f3cb41020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.731+0000 7f3cbaa00700 1 -- 172.21.15.31:0/987101395 shutdown_connections 2024-06-02T22:36:05.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.731+0000 7f3cbaa00700 1 -- 172.21.15.31:0/987101395 wait complete. 2024-06-02T22:36:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 Processor -- start 2024-06-02T22:36:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 -- start start 2024-06-02T22:36:05.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 0x7f3cb419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 0x7f3cb419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4114800 con 0x7f3cb4076ab0 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4114680 con 0x7f3cb4078520 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.732+0000 7f3cbaa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4114980 con 0x7f3cb4077470 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 0x7f3cb419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb3e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 0x7f3cb419ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56288/0 (socket says 172.21.15.31:56288) 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:49790/0 (socket says 172.21.15.31:49790) 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb3e00700 1 -- 172.21.15.31:0/2283301272 learned_addr learned my addr 172.21.15.31:0/2283301272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb3400700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 0x7f3cb419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 -- 172.21.15.31:0/2283301272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 msgr2=0x7f3cb419f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 0x7f3cb419f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 -- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 msgr2=0x7f3cb419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 0x7f3cb419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 -- 172.21.15.31:0/2283301272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb41a6990 con 0x7f3cb4078520 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb3400700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 0x7f3cb419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.733+0000 7f3cb8a00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00b6c0 tx=0x7f3cac007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.734+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac021020 con 0x7f3cb4078520 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.734+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cac004e40 con 0x7f3cb4078520 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.734+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41a6c20 con 0x7f3cb4078520 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.734+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0052d0 con 0x7f3cb4078520 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.734+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a70d0 con 0x7f3cb4078520 2024-06-02T22:36:05.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.735+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb4069180 con 0x7f3cb4078520 2024-06-02T22:36:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.737+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3cac024020 con 0x7f3cb4078520 2024-06-02T22:36:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.739+0000 7f3cb0c00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 0x7f3c980a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.739+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3cac00f020 con 0x7f3cb4078520 2024-06-02T22:36:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.739+0000 7f3cb3e00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 0x7f3c980a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.740+0000 7f3cb3e00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 0x7f3c980a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4005950 tx=0x7f3ca4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:05.741+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3cac09d4a0 con 0x7f3cb4078520 2024-06-02T22:36:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.026+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3cb402dca0 con 0x7f3cb4078520 2024-06-02T22:36:06.027 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:05 smithi031 ceph-mon[31767]: pgmap v484: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.027+0000 7f3cb0c00700 1 -- 172.21.15.31:0/2283301272 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3092 (secure 0 0 0) 0x7f3cac09cda0 con 0x7f3cb4078520 2024-06-02T22:36:06.029 INFO:teuthology.orchestra.run.smithi031.stdout:e29 2024-06-02T22:36:06.029 INFO:teuthology.orchestra.run.smithi031.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T22:36:06.029 INFO:teuthology.orchestra.run.smithi031.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T22:36:06.029 INFO:teuthology.orchestra.run.smithi031.stdout:legacy client fscid: 1 2024-06-02T22:36:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem 'cephfs' (1) 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:fs_name cephfs 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 29 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-06-02T22:31:23.645237+0000 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-06-02T22:32:54.555737+0000 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:tableserver 0 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:root 0 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:session_timeout 300 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:session_autoclose 300 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:max_file_size 1099511627776 2024-06-02T22:36:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:max_xattr_size 65536 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:required_client_features {} 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure 0 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:last_failure_osd_epoch 0 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:max_mds 5 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:in 0,1,2,3,4 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:up {0=24517,1=24505,2=24503,3=24499,4=24484} 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:failed 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:damaged 2024-06-02T22:36:06.031 INFO:teuthology.orchestra.run.smithi031.stdout:stopped 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:data_pools [3,4] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:metadata_pool 2 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:inline_data disabled 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:balancer 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:bal_rank_mask -1 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:standby_count_wanted 0 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:qdb_cluster leader: 24517 members: 24484,24505,24499,24503,24517 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a{0:24517} state up:active seq 8 addr [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.f{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.178:6834/262655409,v1:172.21.15.178:6835/262655409] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.g{1:24505} state up:active seq 30 addr [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.h{1:24461} state up:standby-replay seq 1 addr [v2:172.21.15.98:6836/511134673,v1:172.21.15.98:6837/511134673] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b{2:24503} state up:active seq 29 addr [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.e{2:24449} state up:standby-replay seq 1 addr [v2:172.21.15.98:6834/2455073763,v1:172.21.15.98:6835/2455073763] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.032 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.i{3:24499} state up:active seq 32 addr [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.l{3:24439} state up:standby-replay seq 1 addr [v2:172.21.15.178:6832/1728134779,v1:172.21.15.178:6833/1728134779] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c{4:24484} state up:active seq 34 addr [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.j{4:24431} state up:standby-replay seq 1 addr [v2:172.21.15.31:6834/2351522534,v1:172.21.15.31:6835/2351522534] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:Standby daemons: 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d{-1:14367} state up:standby seq 1 addr [v2:172.21.15.31:6836/3658195000,v1:172.21.15.31:6837/3658195000] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.033 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.k{-1:24419} state up:standby seq 1 addr [v2:172.21.15.98:6832/3988257834,v1:172.21.15.98:6833/3988257834] compat {c=[1],r=[1],i=[1fff]}] 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.030+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 msgr2=0x7f3c980a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.030+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 0x7f3c980a50e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4005950 tx=0x7f3ca4009310 comp rx=0 tx=0).stop 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.030+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 msgr2=0x7f3cb41a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.030+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00b6c0 tx=0x7f3cac007c70 comp rx=0 tx=0).stop 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 shutdown_connections 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3c980a2c20 0x7f3c980a50e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3cb4078520 0x7f3cb41a62f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb4076ab0 0x7f3cb419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 --2- 172.21.15.31:0/2283301272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cb4077470 0x7f3cb419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 >> 172.21.15.31:0/2283301272 conn(0x7f3cb40ffc50 msgr2=0x7f3cb4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 shutdown_connections 2024-06-02T22:36:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:06.031+0000 7f3cbaa00700 1 -- 172.21.15.31:0/2283301272 wait complete. 2024-06-02T22:36:06.035 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:36:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:05 smithi098 ceph-mon[36750]: pgmap v484: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:05 smithi178 ceph-mon[36614]: pgmap v484: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:07.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-02T22:36:07.103 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:06 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2283301272' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T22:36:07.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:06 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2283301272' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T22:36:07.213 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:06 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2283301272' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T22:36:07.506 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:08.003 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:07 smithi031 ceph-mon[31767]: pgmap v485: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:07 smithi098 ceph-mon[36750]: pgmap v485: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:07 smithi178 ceph-mon[36614]: pgmap v485: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 -- 172.21.15.31:0/1949874117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc103000 msgr2=0x7f8fcc1053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/1949874117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc103000 0x7f8fcc1053f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc009990 tx=0x7f8fbc009ca0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 -- 172.21.15.31:0/1949874117 shutdown_connections 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/1949874117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 0x7f8fcc10a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/1949874117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc103000 0x7f8fcc1053f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/1949874117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc105930 0x7f8fcc107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 -- 172.21.15.31:0/1949874117 >> 172.21.15.31:0/1949874117 conn(0x7f8fcc0fc990 msgr2=0x7f8fcc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:09.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 -- 172.21.15.31:0/1949874117 shutdown_connections 2024-06-02T22:36:09.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.966+0000 7f8fd0a00700 1 -- 172.21.15.31:0/1949874117 wait complete. 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.967+0000 7f8fd0a00700 1 Processor -- start 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 -- start start 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 0x7f8fcc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 0x7f8fcc1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10e110 con 0x7f8fcc103000 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10df90 con 0x7f8fcc108260 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fd0a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc10e290 con 0x7f8fcc105930 2024-06-02T22:36:09.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fc9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 0x7f8fcc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:09.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fc9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:09.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fc9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:44902/0 (socket says 172.21.15.31:44902) 2024-06-02T22:36:09.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fc9400700 1 -- 172.21.15.31:0/3993219422 learned_addr learned my addr 172.21.15.31:0/3993219422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:09.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.968+0000 7f8fca800700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 0x7f8fcc1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 -- 172.21.15.31:0/3993219422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 msgr2=0x7f8fcc1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 0x7f8fcc1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 -- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 msgr2=0x7f8fcc19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 0x7f8fcc19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 -- 172.21.15.31:0/3993219422 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc1a25d0 con 0x7f8fcc105930 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9e00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 0x7f8fcc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.969+0000 7f8fc9400700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e9d0 tx=0x7f8fb800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.970+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800cbd0 con 0x7f8fcc105930 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.970+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fb800ee70 con 0x7f8fcc105930 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.970+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc1a28c0 con 0x7f8fcc105930 2024-06-02T22:36:09.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.970+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8018660 con 0x7f8fcc105930 2024-06-02T22:36:09.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.970+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc1a2e50 con 0x7f8fcc105930 2024-06-02T22:36:09.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.971+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc069180 con 0x7f8fcc105930 2024-06-02T22:36:09.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.974+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8fb8010430 con 0x7f8fcc105930 2024-06-02T22:36:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.975+0000 7f8fc2a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 0x7f8fb00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.975+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8fb80cf920 con 0x7f8fcc105930 2024-06-02T22:36:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.975+0000 7f8fc9e00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 0x7f8fb00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.976+0000 7f8fc9e00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 0x7f8fb00a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00b7b0 tx=0x7f8fbc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:09.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:09.977+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8fb809c490 con 0x7f8fcc105930 2024-06-02T22:36:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:09 smithi031 ceph-mon[31767]: pgmap v486: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:09 smithi098 ceph-mon[36750]: pgmap v486: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:10.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.214+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f8fcc0630a0 con 0x7f8fcc105930 2024-06-02T22:36:10.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.216+0000 7f8fc2a00700 1 -- 172.21.15.31:0/3993219422 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v99) ==== 56+0+5643 (secure 0 0 0) 0x7f8fb800cd70 con 0x7f8fcc105930 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 99 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:fsid 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-06-02T22:21:34.835242+0000 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:modified 2024-06-02T22:32:56.484738+0000 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:crush_version 27 2024-06-02T22:36:10.217 INFO:teuthology.orchestra.run.smithi031.stdout:full_ratio 0.95 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:backfillfull_ratio 0.9 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:nearfull_ratio 0.85 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:require_min_compat_client luminous 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:min_compat_client luminous 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:require_osd_release squid 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:stretch_mode_enabled false 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 95 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:max_osd 12 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6802/487181160,v1:172.21.15.31:6803/487181160] [v2:172.21.15.31:6804/487181160,v1:172.21.15.31:6805/487181160] exists,up a2e6dbbc-b92f-48c1-a685-7b8927abae1f 2024-06-02T22:36:10.218 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 up in weight 1 up_from 13 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/1503486625,v1:172.21.15.98:6801/1503486625] [v2:172.21.15.98:6802/1503486625,v1:172.21.15.98:6803/1503486625] exists,up 16a77b57-663a-4221-97c9-5548c8b17528 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 up in weight 1 up_from 18 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6800/2072394322,v1:172.21.15.178:6801/2072394322] [v2:172.21.15.178:6802/2072394322,v1:172.21.15.178:6803/2072394322] exists,up ce3e9128-3ac7-4e85-a8d0-5d39b8808e03 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 up in weight 1 up_from 25 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6810/3409524597,v1:172.21.15.31:6811/3409524597] [v2:172.21.15.31:6812/3409524597,v1:172.21.15.31:6813/3409524597] exists,up d77d2d54-6910-4ed7-83b0-35edc54a34d1 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 up in weight 1 up_from 33 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/4148113847,v1:172.21.15.98:6809/4148113847] [v2:172.21.15.98:6810/4148113847,v1:172.21.15.98:6811/4148113847] exists,up 947b323e-fd09-4b93-a09f-e5096507d984 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 up in weight 1 up_from 38 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6808/1564865420,v1:172.21.15.178:6809/1564865420] [v2:172.21.15.178:6810/1564865420,v1:172.21.15.178:6811/1564865420] exists,up d33c02c1-01bb-4a7c-ab07-14be9d3bafb0 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 up in weight 1 up_from 46 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6818/3425159606,v1:172.21.15.31:6819/3425159606] [v2:172.21.15.31:6820/3425159606,v1:172.21.15.31:6821/3425159606] exists,up 453bcd2d-d571-44c6-8bb1-dc611d2a5e0b 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 up in weight 1 up_from 51 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/1807036424,v1:172.21.15.98:6817/1807036424] [v2:172.21.15.98:6818/1807036424,v1:172.21.15.98:6819/1807036424] exists,up 6dd6941e-24c9-4b1d-8825-c33834a434da 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.8 up in weight 1 up_from 59 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6816/2113425738,v1:172.21.15.178:6817/2113425738] [v2:172.21.15.178:6818/2113425738,v1:172.21.15.178:6819/2113425738] exists,up cc697acf-ed41-4b2d-ae99-bfe3992cd0c7 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.9 up in weight 1 up_from 67 up_thru 98 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6826/3616812337,v1:172.21.15.31:6827/3616812337] [v2:172.21.15.31:6828/3616812337,v1:172.21.15.31:6829/3616812337] exists,up 9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.10 up in weight 1 up_from 72 up_thru 98 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/810778248,v1:172.21.15.98:6825/810778248] [v2:172.21.15.98:6826/810778248,v1:172.21.15.98:6827/810778248] exists,up 668ead78-dca3-48e3-8096-b743361599db 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:osd.11 up in weight 1 up_from 80 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6824/2684096429,v1:172.21.15.178:6825/2684096429] [v2:172.21.15.178:6826/2684096429,v1:172.21.15.178:6827/2684096429] exists,up fbafbaf7-677b-4af5-ad84-e68f9ab5221a 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 2.5 [8,11] 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 2.13 [2,11] 2024-06-02T22:36:10.219 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 2.14 [2,4] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 3.b [3,9] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 3.1d [4,8] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 3.33 [5,9] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 3.36 [4,9] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 3.3a [4,6] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 4.2 [9,1] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 4.e [9,11] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 4.18 [9,8] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_upmap_items 4.1a [5,8] 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/1942203888 expires 2024-06-03T22:22:54.073541+0000 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:6801/4252327404 expires 2024-06-03T22:22:54.073541+0000 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:6800/4252327404 expires 2024-06-03T22:22:54.073541+0000 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/1083714701 expires 2024-06-03T22:22:54.073541+0000 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/228016607 expires 2024-06-03T22:22:18.096691+0000 2024-06-02T22:36:10.220 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/1762120421 expires 2024-06-03T22:22:18.096691+0000 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/2749889089 expires 2024-06-03T22:22:18.096691+0000 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:6800/3345202686 expires 2024-06-03T22:22:18.096691+0000 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:0/2883761228 expires 2024-06-03T22:22:54.073541+0000 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stdout:blocklist 172.21.15.31:6801/3345202686 expires 2024-06-03T22:22:18.096691+0000 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 msgr2=0x7f8fb00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:10.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 0x7f8fb00a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00b7b0 tx=0x7f8fbc005fd0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 msgr2=0x7f8fcc19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e9d0 tx=0x7f8fb800ece0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 shutdown_connections 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8fb00a2ca0 0x7f8fb00a5160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fcc108260 0x7f8fcc1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fcc103000 0x7f8fcc19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 --2- 172.21.15.31:0/3993219422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fcc105930 0x7f8fcc19aeb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 >> 172.21.15.31:0/3993219422 conn(0x7f8fcc0fc990 msgr2=0x7f8fcc1026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 shutdown_connections 2024-06-02T22:36:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:10.221+0000 7f8fd0a00700 1 -- 172.21.15.31:0/3993219422 wait complete. 2024-06-02T22:36:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:09 smithi178 ceph-mon[36614]: pgmap v486: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:11.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:10 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3993219422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T22:36:11.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:10 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3993219422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T22:36:11.240 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-02T22:36:11.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:36:11.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:10 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3993219422' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T22:36:11.725 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:11 smithi098 ceph-mon[36750]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:12.240 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:11 smithi031 ceph-mon[31767]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:11 smithi178 ceph-mon[36614]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:14.138 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:13 smithi031 ceph-mon[31767]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:14.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 -- 172.21.15.31:0/4185068076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c104f80 msgr2=0x7f1c7c111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 --2- 172.21.15.31:0/4185068076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c104f80 0x7f1c7c111490 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009f90 tx=0x7f1c7400b330 comp rx=0 tx=0).stop 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 -- 172.21.15.31:0/4185068076 shutdown_connections 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 --2- 172.21.15.31:0/4185068076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c104f80 0x7f1c7c111490 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 --2- 172.21.15.31:0/4185068076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 0x7f1c7c10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 --2- 172.21.15.31:0/4185068076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 -- 172.21.15.31:0/4185068076 >> 172.21.15.31:0/4185068076 conn(0x7f1c7c1000b0 msgr2=0x7f1c7c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 -- 172.21.15.31:0/4185068076 shutdown_connections 2024-06-02T22:36:14.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.141+0000 7f1c80a00700 1 -- 172.21.15.31:0/4185068076 wait complete. 2024-06-02T22:36:14.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.142+0000 7f1c80a00700 1 Processor -- start 2024-06-02T22:36:14.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.142+0000 7f1c80a00700 1 -- start start 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c1a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 0x7f1c7c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c114910 con 0x7f1c7c104f80 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c114790 con 0x7f1c7c1045c0 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c80a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c114a90 con 0x7f1c7c10a650 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c73e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c73e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40584/0 (socket says 172.21.15.31:40584) 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c73e00700 1 -- 172.21.15.31:0/2946224408 learned_addr learned my addr 172.21.15.31:0/2946224408 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c7a800700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c1a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.143+0000 7f1c7b200700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 0x7f1c7c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 -- 172.21.15.31:0/2946224408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 msgr2=0x7f1c7c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 0x7f1c7c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 -- 172.21.15.31:0/2946224408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 msgr2=0x7f1c7c1a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c1a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 -- 172.21.15.31:0/2946224408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7c19b210 con 0x7f1c7c104f80 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c7a800700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c1a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:14.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.144+0000 7f1c73e00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9c0 tx=0x7f1c6400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.145+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64004a30 con 0x7f1c7c104f80 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.145+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c6400cca0 con 0x7f1c7c104f80 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.145+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7c19b500 con 0x7f1c7c104f80 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.145+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64005610 con 0x7f1c7c104f80 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.145+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7c1a77c0 con 0x7f1c7c104f80 2024-06-02T22:36:14.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.146+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7c069180 con 0x7f1c7c104f80 2024-06-02T22:36:14.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.148+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f1c64004cf0 con 0x7f1c7c104f80 2024-06-02T22:36:14.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.149+0000 7f1c73400700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 0x7f1c600a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:14.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.150+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f1c640cf520 con 0x7f1c7c104f80 2024-06-02T22:36:14.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.150+0000 7f1c7a800700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 0x7f1c600a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:14.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.150+0000 7f1c7a800700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 0x7f1c600a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c19bbf0 tx=0x7f1c6c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:14.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.154+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c6409c090 con 0x7f1c7c104f80 2024-06-02T22:36:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:13 smithi098 ceph-mon[36750]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:13 smithi178 ceph-mon[36614]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:14.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.432+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c7c19bfe0 con 0x7f1c7c104f80 2024-06-02T22:36:14.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.435+0000 7f1c73400700 1 -- 172.21.15.31:0/2946224408 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f1c6409b990 con 0x7f1c7c104f80 2024-06-02T22:36:14.435 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:14.436 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:36:14.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 msgr2=0x7f1c600a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:14.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 0x7f1c600a50e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c19bbf0 tx=0x7f1c6c009260 comp rx=0 tx=0).stop 2024-06-02T22:36:14.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 msgr2=0x7f1c7c1a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:14.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9c0 tx=0x7f1c6400ecd0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 shutdown_connections 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1c600a2c20 0x7f1c600a50e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c10a650 0x7f1c7c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c7c1045c0 0x7f1c7c1a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 --2- 172.21.15.31:0/2946224408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7c104f80 0x7f1c7c1a0e30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 >> 172.21.15.31:0/2946224408 conn(0x7f1c7c1000b0 msgr2=0x7f1c7c101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 shutdown_connections 2024-06-02T22:36:14.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:14.438+0000 7f1c80a00700 1 -- 172.21.15.31:0/2946224408 wait complete. 2024-06-02T22:36:14.440 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:36:15.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:14 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2946224408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:15.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:14 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2946224408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:15.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:14 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2946224408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:15.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:36:15.849 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:15 smithi098 ceph-mon[36750]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:16.215 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:15 smithi031 ceph-mon[31767]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:15 smithi178 ceph-mon[36614]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:18.084 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:17 smithi031 ceph-mon[31767]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:17 smithi098 ceph-mon[36750]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 -- 172.21.15.31:0/2970167474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 msgr2=0x7fc95010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 --2- 172.21.15.31:0/2970167474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95010f320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc948009f90 tx=0x7fc94800b330 comp rx=0 tx=0).stop 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 -- 172.21.15.31:0/2970167474 shutdown_connections 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 --2- 172.21.15.31:0/2970167474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95010f320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 --2- 172.21.15.31:0/2970167474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc9501088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 --2- 172.21.15.31:0/2970167474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 0x7fc95006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 -- 172.21.15.31:0/2970167474 >> 172.21.15.31:0/2970167474 conn(0x7fc950078340 msgr2=0x7fc950078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 -- 172.21.15.31:0/2970167474 shutdown_connections 2024-06-02T22:36:18.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.260+0000 7fc957200700 1 -- 172.21.15.31:0/2970167474 wait complete. 2024-06-02T22:36:18.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.261+0000 7fc957200700 1 Processor -- start 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.261+0000 7fc957200700 1 -- start start 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 0x7fc95019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95019b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc950101dc0 con 0x7fc95006ab30 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc950101c40 con 0x7fc95006a170 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc957200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc950101f40 con 0x7fc950108500 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc955200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc955200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59782/0 (socket says 172.21.15.31:59782) 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc955200700 1 -- 172.21.15.31:0/4076271878 learned_addr learned my addr 172.21.15.31:0/4076271878 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc947e00700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95019b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:18.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.262+0000 7fc94fe00700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 0x7fc95019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:18.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 -- 172.21.15.31:0/4076271878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 msgr2=0x7fc95019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:18.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 0x7fc95019b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 -- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 msgr2=0x7fc95019b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:18.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95019b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 -- 172.21.15.31:0/4076271878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95019fe70 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc955200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc948009550 tx=0x7fc94800cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948021070 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc948007ac0 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9501a0100 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.263+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9480052a0 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.264+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9501a7a10 con 0x7fc950108500 2024-06-02T22:36:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.265+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc950103bc0 con 0x7fc950108500 2024-06-02T22:36:18.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.267+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc948024070 con 0x7fc950108500 2024-06-02T22:36:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.268+0000 7fc94d600700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 0x7fc9340a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.268+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc94800f020 con 0x7fc950108500 2024-06-02T22:36:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.269+0000 7fc94fe00700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 0x7fc9340a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.269+0000 7fc94fe00700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 0x7fc9340a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc940009be0 tx=0x7fc940009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.270+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc94802b020 con 0x7fc950108500 2024-06-02T22:36:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:17 smithi178 ceph-mon[36614]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:18.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.548+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc950069180 con 0x7fc950108500 2024-06-02T22:36:18.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.549+0000 7fc94d600700 1 -- 172.21.15.31:0/4076271878 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7fc950069180 con 0x7fc950108500 2024-06-02T22:36:18.550 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:18.550 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:32:54.555737+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24484,24505,24499,24503,24517]},"id":1}]} 2024-06-02T22:36:18.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 msgr2=0x7fc9340a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:18.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 0x7fc9340a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc940009be0 tx=0x7fc940009260 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 msgr2=0x7fc95019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc948009550 tx=0x7fc94800cfa0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 shutdown_connections 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc9340a2c20 0x7fc9340a50e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc950108500 0x7fc95019f760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc95006a170 0x7fc95019b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 --2- 172.21.15.31:0/4076271878 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc95006ab30 0x7fc95019b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 >> 172.21.15.31:0/4076271878 conn(0x7fc950078340 msgr2=0x7fc9500ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 shutdown_connections 2024-06-02T22:36:18.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:18.553+0000 7fc957200700 1 -- 172.21.15.31:0/4076271878 wait complete. 2024-06-02T22:36:18.555 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-06-02T22:36:19.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:18 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/4076271878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:19.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:18 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/4076271878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:19.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:18 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/4076271878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:36:19.535 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:36:20.025 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:20.176 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:19 smithi031 ceph-mon[31767]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:19 smithi098 ceph-mon[36750]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:19 smithi178 ceph-mon[36614]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:22.169 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:21 smithi031 ceph-mon[31767]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:21 smithi098 ceph-mon[36750]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:21 smithi178 ceph-mon[36614]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 -- 172.21.15.31:0/564060140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf410ece0 msgr2=0x7fbbf4111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 --2- 172.21.15.31:0/564060140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf410ece0 0x7fbbf4111110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00b0a0 tx=0x7fbbec00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 -- 172.21.15.31:0/564060140 shutdown_connections 2024-06-02T22:36:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 --2- 172.21.15.31:0/564060140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf410ece0 0x7fbbf4111110 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 --2- 172.21.15.31:0/564060140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf41015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 --2- 172.21.15.31:0/564060140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf4101b70 0x7fbbf410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 -- 172.21.15.31:0/564060140 >> 172.21.15.31:0/564060140 conn(0x7fbbf40fcd70 msgr2=0x7fbbf40ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 -- 172.21.15.31:0/564060140 shutdown_connections 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.475+0000 7fbbfa000700 1 -- 172.21.15.31:0/564060140 wait complete. 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.476+0000 7fbbfa000700 1 Processor -- start 2024-06-02T22:36:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.476+0000 7fbbfa000700 1 -- start start 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 0x7fbbf419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 0x7fbbf419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf41149d0 con 0x7fbbf4101b70 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4114850 con 0x7fbbf410ece0 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbfa000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf4114b50 con 0x7fbbf41011c0 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbebe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 0x7fbbf419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbebe00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 0x7fbbf419b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56318/0 (socket says 172.21.15.31:56318) 2024-06-02T22:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf419ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:38118/0 (socket says 172.21.15.31:38118) 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbebe00700 1 -- 172.21.15.31:0/2815060954 learned_addr learned my addr 172.21.15.31:0/2815060954 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 0x7fbbf419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 -- 172.21.15.31:0/2815060954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 msgr2=0x7fbbf419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 -- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 msgr2=0x7fbbf419b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 0x7fbbf419b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.477+0000 7fbbf9600700 1 -- 172.21.15.31:0/2815060954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf419fd70 con 0x7fbbf410ece0 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbf9600700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 0x7fbbf419f630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00b070 tx=0x7fbbec004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec021070 con 0x7fbbf410ece0 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf41a0000 con 0x7fbbf410ece0 2024-06-02T22:36:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbec007b80 con 0x7fbbf410ece0 2024-06-02T22:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec005040 con 0x7fbbf410ece0 2024-06-02T22:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.478+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf41a78e0 con 0x7fbbf410ece0 2024-06-02T22:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.480+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf4069180 con 0x7fbbf410ece0 2024-06-02T22:36:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.482+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbbec024070 con 0x7fbbf410ece0 2024-06-02T22:36:22.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.483+0000 7fbbf2000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 0x7fbbd80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:22.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.483+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fbbec0d0250 con 0x7fbbf410ece0 2024-06-02T22:36:22.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.483+0000 7fbbf8c00700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 0x7fbbd80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:22.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.484+0000 7fbbf8c00700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 0x7fbbd80a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009c60 tx=0x7fbbe4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.487+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbbec007d30 con 0x7fbbf410ece0 2024-06-02T22:36:22.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.725+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbf41a7ab0 con 0x7fbbf410ece0 2024-06-02T22:36:22.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.728+0000 7fbbf2000700 1 -- 172.21.15.31:0/2815060954 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7fbbec09ce50 con 0x7fbbf410ece0 2024-06-02T22:36:22.729 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:22.729 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 msgr2=0x7fbbd80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 0x7fbbd80a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009c60 tx=0x7fbbe4009260 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 msgr2=0x7fbbf419f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 0x7fbbf419f630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00b070 tx=0x7fbbec004c80 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 shutdown_connections 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbbd80a2ca0 0x7fbbd80a5160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbbf410ece0 0x7fbbf419f630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbf41011c0 0x7fbbf419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 --2- 172.21.15.31:0/2815060954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbf4101b70 0x7fbbf419b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 >> 172.21.15.31:0/2815060954 conn(0x7fbbf40fcd70 msgr2=0x7fbbf4110f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.731+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 shutdown_connections 2024-06-02T22:36:22.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:22.732+0000 7fbbfa000700 1 -- 172.21.15.31:0/2815060954 wait complete. 2024-06-02T22:36:23.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:22 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2815060954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:36:23.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:22 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2815060954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:36:23.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:22 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2815060954' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:36:23.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T22:31:23.645237+0000', 'modified': '2024-06-02T22:32:54.555737+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24517, 'mds_1': 24505, 'mds_2': 24503, 'mds_3': 24499, 'mds_4': 24484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24431': {'gid': 24431, 'name': 'j', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.31:6835/2351522534', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2351522534}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2351522534}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6833/1728134779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 1728134779}, {'type': 'v1', 'addr': '172.21.15.178:6833', 'nonce': 1728134779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/2455073763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 2455073763}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 2455073763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6837/511134673', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 511134673}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 511134673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/262655409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 262655409}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 262655409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 34, 'addr': '172.21.15.178:6837/2069330007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 2069330007}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 2069330007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.178:6839/4016839880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 4016839880}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 4016839880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'b', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 29, 'addr': '172.21.15.98:6839/2003931119', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2003931119}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2003931119}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 30, 'addr': '172.21.15.31:6839/4188521464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6838', 'nonce': 4188521464}, {'type': 'v1', 'addr': '172.21.15.31:6839', 'nonce': 4188521464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.31:6841/3282614730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6840', 'nonce': 3282614730}, {'type': 'v1', 'addr': '172.21.15.31:6841', 'nonce': 3282614730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24517, 'qdb_cluster': [24484, 24505, 24499, 24503, 24517]} 2024-06-02T22:36:23.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-02T22:36:23.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.c status 2024-06-02T22:36:24.185 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:23 smithi098 ceph-mon[36750]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:23 smithi178 ceph-mon[36614]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:24.339 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:23 smithi031 ceph-mon[31767]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:25 smithi098 ceph-mon[36750]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:26.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:25 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:36:26.265 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:25 smithi031 ceph-mon[31767]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:26.265 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:25 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:36:26.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:25 smithi178 ceph-mon[36614]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:26.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:25 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 -- 172.21.15.31:0/153527871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b410ee90 msgr2=0x7fe9b4111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/153527871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b410ee90 0x7fe9b4111280 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b0a0 tx=0x7fe9ac00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 -- 172.21.15.31:0/153527871 shutdown_connections 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/153527871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b410ee90 0x7fe9b4111280 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/153527871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 0x7fe9b4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/153527871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b4074fe0 0x7fe9b410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 -- 172.21.15.31:0/153527871 >> 172.21.15.31:0/153527871 conn(0x7fe9b40795f0 msgr2=0x7fe9b4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 -- 172.21.15.31:0/153527871 shutdown_connections 2024-06-02T22:36:26.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.597+0000 7fe9b8e00700 1 -- 172.21.15.31:0/153527871 wait complete. 2024-06-02T22:36:26.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.599+0000 7fe9b8e00700 1 Processor -- start 2024-06-02T22:36:26.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.599+0000 7fe9b8e00700 1 -- start start 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.599+0000 7fe9b8e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 0x7fe9b419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.599+0000 7fe9b8e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b8e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b410ee90 0x7fe9b419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b8e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4114a90 con 0x7fe9b4074fe0 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b8e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4114910 con 0x7fe9b410ee90 2024-06-02T22:36:26.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b8e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4114c10 con 0x7fe9b40746c0 2024-06-02T22:36:26.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56340/0 (socket says 172.21.15.31:56340) 2024-06-02T22:36:26.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 -- 172.21.15.31:0/1834805709 learned_addr learned my addr 172.21.15.31:0/1834805709 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:26.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 0x7fe9b419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b2800700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b410ee90 0x7fe9b419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 -- 172.21.15.31:0/1834805709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 msgr2=0x7fe9b419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 0x7fe9b419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 -- 172.21.15.31:0/1834805709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b410ee90 msgr2=0x7fe9b419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b410ee90 0x7fe9b419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.600+0000 7fe9b1400700 1 -- 172.21.15.31:0/1834805709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b419fef0 con 0x7fe9b4074fe0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9b1400700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000eb30 tx=0x7fe9a000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9aaa00700 1 -- 172.21.15.31:0/1834805709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000cbd0 con 0x7fe9b4074fe0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9aaa00700 1 -- 172.21.15.31:0/1834805709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a0004500 con 0x7fe9b4074fe0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b41a01e0 con 0x7fe9b4074fe0 2024-06-02T22:36:26.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9aaa00700 1 -- 172.21.15.31:0/1834805709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0010430 con 0x7fe9b4074fe0 2024-06-02T22:36:26.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.601+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b41a7a60 con 0x7fe9b4074fe0 2024-06-02T22:36:26.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.606+0000 7fe9aaa00700 1 -- 172.21.15.31:0/1834805709 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe9a0003f00 con 0x7fe9b4074fe0 2024-06-02T22:36:26.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 Processor -- start 2024-06-02T22:36:26.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 -- start start 2024-06-02T22:36:26.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562730fad9c0 con 0x5627310ad350 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562730ff0ab0 con 0x5627310a7a00 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.607+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562730fab8a0 con 0x5627310adc70 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b2800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:38142/0 (socket says 172.21.15.31:38142) 2024-06-02T22:36:26.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 -- 172.21.15.31:0/1416654002 learned_addr learned my addr 172.21.15.31:0/1416654002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:26.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1400700 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 -- 172.21.15.31:0/1416654002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 msgr2=0x5627310a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310a7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 -- 172.21.15.31:0/1416654002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 msgr2=0x5627310ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1e00700 1 -- 172.21.15.31:0/1416654002 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562730f98f40 con 0x5627310adc70 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9b1400700 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9aaa00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 0x7fe9980a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.608+0000 7fe9aaa00700 1 -- 172.21.15.31:0/1834805709 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe9a00cf650 con 0x7fe9b4074fe0 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.609+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009db0 tx=0x7fe9a4011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17bc4529b3d0d624 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.609+0000 7fe9b2800700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 0x7fe9980a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.609+0000 7fe99f400700 1 -- 172.21.15.31:0/1416654002 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a401e070 con 0x5627310adc70 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.609+0000 7fe99f400700 1 -- 172.21.15.31:0/1416654002 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a4019b10 con 0x5627310adc70 2024-06-02T22:36:26.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.609+0000 7fe99f400700 1 -- 172.21.15.31:0/1416654002 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400ec30 con 0x5627310adc70 2024-06-02T22:36:26.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 -- 172.21.15.31:0/1416654002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 msgr2=0x5627310a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009db0 tx=0x7fe9a4011720 comp rx=0 tx=0).stop 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9b2800700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 0x7fe9980a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b780 tx=0x7fe9ac006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 -- 172.21.15.31:0/1416654002 shutdown_connections 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/1416654002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310a74c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 -- 172.21.15.31:0/1416654002 >> 172.21.15.31:0/1416654002 conn(0x562730fcb120 msgr2=0x562731099fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 -- 172.21.15.31:0/1416654002 shutdown_connections 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.610+0000 7fe9c3751b80 1 -- 172.21.15.31:0/1416654002 wait complete. 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.611+0000 7fe9c3751b80 1 -- start start 2024-06-02T22:36:26.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.611+0000 7fe9c3751b80 1 Processor -- start 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 0x5627310b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 0x5627310b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562730f8cf10 con 0x5627310adc70 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562730feca70 con 0x5627310a7a00 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5627310b4650 con 0x5627310ad350 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9c3751b80 10 client.0 _ll_register_callbacks cb 0x562730f86330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 0x5627310b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b2800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 0x5627310b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33468/0 (socket says 172.21.15.31:33468) 2024-06-02T22:36:26.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 0x5627310b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:38154/0 (socket says 172.21.15.31:38154) 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.612+0000 7fe9b1e00700 1 -- 172.21.15.31:0/2285008565 learned_addr learned my addr 172.21.15.31:0/2285008565 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 -- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 msgr2=0x5627310b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 0x5627310b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 -- 172.21.15.31:0/2285008565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 msgr2=0x5627310b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 0x5627310b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 -- 172.21.15.31:0/2285008565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562730f3f880 con 0x5627310a7a00 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b2800700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 0x5627310b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4011b20 tx=0x7fe9a40098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=615c95ce856da54e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe993e00700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a401e040 con 0x5627310a7a00 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe9a4004440 con 0x5627310a7a00 2024-06-02T22:36:26.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.613+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9a4019b10 con 0x5627310a7a00 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9a4030050 con 0x5627310a7a00 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe9c3751b80 10 client.25097 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5627310bee40 con 0x5627310a7a00 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a4019b10 con 0x5627310a7a00 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe9a400e810 con 0x5627310a7a00 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.614+0000 7fe9c3751b80 10 client.25097 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9c3751b80 10 client.25097 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9c3751b80 20 client.25097 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x5627310c11a0 0x5627310c2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9c3751b80 4 client.25097 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 --> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562730ffdfb0 con 0x5627310c11a0 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.615+0000 7fe9b1400700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x5627310c11a0 0x5627310c2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.616+0000 7fe9b1400700 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x5627310c11a0 0x5627310c2610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a948d29532d1d8e7 server_cookie=85331a07a719b0d7 in_seq=0 out_seq=0 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.616+0000 7fe993e00700 10 client.25097 ms_handle_connect on v2:172.21.15.178:6836/2069330007 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.616+0000 7fe993e00700 1 -- 172.21.15.31:0/2285008565 <== mds.4 v2:172.21.15.178:6836/2069330007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562730ffdfb0 con 0x5627310c11a0 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.616+0000 7fe993e00700 10 client.25097 handle_command_reply: tid=0 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 client.25097 shutdown 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 msgr2=0x5627310b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4011b20 tx=0x7fe9a40098c0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 shutdown_connections 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x5627310c11a0 0x5627310c2610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310adc70 0x5627310b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310a7a00 0x5627310b3a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2285008565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310ad350 0x5627310b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 >> 172.21.15.31:0/2285008565 conn(0x562730fcb120 msgr2=0x562731093740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe993e00700 0 client.25097 ms_handle_reset on v2:172.21.15.178:6836/2069330007 2024-06-02T22:36:26.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 shutdown_connections 2024-06-02T22:36:26.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.617+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2285008565 wait complete. 2024-06-02T22:36:26.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.618+0000 7fe9c3751b80 20 client.25097 trim_cache size 0 max 16384 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.641+0000 7fe9c3751b80 1 Processor -- start 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.641+0000 7fe9c3751b80 1 -- start start 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310a7a00 0x5627310a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310ae760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5627310c0950 con 0x5627310a7a00 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5627310c1020 con 0x5627310ad350 2024-06-02T22:36:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5627310c16f0 con 0x5627310adc70 2024-06-02T22:36:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33472/0 (socket says 172.21.15.31:33472) 2024-06-02T22:36:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9b1400700 1 -- 172.21.15.31:0/852037802 learned_addr learned my addr 172.21.15.31:0/852037802 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310a7a00 0x5627310a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.642+0000 7fe9b2800700 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 -- 172.21.15.31:0/852037802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 msgr2=0x5627310ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 -- 172.21.15.31:0/852037802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310a7a00 msgr2=0x5627310a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310a7a00 0x5627310a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 -- 172.21.15.31:0/852037802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627310ace00 con 0x5627310ad350 2024-06-02T22:36:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe9b1400700 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c5b0 tx=0x7fe9a0097ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54e1d05996e56409 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe99ea00700 1 -- 172.21.15.31:0/852037802 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a009c220 con 0x5627310ad350 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe99ea00700 1 -- 172.21.15.31:0/852037802 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a009ce50 con 0x5627310ad350 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.643+0000 7fe99ea00700 1 -- 172.21.15.31:0/852037802 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00cced0 con 0x5627310ad350 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 -- 172.21.15.31:0/852037802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 msgr2=0x5627310940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c5b0 tx=0x7fe9a0097ec0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 -- 172.21.15.31:0/852037802 shutdown_connections 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310adc70 0x5627310ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310a7a00 0x5627310a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/852037802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310ad350 0x5627310940e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 -- 172.21.15.31:0/852037802 >> 172.21.15.31:0/852037802 conn(0x562730fcb120 msgr2=0x5627310ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 -- 172.21.15.31:0/852037802 shutdown_connections 2024-06-02T22:36:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.644+0000 7fe9c3751b80 1 -- 172.21.15.31:0/852037802 wait complete. 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.645+0000 7fe9c3751b80 1 -- start start 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.645+0000 7fe9c3751b80 1 Processor -- start 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310adc70 0x5627310b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5627310c2490 con 0x5627310ad350 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5627310c1dc0 con 0x5627310adc70 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5627310c2b60 con 0x5627310a7a00 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9c3751b80 10 client.0 _ll_register_callbacks cb 0x562730f86330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9b1400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9b1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:38170/0 (socket says 172.21.15.31:38170) 2024-06-02T22:36:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9b1e00700 1 -- 172.21.15.31:0/2318613911 learned_addr learned my addr 172.21.15.31:0/2318613911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.646+0000 7fe9b2800700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310adc70 0x5627310b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 -- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 msgr2=0x5627310cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 -- 172.21.15.31:0/2318613911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310adc70 msgr2=0x5627310b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310adc70 0x5627310b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 -- 172.21.15.31:0/2318613911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627310b3170 con 0x5627310ad350 2024-06-02T22:36:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe9b1400700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310cc310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9a009d000 tx=0x7fe9a000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9293a3b66b761826 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe993e00700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.647+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a009c220 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe9a00cced0 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9a009ce50 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9a0003680 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 10 client.15009 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5627310cb6a0 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a009ce50 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe9a009bd80 con 0x5627310ad350 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 10 client.15009 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 10 client.15009 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T22:36:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 20 client.15009 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.648+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x562731130c80 0x56273112f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.649+0000 7fe9c3751b80 4 client.15009 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:36:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.649+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 --> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] -- command(tid 0: {"prefix": "status"}) -- 0x562730ff8530 con 0x562731130c80 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.649+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x562731130c80 0x56273112f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9b1e00700 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x562731130c80 0x56273112f990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c8ff17b7a2e32034 server_cookie=9aa2f8ed988028f6 in_seq=0 out_seq=0 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe993e00700 10 client.15009 ms_handle_connect on v2:172.21.15.178:6836/2069330007 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe993e00700 1 -- 172.21.15.31:0/2318613911 <== mds.4 v2:172.21.15.178:6836/2069330007 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562730ff8530 con 0x562731130c80 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe993e00700 10 client.15009 handle_command_reply: tid=0 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 client.15009 shutdown 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 msgr2=0x5627310cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310cc310 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe9a009d000 tx=0x7fe9a000c6e0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 shutdown_connections 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:6836/2069330007,v1:172.21.15.178:6837/2069330007] conn(0x562731130c80 0x56273112f990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5627310adc70 0x5627310b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5627310a7a00 0x5627310cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 --2- 172.21.15.31:0/2318613911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5627310ad350 0x5627310cc310 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.650+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 >> 172.21.15.31:0/2318613911 conn(0x562730fcb120 msgr2=0x5627310abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.651+0000 7fe993e00700 0 client.15009 ms_handle_reset on v2:172.21.15.178:6836/2069330007 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.651+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 shutdown_connections 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.651+0000 7fe9c3751b80 1 -- 172.21.15.31:0/2318613911 wait complete. 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.651+0000 7fe9c3751b80 20 client.15009 trim_cache size 0 max 16384 2024-06-02T22:36:26.653 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 4, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24484, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 217.19419200999999, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 345.76728748300002 2024-06-02T22:36:26.654 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 msgr2=0x7fe9980a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 0x7fe9980a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b780 tx=0x7fe9ac006210 comp rx=0 tx=0).stop 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 msgr2=0x7fe9b419b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000eb30 tx=0x7fe9a000ee40 comp rx=0 tx=0).stop 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 shutdown_connections 2024-06-02T22:36:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe9980a2ca0 0x7fe9980a5160 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9b410ee90 0x7fe9b419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b40746c0 0x7fe9b419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 --2- 172.21.15.31:0/1834805709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9b4074fe0 0x7fe9b419b420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 >> 172.21.15.31:0/1834805709 conn(0x7fe9b40795f0 msgr2=0x7fe9b4100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 shutdown_connections 2024-06-02T22:36:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:26.652+0000 7fe9b8e00700 1 -- 172.21.15.31:0/1834805709 wait complete. 2024-06-02T22:36:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:26 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:36:27.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:26 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:36:27.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:26 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:36:27.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:26 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:36:27.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:26 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:36:27.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:26 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:36:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:26 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:36:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:26 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:36:27.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:26 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:36:27.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-02T22:36:28.055 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:28.210 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:27 smithi031 ceph-mon[31767]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:27 smithi098 ceph-mon[36750]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:27 smithi178 ceph-mon[36614]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:29 smithi098 ceph-mon[36750]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:30.216 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:29 smithi031 ceph-mon[31767]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:29 smithi178 ceph-mon[36614]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:30.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 -- 172.21.15.31:0/1098572913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b01046b0 msgr2=0x7f69b0104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 --2- 172.21.15.31:0/1098572913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b01046b0 0x7f69b0104b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6998009990 tx=0x7f6998009ca0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 -- 172.21.15.31:0/1098572913 shutdown_connections 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 --2- 172.21.15.31:0/1098572913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b0111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 --2- 172.21.15.31:0/1098572913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b010a6b0 0x7f69b010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 --2- 172.21.15.31:0/1098572913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b01046b0 0x7f69b0104b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.489+0000 7f69b5c00700 1 -- 172.21.15.31:0/1098572913 >> 172.21.15.31:0/1098572913 conn(0x7f69b01001a0 msgr2=0x7f69b01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.490+0000 7f69b5c00700 1 -- 172.21.15.31:0/1098572913 shutdown_connections 2024-06-02T22:36:30.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.490+0000 7f69b5c00700 1 -- 172.21.15.31:0/1098572913 wait complete. 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 Processor -- start 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 -- start start 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 0x7f69b019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b010a6b0 0x7f69b019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0114a40 con 0x7f69b010a6b0 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f69b01148c0 con 0x7f69b0105070 2024-06-02T22:36:30.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.491+0000 7f69b5c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f69b0114bc0 con 0x7f69b01046b0 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69aea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 0x7f69b019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69aea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 0x7f69b019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35840/0 (socket says 172.21.15.31:35840) 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69aea00700 1 -- 172.21.15.31:0/3324350592 learned_addr learned my addr 172.21.15.31:0/3324350592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69af400700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b010a6b0 0x7f69b019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 -- 172.21.15.31:0/3324350592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 msgr2=0x7f69b019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 0x7f69b019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 -- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b010a6b0 msgr2=0x7f69b019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b010a6b0 0x7f69b019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.492+0000 7f69a7e00700 1 -- 172.21.15.31:0/3324350592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b019fe10 con 0x7f69b0105070 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b019b390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69980059d0 tx=0x7f699800bb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69a7400700 1 -- 172.21.15.31:0/3324350592 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6998027070 con 0x7f69b0105070 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69a7400700 1 -- 172.21.15.31:0/3324350592 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6998003d70 con 0x7f69b0105070 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69a7400700 1 -- 172.21.15.31:0/3324350592 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699800f460 con 0x7f69b0105070 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b01a00a0 con 0x7f69b0105070 2024-06-02T22:36:30.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.493+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b01a7980 con 0x7f69b0105070 2024-06-02T22:36:30.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.496+0000 7f69a7400700 1 -- 172.21.15.31:0/3324350592 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f699802a070 con 0x7f69b0105070 2024-06-02T22:36:30.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69c0670b80 1 Processor -- start 2024-06-02T22:36:30.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69a7400700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 0x7f69940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69c0670b80 1 -- start start 2024-06-02T22:36:30.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69a7400700 1 -- 172.21.15.31:0/3324350592 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f69980d0320 con 0x7f69b0105070 2024-06-02T22:36:30.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69af400700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 0x7f69940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.499+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119c460 0x55e271195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e2711961f0 0x55e271196630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69c0670b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e2710a49c0 con 0x55e27119c460 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69c0670b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e2710e7ab0 con 0x55e27119bb40 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69c0670b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e2710a28a0 con 0x55e2711961f0 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56806/0 (socket says 172.21.15.31:56806) 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 -- 172.21.15.31:0/2142012989 learned_addr learned my addr 172.21.15.31:0/2142012989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69a7e00700 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119c460 0x55e271195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 -- 172.21.15.31:0/2142012989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e2711961f0 msgr2=0x55e271196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e2711961f0 0x55e271196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 -- 172.21.15.31:0/2142012989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119c460 msgr2=0x55e271195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119c460 0x55e271195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.500+0000 7f69aea00700 1 -- 172.21.15.31:0/2142012989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27108ff40 con 0x55e27119bb40 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.501+0000 7f69af400700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 0x7f69940a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69a80093f0 tx=0x7f69a8009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.501+0000 7f69aea00700 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009dd0 tx=0x7f69a00106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e1d6ccec35573c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.501+0000 7f699fe00700 1 -- 172.21.15.31:0/2142012989 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0010e10 con 0x55e27119bb40 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.501+0000 7f699fe00700 1 -- 172.21.15.31:0/2142012989 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a0011920 con 0x55e27119bb40 2024-06-02T22:36:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.501+0000 7f699fe00700 1 -- 172.21.15.31:0/2142012989 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a001a810 con 0x55e27119bb40 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 -- 172.21.15.31:0/2142012989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 msgr2=0x55e27119bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009dd0 tx=0x7f69a00106b0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 -- 172.21.15.31:0/2142012989 shutdown_connections 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e2711961f0 0x55e271196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119bb40 0x55e27119bf20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2142012989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119c460 0x55e271195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 -- 172.21.15.31:0/2142012989 >> 172.21.15.31:0/2142012989 conn(0x55e2710c2120 msgr2=0x55e271190fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 -- 172.21.15.31:0/2142012989 shutdown_connections 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.502+0000 7f69c0670b80 1 -- 172.21.15.31:0/2142012989 wait complete. 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.503+0000 7f69c0670b80 1 -- start start 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.503+0000 7f69c0670b80 1 Processor -- start 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e2711a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e27119f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27119f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e271083f10 con 0x55e27119bb40 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e2710e3a70 con 0x55e2711961f0 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e2711a2e40 con 0x55e27119c460 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69c0670b80 10 client.0 _ll_register_callbacks cb 0x55e27107d330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69af400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27119f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69a7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e27119f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69af400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27119f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35864/0 (socket says 172.21.15.31:35864) 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69af400700 1 -- 172.21.15.31:0/3675808248 learned_addr learned my addr 172.21.15.31:0/3675808248 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69aea00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e2711a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69a7e00700 1 -- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 msgr2=0x55e27119f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27119f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69a7e00700 1 -- 172.21.15.31:0/3675808248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 msgr2=0x55e2711a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.504+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e2711a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f69a7e00700 1 -- 172.21.15.31:0/3675808248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e271036880 con 0x55e27119bb40 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f69a7e00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e27119f4a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f69980098e0 tx=0x7f6998005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155af61c383c114c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f699cc00700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:36:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699809c180 con 0x55e27119bb40 2024-06-02T22:36:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f699809ab20 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a0011920 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69980043d0 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f69c0670b80 10 client.15021 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.505+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2711ad5a0 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a0011920 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f69980a4f70 con 0x55e27119bb40 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 10 client.15021 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 10 client.15021 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 20 client.15021 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2711afba0 0x55e2711b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 4 client.15021 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.506+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 --> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2710f4fb0 con 0x55e2711afba0 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.507+0000 7f69aea00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2711afba0 0x55e2711b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.507+0000 7f69aea00700 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2711afba0 0x55e2711b1010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8a3b8265e8f03cd2 server_cookie=81950858385bc1e6 in_seq=0 out_seq=0 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.507+0000 7f699cc00700 10 client.15021 ms_handle_connect on v2:172.21.15.178:6838/4016839880 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.508+0000 7f699cc00700 1 -- 172.21.15.31:0/3675808248 <== mds.3 v2:172.21.15.178:6838/4016839880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e2710f4fb0 con 0x55e2711afba0 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.508+0000 7f699cc00700 10 client.15021 handle_command_reply: tid=0 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.508+0000 7f69c0670b80 1 client.15021 shutdown 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 msgr2=0x55e27119f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e27119f4a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f69980098e0 tx=0x7f6998005ad0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 shutdown_connections 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2711afba0 0x55e2711b1010 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27119f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e2711a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 --2- 172.21.15.31:0/3675808248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e27119f4a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 >> 172.21.15.31:0/3675808248 conn(0x55e2710c2120 msgr2=0x55e27118a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f699cc00700 0 client.15021 ms_handle_reset on v2:172.21.15.178:6838/4016839880 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 shutdown_connections 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 1 -- 172.21.15.31:0/3675808248 wait complete. 2024-06-02T22:36:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.509+0000 7f69c0670b80 20 client.15021 trim_cache size 0 max 16384 2024-06-02T22:36:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 Processor -- start 2024-06-02T22:36:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 -- start start 2024-06-02T22:36:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e271192300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27118b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e2711af350 con 0x55e27119bb40 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.533+0000 7f69c0670b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e2711afa20 con 0x55e2711961f0 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69c0670b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e2711b00f0 con 0x55e27119c460 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69a7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e271192300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56824/0 (socket says 172.21.15.31:56824) 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 -- 172.21.15.31:0/479148215 learned_addr learned my addr 172.21.15.31:0/479148215 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69af400700 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27118b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 -- 172.21.15.31:0/479148215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 msgr2=0x55e27118b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27118b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 -- 172.21.15.31:0/479148215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 msgr2=0x55e271192300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e271192300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.534+0000 7f69aea00700 1 -- 172.21.15.31:0/479148215 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27119da10 con 0x55e2711961f0 2024-06-02T22:36:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.535+0000 7f69aea00700 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a00092a0 tx=0x7f69a0010e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22492501d7151d66 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.535+0000 7f699f400700 1 -- 172.21.15.31:0/479148215 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0005230 con 0x55e2711961f0 2024-06-02T22:36:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.535+0000 7f699f400700 1 -- 172.21.15.31:0/479148215 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a0004bf0 con 0x55e2711961f0 2024-06-02T22:36:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.535+0000 7f699f400700 1 -- 172.21.15.31:0/479148215 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a001c7b0 con 0x55e2711961f0 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- 172.21.15.31:0/479148215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 msgr2=0x55e271195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a00092a0 tx=0x7f69a0010e50 comp rx=0 tx=0).stop 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- 172.21.15.31:0/479148215 shutdown_connections 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119c460 0x55e27118b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e2711961f0 0x55e271195cb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 --2- 172.21.15.31:0/479148215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e27119bb40 0x55e271192300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- 172.21.15.31:0/479148215 >> 172.21.15.31:0/479148215 conn(0x55e2710c2120 msgr2=0x55e2711995c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- 172.21.15.31:0/479148215 shutdown_connections 2024-06-02T22:36:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- 172.21.15.31:0/479148215 wait complete. 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.536+0000 7f69c0670b80 1 -- start start 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 Processor -- start 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119bb40 0x55e27118a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119c460 0x55e27118a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e2711b0e90 con 0x55e2711961f0 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e2711b07c0 con 0x55e27119c460 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e2711b1560 con 0x55e27119bb40 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69c0670b80 10 client.0 _ll_register_callbacks cb 0x55e27107d330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36066/0 (socket says 172.21.15.31:36066) 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.537+0000 7f69aea00700 1 -- 172.21.15.31:0/2915812022 learned_addr learned my addr 172.21.15.31:0/2915812022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69af400700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119c460 0x55e27118a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69a7e00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119bb40 0x55e27118a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 -- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119bb40 msgr2=0x55e27118a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119bb40 0x55e27118a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 -- 172.21.15.31:0/2915812022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119c460 msgr2=0x55e27118a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119c460 0x55e27118a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 -- 172.21.15.31:0/2915812022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e27118af30 con 0x55e2711961f0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f69aea00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69a000a010 tx=0x7f69a00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2062cd616ba8a58e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.538+0000 7f699cc00700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0036070 con 0x55e2711961f0 2024-06-02T22:36:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f69a0004910 con 0x55e2711961f0 2024-06-02T22:36:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a0004bf0 con 0x55e2711961f0 2024-06-02T22:36:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69a0042050 con 0x55e2711961f0 2024-06-02T22:36:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f69c0670b80 10 client.15027 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e271223ca0 con 0x55e2711961f0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69a0004bf0 con 0x55e2711961f0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f69a001c880 con 0x55e2711961f0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.539+0000 7f69c0670b80 10 client.15027 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69c0670b80 10 client.15027 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69c0670b80 20 client.15027 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2712280e0 0x55e271226df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69c0670b80 4 client.15027 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 --> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] -- command(tid 0: {"prefix": "status"}) -- 0x55e2710ef530 con 0x55e2712280e0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.540+0000 7f69a7e00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2712280e0 0x55e271226df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69a7e00700 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2712280e0 0x55e271226df0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e595b7677a24b80d server_cookie=2443c7e1aae0d42e in_seq=0 out_seq=0 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f699cc00700 10 client.15027 ms_handle_connect on v2:172.21.15.178:6838/4016839880 2024-06-02T22:36:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f699cc00700 1 -- 172.21.15.31:0/2915812022 <== mds.3 v2:172.21.15.178:6838/4016839880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e2710ef530 con 0x55e2712280e0 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f699cc00700 10 client.15027 handle_command_reply: tid=0 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 client.15027 shutdown 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 msgr2=0x55e2711bac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69a000a010 tx=0x7f69a00057c0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 shutdown_connections 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:6838/4016839880,v1:172.21.15.178:6839/4016839880] conn(0x55e2712280e0 0x55e271226df0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e27119c460 0x55e27118a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e2711961f0 0x55e2711bac40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 --2- 172.21.15.31:0/2915812022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e27119bb40 0x55e27118a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 >> 172.21.15.31:0/2915812022 conn(0x55e2710c2120 msgr2=0x55e271190a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f699cc00700 0 client.15027 ms_handle_reset on v2:172.21.15.178:6838/4016839880 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 shutdown_connections 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.541+0000 7f69c0670b80 1 -- 172.21.15.31:0/2915812022 wait complete. 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69c0670b80 20 client.15027 trim_cache size 0 max 16384 2024-06-02T22:36:30.546 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 3, 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24499, 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 222.09465802899999, 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:36:30.547 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:36:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:36:30.548 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 343.94122701999999 2024-06-02T22:36:30.548 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:36:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 msgr2=0x7f69940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 0x7f69940a5160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69a80093f0 tx=0x7f69a8009920 comp rx=0 tx=0).stop 2024-06-02T22:36:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 msgr2=0x7f69b019b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b019b390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f69980059d0 tx=0x7f699800bb60 comp rx=0 tx=0).stop 2024-06-02T22:36:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 shutdown_connections 2024-06-02T22:36:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f69940a2ca0 0x7f69940a5160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b010a6b0 0x7f69b019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69b01046b0 0x7f69b019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 --2- 172.21.15.31:0/3324350592 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f69b0105070 0x7f69b019b390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.542+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 >> 172.21.15.31:0/3324350592 conn(0x7f69b01001a0 msgr2=0x7f69b0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.543+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 shutdown_connections 2024-06-02T22:36:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:30.543+0000 7f69b5c00700 1 -- 172.21.15.31:0/3324350592 wait complete. 2024-06-02T22:36:31.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-02T22:36:32.029 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:31 smithi098 ceph-mon[36750]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:31 smithi178 ceph-mon[36614]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:32.350 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:31 smithi031 ceph-mon[31767]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:34.281 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:33 smithi031 ceph-mon[31767]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:33 smithi178 ceph-mon[36614]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:33 smithi098 ceph-mon[36750]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 -- 172.21.15.31:0/3878617961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103640 msgr2=0x7f10b8103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 --2- 172.21.15.31:0/3878617961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103640 0x7f10b8103a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009990 tx=0x7f10a8009ca0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 -- 172.21.15.31:0/3878617961 shutdown_connections 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 --2- 172.21.15.31:0/3878617961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b810ca20 0x7f10b810ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 --2- 172.21.15.31:0/3878617961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103640 0x7f10b8103a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 --2- 172.21.15.31:0/3878617961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b8103f60 0x7f10b810c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 -- 172.21.15.31:0/3878617961 >> 172.21.15.31:0/3878617961 conn(0x7f10b80fce10 msgr2=0x7f10b80ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 -- 172.21.15.31:0/3878617961 shutdown_connections 2024-06-02T22:36:34.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.611+0000 7f10be600700 1 -- 172.21.15.31:0/3878617961 wait complete. 2024-06-02T22:36:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.612+0000 7f10be600700 1 Processor -- start 2024-06-02T22:36:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 -- start start 2024-06-02T22:36:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 0x7f10b81017e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b810ca20 0x7f10b8101d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8112710 con 0x7f10b8103f60 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8112590 con 0x7f10b810ca20 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10be600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f10b8112890 con 0x7f10b8103640 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 0x7f10b81017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35892/0 (socket says 172.21.15.31:35892) 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.613+0000 7f10b7400700 1 -- 172.21.15.31:0/2250574123 learned_addr learned my addr 172.21.15.31:0/2250574123 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7e00700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b810ca20 0x7f10b8101d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 -- 172.21.15.31:0/2250574123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b810ca20 msgr2=0x7f10b8101d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b810ca20 0x7f10b8101d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 -- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 msgr2=0x7f10b81017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 0x7f10b81017e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 -- 172.21.15.31:0/2250574123 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b81a70f0 con 0x7f10b8103640 2024-06-02T22:36:34.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10aea00700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 0x7f10b81017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:34.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.614+0000 7f10b7400700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10a8000c00 tx=0x7f10a800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.615+0000 7f10b4c00700 1 -- 172.21.15.31:0/2250574123 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8027070 con 0x7f10b8103640 2024-06-02T22:36:34.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.615+0000 7f10b4c00700 1 -- 172.21.15.31:0/2250574123 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8003d70 con 0x7f10b8103640 2024-06-02T22:36:34.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.615+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b81a7380 con 0x7f10b8103640 2024-06-02T22:36:34.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.615+0000 7f10b4c00700 1 -- 172.21.15.31:0/2250574123 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800f460 con 0x7f10b8103640 2024-06-02T22:36:34.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.615+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b81a78b0 con 0x7f10b8103640 2024-06-02T22:36:34.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.618+0000 7f10b4c00700 1 -- 172.21.15.31:0/2250574123 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f10a802a070 con 0x7f10b8103640 2024-06-02T22:36:34.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.620+0000 7f10c8e9ab80 1 Processor -- start 2024-06-02T22:36:34.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.620+0000 7f10c8e9ab80 1 -- start start 2024-06-02T22:36:34.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b4c00700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 0x7f109c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d55798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5581d547b9c0 con 0x5581d556c630 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d54beab0 con 0x5581d55774e0 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5581d54798a0 con 0x5581d556bd10 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b4c00700 1 -- 172.21.15.31:0/2250574123 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f10a80d01a0 con 0x7f10b8103640 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b7e00700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 0x7f109c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35898/0 (socket says 172.21.15.31:35898) 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b7400700 1 -- 172.21.15.31:0/3248327214 learned_addr learned my addr 172.21.15.31:0/3248327214 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.621+0000 7f10b7e00700 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d55798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 -- 172.21.15.31:0/3248327214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 msgr2=0x5581d55798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d55798d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 -- 172.21.15.31:0/3248327214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 msgr2=0x5581d5576fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 -- 172.21.15.31:0/3248327214 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d5466f40 con 0x5581d556bd10 2024-06-02T22:36:34.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7400700 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10a8098b00 tx=0x7f10a8098a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=febceae34ed227b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10b7e00700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 0x7f109c0a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ec0 tx=0x7f10b0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10acc00700 1 -- 172.21.15.31:0/3248327214 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a809c000 con 0x5581d556bd10 2024-06-02T22:36:34.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10acc00700 1 -- 172.21.15.31:0/3248327214 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80043d0 con 0x5581d556bd10 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.622+0000 7f10acc00700 1 -- 172.21.15.31:0/3248327214 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80cd9c0 con 0x5581d556bd10 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/3248327214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 msgr2=0x5581d556c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f10a8098b00 tx=0x7f10a8098a70 comp rx=0 tx=0).stop 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/3248327214 shutdown_connections 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d55798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d556c0f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/3248327214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/3248327214 >> 172.21.15.31:0/3248327214 conn(0x5581d5499120 msgr2=0x5581d5568230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/3248327214 shutdown_connections 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.623+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/3248327214 wait complete. 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.624+0000 7f10c8e9ab80 1 -- start start 2024-06-02T22:36:34.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.624+0000 7f10c8e9ab80 1 Processor -- start 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556bd10 0x5581d5576ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5573fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5581d545af10 con 0x5581d556c630 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d54baa70 con 0x5581d556bd10 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5581d54798a0 con 0x5581d55774e0 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10c8e9ab80 10 client.0 _ll_register_callbacks cb 0x5581d5454330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:34.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5573fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10b7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10b7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35904/0 (socket says 172.21.15.31:35904) 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10b7e00700 1 -- 172.21.15.31:0/181509769 learned_addr learned my addr 172.21.15.31:0/181509769 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.625+0000 7f10b7400700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556bd10 0x5581d5576ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 -- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556bd10 msgr2=0x5581d5576ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556bd10 0x5581d5576ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 -- 172.21.15.31:0/181509769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 msgr2=0x5581d5573fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5573fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 -- 172.21.15.31:0/181509769 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d540d880 con 0x5581d55774e0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10b7e00700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10b0018f80 tx=0x7f10b000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ee364dbaa70ec7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10a5600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:36:34.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b001bd50 con 0x5581d55774e0 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f10b0004bb0 con 0x5581d55774e0 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.626+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a80043d0 con 0x5581d55774e0 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f10b0032050 con 0x5581d55774e0 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 10 client.25144 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5581d5584400 con 0x5581d55774e0 2024-06-02T22:36:34.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80043d0 con 0x5581d55774e0 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f10b0005020 con 0x5581d55774e0 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 10 client.25144 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 10 client.25144 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 20 client.25144 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d5586ab0 0x5581d5587f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 4 client.25144 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.627+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 --> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581d54cbfb0 con 0x5581d5586ab0 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.628+0000 7f10b7400700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d5586ab0 0x5581d5587f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.628+0000 7f10b7400700 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d5586ab0 0x5581d5587f20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18dee7ad40fd1bd1 server_cookie=f9c5ef4a7cae1d60 in_seq=0 out_seq=0 2024-06-02T22:36:34.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.628+0000 7f10a5600700 10 client.25144 ms_handle_connect on v2:172.21.15.98:6838/2003931119 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.629+0000 7f10a5600700 1 -- 172.21.15.31:0/181509769 <== mds.2 v2:172.21.15.98:6838/2003931119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5581d54cbfb0 con 0x5581d5586ab0 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.629+0000 7f10a5600700 10 client.25144 handle_command_reply: tid=0 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.629+0000 7f10c8e9ab80 1 client.25144 shutdown 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.629+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 msgr2=0x5581d5574520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.629+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f10b0018f80 tx=0x7f10b000b040 comp rx=0 tx=0).stop 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 shutdown_connections 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d55774e0 0x5581d5574520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556bd10 0x5581d5576ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d5586ab0 0x5581d5587f20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/181509769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5573fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10a5600700 0 client.25144 ms_handle_reset on v2:172.21.15.98:6838/2003931119 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 >> 172.21.15.31:0/181509769 conn(0x5581d5499120 msgr2=0x5581d5567e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 shutdown_connections 2024-06-02T22:36:34.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/181509769 wait complete. 2024-06-02T22:36:34.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.630+0000 7f10c8e9ab80 20 client.25144 trim_cache size 0 max 16384 2024-06-02T22:36:34.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 Processor -- start 2024-06-02T22:36:34.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 -- start start 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d5573fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5581d5586260 con 0x5581d556c630 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d5586930 con 0x5581d55774e0 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.654+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5581d5587000 con 0x5581d556bd10 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10aea00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35914/0 (socket says 172.21.15.31:35914) 2024-06-02T22:36:34.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 -- 172.21.15.31:0/2046893638 learned_addr learned my addr 172.21.15.31:0/2046893638 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:34.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7e00700 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d5573fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 -- 172.21.15.31:0/2046893638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 msgr2=0x5581d5573fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d5573fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 -- 172.21.15.31:0/2046893638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 msgr2=0x5581d5576d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.655+0000 7f10b7400700 1 -- 172.21.15.31:0/2046893638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d5572550 con 0x5581d556bd10 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10b7400700 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80a0ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b618123cf472b55 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10a7e00700 1 -- 172.21.15.31:0/2046893638 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a809cda0 con 0x5581d556bd10 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10a7e00700 1 -- 172.21.15.31:0/2046893638 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80095d0 con 0x5581d556bd10 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10a7e00700 1 -- 172.21.15.31:0/2046893638 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80cd9c0 con 0x5581d556bd10 2024-06-02T22:36:34.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2046893638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 msgr2=0x5581d5576820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.656+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f10a8006010 tx=0x7f10a80a0ad0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2046893638 shutdown_connections 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d55774e0 0x5581d5573fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d5576820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2046893638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d556c630 0x5581d5576d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2046893638 >> 172.21.15.31:0/2046893638 conn(0x5581d5499120 msgr2=0x5581d55728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2046893638 shutdown_connections 2024-06-02T22:36:34.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2046893638 wait complete. 2024-06-02T22:36:34.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 -- start start 2024-06-02T22:36:34.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.657+0000 7f10c8e9ab80 1 Processor -- start 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556c630 0x5581d558b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 0x5581d558bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5581d5587da0 con 0x5581d55774e0 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d55876d0 con 0x5581d556c630 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5581d5588470 con 0x5581d556bd10 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10c8e9ab80 10 client.0 _ll_register_callbacks cb 0x5581d5454330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10b7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 0x5581d558bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10b7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35924/0 (socket says 172.21.15.31:35924) 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10b7400700 1 -- 172.21.15.31:0/2184172387 learned_addr learned my addr 172.21.15.31:0/2184172387 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.658+0000 7f10aea00700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556c630 0x5581d558b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 -- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556c630 msgr2=0x5581d558b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556c630 0x5581d558b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 -- 172.21.15.31:0/2184172387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 msgr2=0x5581d558bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 0x5581d558bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 -- 172.21.15.31:0/2184172387 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d558fa90 con 0x5581d556bd10 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7e00700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 0x5581d558bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10b7400700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f10a80229c0 tx=0x7f10a800b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a71b303eb78ea62a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:34.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.659+0000 7f10a5600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80043d0 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a80095d0 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f10a80a1be0 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f10a80a52b0 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10c8e9ab80 10 client.25150 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5581d55f2710 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a80095d0 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.660+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f10a809c900 con 0x5581d556bd10 2024-06-02T22:36:34.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 10 client.25150 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 10 client.25150 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 20 client.25150 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d55f6e40 0x5581d55f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 4 client.25150 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 --> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] -- command(tid 0: {"prefix": "status"}) -- 0x5581d54c6530 con 0x5581d55f6e40 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10aea00700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d55f6e40 0x5581d55f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10aea00700 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d55f6e40 0x5581d55f5b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93df613e8d577aca server_cookie=c47c788c7dae1826 in_seq=0 out_seq=0 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.661+0000 7f10a5600700 10 client.25150 ms_handle_connect on v2:172.21.15.98:6838/2003931119 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10a5600700 1 -- 172.21.15.31:0/2184172387 <== mds.2 v2:172.21.15.98:6838/2003931119 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5581d54c6530 con 0x5581d55f6e40 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10a5600700 10 client.25150 handle_command_reply: tid=0 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 client.25150 shutdown 2024-06-02T22:36:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 msgr2=0x5581d558b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f10a80229c0 tx=0x7f10a800b7c0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 shutdown_connections 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:6838/2003931119,v1:172.21.15.98:6839/2003931119] conn(0x5581d55f6e40 0x5581d55f5b50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5581d55774e0 0x5581d558bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5581d556bd10 0x5581d558b1d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 --2- 172.21.15.31:0/2184172387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d556c630 0x5581d558b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10a5600700 0 client.25150 ms_handle_reset on v2:172.21.15.98:6838/2003931119 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 >> 172.21.15.31:0/2184172387 conn(0x5581d5499120 msgr2=0x5581d5572760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 shutdown_connections 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 1 -- 172.21.15.31:0/2184172387 wait complete. 2024-06-02T22:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.662+0000 7f10c8e9ab80 20 client.25150 trim_cache size 0 max 16384 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 2, 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24503, 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 227.22514841200001, 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:36:34.666 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:36:34.667 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:36:34.667 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 335.31002308199999 2024-06-02T22:36:34.667 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:36:34.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 msgr2=0x7f109c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 0x7f109c0a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009ec0 tx=0x7f10b0009920 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 msgr2=0x7f10b81012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10a8000c00 tx=0x7f10a800bab0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 shutdown_connections 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f109c0a2ca0 0x7f109c0a5160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10b810ca20 0x7f10b8101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10b8103640 0x7f10b81012a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 --2- 172.21.15.31:0/2250574123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b8103f60 0x7f10b81017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 >> 172.21.15.31:0/2250574123 conn(0x7f10b80fce10 msgr2=0x7f10b80fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 shutdown_connections 2024-06-02T22:36:34.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:34.663+0000 7f10be600700 1 -- 172.21.15.31:0/2250574123 wait complete. 2024-06-02T22:36:35.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.g status 2024-06-02T22:36:36.236 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:35 smithi178 ceph-mon[36614]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:35 smithi031 ceph-mon[31767]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:35 smithi098 ceph-mon[36750]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:38.283 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:37 smithi031 ceph-mon[31767]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:37 smithi178 ceph-mon[36614]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:37 smithi098 ceph-mon[36750]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-06-02T22:36:38.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.605+0000 7ff283200700 1 -- 172.21.15.31:0/1088239676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 msgr2=0x7ff284104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.605+0000 7ff283200700 1 --2- 172.21.15.31:0/1088239676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff284104a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2700099c0 tx=0x7ff270009cd0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.605+0000 7ff283200700 1 -- 172.21.15.31:0/1088239676 shutdown_connections 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 --2- 172.21.15.31:0/1088239676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff284104f80 0x7ff284111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 --2- 172.21.15.31:0/1088239676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff28410a670 0x7ff28410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 --2- 172.21.15.31:0/1088239676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff284104a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 -- 172.21.15.31:0/1088239676 >> 172.21.15.31:0/1088239676 conn(0x7ff2841000d0 msgr2=0x7ff2841024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 -- 172.21.15.31:0/1088239676 shutdown_connections 2024-06-02T22:36:38.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.606+0000 7ff283200700 1 -- 172.21.15.31:0/1088239676 wait complete. 2024-06-02T22:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.607+0000 7ff283200700 1 Processor -- start 2024-06-02T22:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.607+0000 7ff283200700 1 -- start start 2024-06-02T22:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 0x7ff2841a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 0x7ff28419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff284114970 con 0x7ff2841045c0 2024-06-02T22:36:38.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2841147f0 con 0x7ff284104f80 2024-06-02T22:36:38.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff283200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff284114af0 con 0x7ff28410a670 2024-06-02T22:36:38.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36146/0 (socket says 172.21.15.31:36146) 2024-06-02T22:36:38.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff281e00700 1 -- 172.21.15.31:0/532945530 learned_addr learned my addr 172.21.15.31:0/532945530 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.608+0000 7ff282800700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 0x7ff28419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff281400700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 0x7ff2841a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 -- 172.21.15.31:0/532945530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 msgr2=0x7ff2841a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 0x7ff2841a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 -- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 msgr2=0x7ff2841a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 -- 172.21.15.31:0/532945530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28419b290 con 0x7ff28410a670 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff281e00700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff281400700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 0x7ff2841a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff282800700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 0x7ff28419ab30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff27aa00700 1 -- 172.21.15.31:0/532945530 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0092e0 con 0x7ff28410a670 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28419b520 con 0x7ff28410a670 2024-06-02T22:36:38.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff27aa00700 1 -- 172.21.15.31:0/532945530 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff27c004bb0 con 0x7ff28410a670 2024-06-02T22:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.609+0000 7ff27aa00700 1 -- 172.21.15.31:0/532945530 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c004280 con 0x7ff28410a670 2024-06-02T22:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.610+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2841a77f0 con 0x7ff28410a670 2024-06-02T22:36:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.613+0000 7ff27aa00700 1 -- 172.21.15.31:0/532945530 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7ff27c01b030 con 0x7ff28410a670 2024-06-02T22:36:38.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.614+0000 7ff27aa00700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 0x7ff2680a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.614+0000 7ff29353fb80 1 Processor -- start 2024-06-02T22:36:38.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.614+0000 7ff27aa00700 1 -- 172.21.15.31:0/532945530 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff27c0cefe0 con 0x7ff28410a670 2024-06-02T22:36:38.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 -- start start 2024-06-02T22:36:38.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff281e00700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 0x7ff2680a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 0x55da9ee3b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee45fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55da9ed4a9c0 con 0x55da9ee3b630 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da9ed8dab0 con 0x55da9ee3ad10 2024-06-02T22:36:38.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff29353fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da9ed488a0 con 0x55da9ee464e0 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.615+0000 7ff281400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee45fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 0x55da9ee3b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee45fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36150/0 (socket says 172.21.15.31:36150) 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281400700 1 -- 172.21.15.31:0/1579529802 learned_addr learned my addr 172.21.15.31:0/1579529802 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff282800700 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 0x7ff2680a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2740115a0 tx=0x7ff274009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 -- 172.21.15.31:0/1579529802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 msgr2=0x55da9ee488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 -- 172.21.15.31:0/1579529802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 msgr2=0x55da9ee45fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee45fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 -- 172.21.15.31:0/1579529802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9ed35f40 con 0x55da9ee3ad10 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.616+0000 7ff281e00700 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 0x55da9ee3b0f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fd0 tx=0x7ff274014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4d80142cf2f817 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.617+0000 7ff26f400700 1 -- 172.21.15.31:0/1579529802 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740245f0 con 0x55da9ee3ad10 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.617+0000 7ff26f400700 1 -- 172.21.15.31:0/1579529802 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff274024c70 con 0x55da9ee3ad10 2024-06-02T22:36:38.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.617+0000 7ff26f400700 1 -- 172.21.15.31:0/1579529802 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27401be10 con 0x55da9ee3ad10 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.617+0000 7ff29353fb80 1 -- 172.21.15.31:0/1579529802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 msgr2=0x55da9ee3b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.617+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 0x55da9ee3b0f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff274009fd0 tx=0x7ff274014000 comp rx=0 tx=0).stop 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 -- 172.21.15.31:0/1579529802 shutdown_connections 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3ad10 0x55da9ee3b0f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1579529802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee45fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 -- 172.21.15.31:0/1579529802 >> 172.21.15.31:0/1579529802 conn(0x55da9ed68120 msgr2=0x55da9ee37230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 -- 172.21.15.31:0/1579529802 shutdown_connections 2024-06-02T22:36:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 -- 172.21.15.31:0/1579529802 wait complete. 2024-06-02T22:36:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.618+0000 7ff29353fb80 1 -- start start 2024-06-02T22:36:38.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 Processor -- start 2024-06-02T22:36:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee45cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 0x55da9ee42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee43530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55da9ed29f10 con 0x55da9ee3ad10 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da9ed89a70 con 0x55da9ee3b630 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee48f70 con 0x55da9ee464e0 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.619+0000 7ff29353fb80 10 client.0 _ll_register_callbacks cb 0x55da9ed23330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee45cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 0x55da9ee42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee45cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36160/0 (socket says 172.21.15.31:36160) 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281e00700 1 -- 172.21.15.31:0/1771947212 learned_addr learned my addr 172.21.15.31:0/1771947212 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff282800700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee43530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 -- 172.21.15.31:0/1771947212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 msgr2=0x55da9ee43530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee43530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 -- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 msgr2=0x55da9ee45cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee45cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 -- 172.21.15.31:0/1771947212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9ecdc880 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff281400700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 0x55da9ee42ff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff270006010 tx=0x7ff27000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25f6907e2573f10 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.620+0000 7ff263e00700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270003a60 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff270003c00 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff274024c70 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff270031050 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff29353fb80 10 client.25151 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55da9ee53700 con 0x55da9ee3b630 2024-06-02T22:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.621+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff274024c70 con 0x55da9ee3b630 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff270023670 con 0x55da9ee3b630 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 10 client.25151 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 10 client.25151 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 20 client.25151 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9ee55d40 0x55da9ee571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 4 client.25151 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 --> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da9ed9afb0 con 0x55da9ee55d40 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.622+0000 7ff281e00700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9ee55d40 0x55da9ee571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.623+0000 7ff281e00700 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9ee55d40 0x55da9ee571b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1a4ed9d9f46fb06 server_cookie=1b282da8e8fb0b5c in_seq=0 out_seq=0 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.623+0000 7ff263e00700 10 client.25151 ms_handle_connect on v2:172.21.15.31:6838/4188521464 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff263e00700 1 -- 172.21.15.31:0/1771947212 <== mds.1 v2:172.21.15.31:6838/4188521464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55da9ed9afb0 con 0x55da9ee55d40 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff263e00700 10 client.25151 handle_command_reply: tid=0 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 client.25151 shutdown 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 msgr2=0x55da9ee42ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 0x55da9ee42ff0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff270006010 tx=0x7ff27000bec0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 shutdown_connections 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee464e0 0x55da9ee43530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9ee55d40 0x55da9ee571b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee45cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1771947212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee3b630 0x55da9ee42ff0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 >> 172.21.15.31:0/1771947212 conn(0x55da9ed68120 msgr2=0x55da9ee36e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.624+0000 7ff263e00700 0 client.25151 ms_handle_reset on v2:172.21.15.31:6838/4188521464 2024-06-02T22:36:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.625+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 shutdown_connections 2024-06-02T22:36:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.625+0000 7ff29353fb80 1 -- 172.21.15.31:0/1771947212 wait complete. 2024-06-02T22:36:38.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.625+0000 7ff29353fb80 20 client.25151 trim_cache size 0 max 16384 2024-06-02T22:36:38.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.649+0000 7ff29353fb80 1 Processor -- start 2024-06-02T22:36:38.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.649+0000 7ff29353fb80 1 -- start start 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.649+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.649+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3b630 0x55da9ee45830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee45d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff29353fb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee554f0 con 0x55da9ee3ad10 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff29353fb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee55bc0 con 0x55da9ee464e0 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff29353fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee56290 con 0x55da9ee3b630 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36174/0 (socket says 172.21.15.31:36174) 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 -- 172.21.15.31:0/1603340493 learned_addr learned my addr 172.21.15.31:0/1603340493 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:38.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff282800700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee45d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281400700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3b630 0x55da9ee45830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 -- 172.21.15.31:0/1603340493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3b630 msgr2=0x55da9ee45830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3b630 0x55da9ee45830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 -- 172.21.15.31:0/1603340493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 msgr2=0x55da9ee45d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee45d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff281e00700 1 -- 172.21.15.31:0/1603340493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9ee41560 con 0x55da9ee3ad10 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.650+0000 7ff282800700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee45d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:38.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.651+0000 7ff281e00700 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff27401cb60 tx=0x7ff27401b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e32011271028020 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.651+0000 7ff26ea00700 1 -- 172.21.15.31:0/1603340493 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27401ba40 con 0x55da9ee3ad10 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.651+0000 7ff26ea00700 1 -- 172.21.15.31:0/1603340493 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff274005520 con 0x55da9ee3ad10 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.651+0000 7ff26ea00700 1 -- 172.21.15.31:0/1603340493 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274004a50 con 0x55da9ee3ad10 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 -- 172.21.15.31:0/1603340493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 msgr2=0x55da9ee366d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff27401cb60 tx=0x7ff27401b740 comp rx=0 tx=0).stop 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 -- 172.21.15.31:0/1603340493 shutdown_connections 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee45d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3ad10 0x55da9ee366d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 --2- 172.21.15.31:0/1603340493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3b630 0x55da9ee45830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 -- 172.21.15.31:0/1603340493 >> 172.21.15.31:0/1603340493 conn(0x55da9ed68120 msgr2=0x55da9ee418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 -- 172.21.15.31:0/1603340493 shutdown_connections 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.652+0000 7ff29353fb80 1 -- 172.21.15.31:0/1603340493 wait complete. 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 -- start start 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 Processor -- start 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 0x55da9ee60e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee5c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee57030 con 0x55da9ee3b630 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee56960 con 0x55da9ee464e0 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da9ee57700 con 0x55da9ee3ad10 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.653+0000 7ff29353fb80 10 client.0 _ll_register_callbacks cb 0x55da9ed23330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:38.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff282800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee5c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36186/0 (socket says 172.21.15.31:36186) 2024-06-02T22:36:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281400700 1 -- 172.21.15.31:0/479176415 learned_addr learned my addr 172.21.15.31:0/479176415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 0x55da9ee60e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 -- 172.21.15.31:0/479176415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 msgr2=0x55da9ee5c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee5c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 -- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 msgr2=0x55da9ee5c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281e00700 1 -- 172.21.15.31:0/479176415 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9eec05d0 con 0x55da9ee3ad10 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff282800700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee5c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.654+0000 7ff281400700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.655+0000 7ff281e00700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 0x55da9ee60e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff274011460 tx=0x7ff27401cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8882581428c20959 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.655+0000 7ff263e00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.655+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274043060 con 0x55da9ee3ad10 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.655+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff274005520 con 0x55da9ee3ad10 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.655+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff274005300 con 0x55da9ee3ad10 2024-06-02T22:36:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff27401b970 con 0x55da9ee3ad10 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff29353fb80 10 client.25168 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55da9eec1740 con 0x55da9ee3ad10 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff274005520 con 0x55da9ee3ad10 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff274023030 con 0x55da9ee3ad10 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff29353fb80 10 client.25168 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff29353fb80 10 client.25168 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.656+0000 7ff29353fb80 20 client.25168 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9eec5d20 0x55da9eec4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff29353fb80 4 client.25168 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 --> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] -- command(tid 0: {"prefix": "status"}) -- 0x55da9ed95530 con 0x55da9eec5d20 2024-06-02T22:36:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff281400700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9eec5d20 0x55da9eec4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:38.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff281400700 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9eec5d20 0x55da9eec4a30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88a2b38ec0ec2a63 server_cookie=cc6c3103745e57b0 in_seq=0 out_seq=0 2024-06-02T22:36:38.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.657+0000 7ff263e00700 10 client.25168 ms_handle_connect on v2:172.21.15.31:6838/4188521464 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff263e00700 1 -- 172.21.15.31:0/479176415 <== mds.1 v2:172.21.15.31:6838/4188521464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da9ed95530 con 0x55da9eec5d20 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff263e00700 10 client.25168 handle_command_reply: tid=0 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 client.25168 shutdown 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 msgr2=0x55da9ee60e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 0x55da9ee60e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff274011460 tx=0x7ff27401cca0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 shutdown_connections 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da9ee464e0 0x55da9ee5c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9ee3ad10 0x55da9ee60e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:6838/4188521464,v1:172.21.15.31:6839/4188521464] conn(0x55da9eec5d20 0x55da9eec4a30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 --2- 172.21.15.31:0/479176415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55da9ee3b630 0x55da9ee5c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff263e00700 0 client.25168 ms_handle_reset on v2:172.21.15.31:6838/4188521464 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 >> 172.21.15.31:0/479176415 conn(0x55da9ed68120 msgr2=0x55da9ee42870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 shutdown_connections 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.658+0000 7ff29353fb80 1 -- 172.21.15.31:0/479176415 wait complete. 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff29353fb80 20 client.25168 trim_cache size 0 max 16384 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 1, 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24505, 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:36:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 232.23162203999999, 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 347.24546891900002 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 msgr2=0x7ff2680a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 0x7ff2680a50e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2740115a0 tx=0x7ff274009260 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 msgr2=0x7ff28419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 0x7ff28419ab30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00efc0 tx=0x7ff27c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.659+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 shutdown_connections 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff2680a2c20 0x7ff2680a50e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28410a670 0x7ff28419ab30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2841045c0 0x7ff2841a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 --2- 172.21.15.31:0/532945530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff284104f80 0x7ff2841a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 >> 172.21.15.31:0/532945530 conn(0x7ff2841000d0 msgr2=0x7ff284101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 shutdown_connections 2024-06-02T22:36:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:38.660+0000 7ff283200700 1 -- 172.21.15.31:0/532945530 wait complete. 2024-06-02T22:36:39.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph tell mds.a status 2024-06-02T22:36:40.183 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:39 smithi178 ceph-mon[36614]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:40.338 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:39 smithi031 ceph-mon[31767]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:39 smithi098 ceph-mon[36750]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:41 smithi178 ceph-mon[36614]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:42.358 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:41 smithi031 ceph-mon[31767]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:41 smithi098 ceph-mon[36750]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T22:36:42.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 -- 172.21.15.31:0/888864461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a80746c0 msgr2=0x7f27a8074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 --2- 172.21.15.31:0/888864461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a80746c0 0x7f27a8074aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27980098f0 tx=0x7f2798009c00 comp rx=0 tx=0).stop 2024-06-02T22:36:42.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 -- 172.21.15.31:0/888864461 shutdown_connections 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 --2- 172.21.15.31:0/888864461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a810ee90 0x7f27a8111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 --2- 172.21.15.31:0/888864461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a80746c0 0x7f27a8074aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 --2- 172.21.15.31:0/888864461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a8074fe0 0x7f27a810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 -- 172.21.15.31:0/888864461 >> 172.21.15.31:0/888864461 conn(0x7f27a80795f0 msgr2=0x7f27a8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 -- 172.21.15.31:0/888864461 shutdown_connections 2024-06-02T22:36:42.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.719+0000 7f27ae400700 1 -- 172.21.15.31:0/888864461 wait complete. 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.720+0000 7f27ae400700 1 Processor -- start 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 -- start start 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a8074fe0 0x7f27a819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a810ee90 0x7f27a819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81149f0 con 0x7f27a810ee90 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8114870 con 0x7f27a8074fe0 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27ae400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8114b70 con 0x7f27a80746c0 2024-06-02T22:36:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27a7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.721+0000 7f27a7e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a810ee90 0x7f27a819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48978/0 (socket says 172.21.15.31:48978) 2024-06-02T22:36:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 -- 172.21.15.31:0/1853589864 learned_addr learned my addr 172.21.15.31:0/1853589864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a8074fe0 0x7f27a819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 -- 172.21.15.31:0/1853589864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a8074fe0 msgr2=0x7f27a819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a8074fe0 0x7f27a819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 -- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a810ee90 msgr2=0x7f27a819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a810ee90 0x7f27a819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 -- 172.21.15.31:0/1853589864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a819fe70 con 0x7f27a80746c0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.722+0000 7f27a7400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2798005950 tx=0x7f279800fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.723+0000 7f279fe00700 1 -- 172.21.15.31:0/1853589864 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980051f0 con 0x7f27a80746c0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.723+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a81a0100 con 0x7f27a80746c0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.723+0000 7f279fe00700 1 -- 172.21.15.31:0/1853589864 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279800b560 con 0x7f27a80746c0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.723+0000 7f279fe00700 1 -- 172.21.15.31:0/1853589864 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798003a40 con 0x7f27a80746c0 2024-06-02T22:36:42.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.723+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a81a79e0 con 0x7f27a80746c0 2024-06-02T22:36:42.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.728+0000 7f279fe00700 1 -- 172.21.15.31:0/1853589864 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f279800ba80 con 0x7f27a80746c0 2024-06-02T22:36:42.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.729+0000 7f27b8de6b80 1 Processor -- start 2024-06-02T22:36:42.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.729+0000 7f27b8de6b80 1 -- start start 2024-06-02T22:36:42.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.729+0000 7f279fe00700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 0x7f278c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f279fe00700 1 -- 172.21.15.31:0/1853589864 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27980d03d0 con 0x7f27a80746c0 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559de38089c0 con 0x559de38f9560 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559de384bab0 con 0x559de3875df0 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559de38068a0 con 0x559de39042b0 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 0x7f278c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27a6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27a6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37630/0 (socket says 172.21.15.31:37630) 2024-06-02T22:36:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27a6a00700 1 -- 172.21.15.31:0/3572390068 learned_addr learned my addr 172.21.15.31:0/3572390068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.730+0000 7f27a7400700 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a7e00700 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 -- 172.21.15.31:0/3572390068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 msgr2=0x559de39066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 -- 172.21.15.31:0/3572390068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 msgr2=0x559de38f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 -- 172.21.15.31:0/3572390068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de37f3f40 con 0x559de38f9560 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 0x7f278c0a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27a806b9f0 tx=0x7f27a0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.731+0000 7f27a6a00700 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2794009cf0 tx=0x7f2794011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bd56a2da12e48a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.732+0000 7f279cc00700 1 -- 172.21.15.31:0/3572390068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794011d80 con 0x559de38f9560 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.732+0000 7f279cc00700 1 -- 172.21.15.31:0/3572390068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2794004500 con 0x559de38f9560 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.732+0000 7f279cc00700 1 -- 172.21.15.31:0/3572390068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794003e60 con 0x559de38f9560 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 -- 172.21.15.31:0/3572390068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 msgr2=0x559de38f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2794009cf0 tx=0x7f2794011440 comp rx=0 tx=0).stop 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 -- 172.21.15.31:0/3572390068 shutdown_connections 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/3572390068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f99e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 -- 172.21.15.31:0/3572390068 >> 172.21.15.31:0/3572390068 conn(0x559de3826120 msgr2=0x559de38f5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 -- 172.21.15.31:0/3572390068 shutdown_connections 2024-06-02T22:36:42.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.733+0000 7f27b8de6b80 1 -- 172.21.15.31:0/3572390068 wait complete. 2024-06-02T22:36:42.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 -- start start 2024-06-02T22:36:42.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 Processor -- start 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de3900d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39012d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559de37e7f10 con 0x559de38f9560 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559de3847a70 con 0x559de3875df0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.734+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559de3906f70 con 0x559de39042b0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27b8de6b80 10 client.0 _ll_register_callbacks cb 0x559de37e56d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48444/0 (socket says 172.21.15.31:48444) 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 -- 172.21.15.31:0/1064127091 learned_addr learned my addr 172.21.15.31:0/1064127091 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de3900d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 -- 172.21.15.31:0/1064127091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 msgr2=0x559de39012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 -- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 msgr2=0x559de3900d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de3900d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a7400700 1 -- 172.21.15.31:0/1064127091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de379a880 con 0x559de3875df0 2024-06-02T22:36:42.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.735+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de3900d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f27a7400700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f279809c860 tx=0x7f279809cfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24548933c2a5abf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f2791600700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980b5060 con 0x559de3875df0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27980a30e0 con 0x559de3875df0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2794004500 con 0x559de3875df0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2798085e60 con 0x559de3875df0 2024-06-02T22:36:42.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f27b8de6b80 10 client.25169 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559de3911700 con 0x559de3875df0 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.736+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2794004500 con 0x559de3875df0 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2798003c20 con 0x559de3875df0 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 10 client.25169 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 10 client.25169 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 20 client.25169 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de3913d10 0x559de3915180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 4 client.25169 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559de3858fb0 con 0x559de3913d10 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.737+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de3913d10 0x559de3915180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.738+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de3913d10 0x559de3915180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913079dc46616fb6 server_cookie=dd5fb9e179cd933f in_seq=0 out_seq=0 2024-06-02T22:36:42.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.738+0000 7f2791600700 10 client.25169 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:36:42.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f2791600700 1 -- 172.21.15.31:0/1064127091 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559de3858fb0 con 0x559de3913d10 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f2791600700 10 client.25169 handle_command_reply: tid=0 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 client.25169 shutdown 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 msgr2=0x559de3903a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f279809c860 tx=0x7f279809cfd0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 shutdown_connections 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de39012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de3913d10 0x559de3915180 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de3903a90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1064127091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de3900d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f2791600700 0 client.25169 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.739+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 >> 172.21.15.31:0/1064127091 conn(0x559de3826120 msgr2=0x559de38f46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.740+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 shutdown_connections 2024-06-02T22:36:42.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.740+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1064127091 wait complete. 2024-06-02T22:36:42.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.740+0000 7f27b8de6b80 20 client.25169 trim_cache size 0 max 16384 2024-06-02T22:36:42.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 Processor -- start 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 -- start start 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de38f9560 0x559de39056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 0x559de3905be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559de39134c0 con 0x559de3875df0 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559de3913b90 con 0x559de39042b0 2024-06-02T22:36:42.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.782+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559de3914260 con 0x559de38f9560 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37652/0 (socket says 172.21.15.31:37652) 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 0x559de3905be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de38f9560 0x559de39056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7400700 1 -- 172.21.15.31:0/1874847581 learned_addr learned my addr 172.21.15.31:0/1874847581 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 -- 172.21.15.31:0/1874847581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de38f9560 msgr2=0x559de39056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de38f9560 0x559de39056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 -- 172.21.15.31:0/1874847581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 msgr2=0x559de39035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7e00700 1 -- 172.21.15.31:0/1874847581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de38ecdc0 con 0x559de39042b0 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.783+0000 7f27a7400700 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.784+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 0x559de3905be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27a00198a0 tx=0x7f27a001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f839c09f4e49ade server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.784+0000 7f2793e00700 1 -- 172.21.15.31:0/1874847581 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0027070 con 0x559de39042b0 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.784+0000 7f2793e00700 1 -- 172.21.15.31:0/1874847581 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a0004db0 con 0x559de39042b0 2024-06-02T22:36:42.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.784+0000 7f2793e00700 1 -- 172.21.15.31:0/1874847581 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a001d070 con 0x559de39042b0 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1874847581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 msgr2=0x559de3905be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 0x559de3905be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27a00198a0 tx=0x7f27a001c000 comp rx=0 tx=0).stop 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1874847581 shutdown_connections 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de39042b0 0x559de3905be0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de3875df0 0x559de39035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1874847581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de38f9560 0x559de39056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1874847581 >> 172.21.15.31:0/1874847581 conn(0x559de3826120 msgr2=0x559de38ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1874847581 shutdown_connections 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.785+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1874847581 wait complete. 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 -- start start 2024-06-02T22:36:42.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 Processor -- start 2024-06-02T22:36:42.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de38f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559de3915000 con 0x559de38f9560 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559de3914930 con 0x559de3875df0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559de39156d0 con 0x559de39042b0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.786+0000 7f27b8de6b80 10 client.0 _ll_register_callbacks cb 0x559de37e56d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a6a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48466/0 (socket says 172.21.15.31:48466) 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 -- 172.21.15.31:0/1996320445 learned_addr learned my addr 172.21.15.31:0/1996320445 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7e00700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de38f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 -- 172.21.15.31:0/1996320445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 msgr2=0x559de38f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de38f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 -- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 msgr2=0x559de38f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.787+0000 7f27a7400700 1 -- 172.21.15.31:0/1996320445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de391ad40 con 0x559de3875df0 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f27a7400700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f279809ca90 tx=0x7f27980214c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e89a698240a3c64e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:42.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f2791600700 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:36:42.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27980a0c80 con 0x559de3875df0 2024-06-02T22:36:42.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2798098f40 con 0x559de3875df0 2024-06-02T22:36:42.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a0004db0 con 0x559de3875df0 2024-06-02T22:36:42.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2798003c20 con 0x559de3875df0 2024-06-02T22:36:42.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f27b8de6b80 10 client.25175 fetch_fsmap learned FSMap version 29 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559de397f940 con 0x559de3875df0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.788+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27a0004db0 con 0x559de3875df0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f27980a5020 con 0x559de3875df0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 10 client.25175 fetch_fsmap finished waiting for FSMap version 29 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 10 client.25175 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 20 client.25175 populate_metadata read hostname 'smithi031' 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de39842d0 0x559de3982fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 4 client.25175 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "status"}) -- 0x559de3853530 con 0x559de39842d0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.789+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de39842d0 0x559de3982fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.790+0000 7f27a6a00700 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de39842d0 0x559de3982fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8506f1ef020ccce server_cookie=3216679af17efa7b in_seq=0 out_seq=0 2024-06-02T22:36:42.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.790+0000 7f2791600700 10 client.25175 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:36:42.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f2791600700 1 -- 172.21.15.31:0/1996320445 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559de3853530 con 0x559de39842d0 2024-06-02T22:36:42.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f2791600700 10 client.25175 handle_command_reply: tid=0 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 client.25175 shutdown 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 msgr2=0x559de38f4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f279809ca90 tx=0x7f27980214c0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 shutdown_connections 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559de39042b0 0x559de38f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559de39842d0 0x559de3982fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559de3875df0 0x559de38f4a20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 --2- 172.21.15.31:0/1996320445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559de38f9560 0x559de38f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f2791600700 0 client.25175 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 >> 172.21.15.31:0/1996320445 conn(0x559de3826120 msgr2=0x559de38faf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 shutdown_connections 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 1 -- 172.21.15.31:0/1996320445 wait complete. 2024-06-02T22:36:42.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.791+0000 7f27b8de6b80 20 client.25175 trim_cache size 0 max 16384 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "52c9257e-212e-11ef-bc9b-c7b262605968", 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24517, 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 319.03380289799998, 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 29, 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 99, 2024-06-02T22:36:42.793 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 97, 2024-06-02T22:36:42.794 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 346.42016589799999 2024-06-02T22:36:42.794 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:36:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 msgr2=0x7f278c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 0x7f278c0a50e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27a806b9f0 tx=0x7f27a0009920 comp rx=0 tx=0).stop 2024-06-02T22:36:42.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 msgr2=0x7f27a819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2798005950 tx=0x7f279800fb20 comp rx=0 tx=0).stop 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 shutdown_connections 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f278c0a2c20 0x7f278c0a50e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a810ee90 0x7f27a819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a80746c0 0x7f27a819ae60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 --2- 172.21.15.31:0/1853589864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27a8074fe0 0x7f27a819b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.792+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 >> 172.21.15.31:0/1853589864 conn(0x7f27a80795f0 msgr2=0x7f27a80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.793+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 shutdown_connections 2024-06-02T22:36:42.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:42.793+0000 7f27ae400700 1 -- 172.21.15.31:0/1853589864 wait complete. 2024-06-02T22:36:43.886 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T22:36:43.896 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T22:36:43.896 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T22:36:43.896 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T22:36:43.896 INFO:teuthology.run_tasks:Running task kclient... 2024-06-02T22:36:43.954 INFO:tasks.kclient:Mounting kernel clients... 2024-06-02T22:36:43.954 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-02T22:36:43.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:43.955 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-06-02T22:36:44.011 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-02T22:36:44.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:44.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T22:36:44.090 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:43 smithi031 ceph-mon[31767]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:44.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:44.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-06-02T22:36:44.200 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-06-02T22:36:44.200 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T22:36:44.200 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-06-02T22:36:44.200 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-06-02T22:36:44.200 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T22:36:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:43 smithi178 ceph-mon[36614]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:43 smithi098 ceph-mon[36750]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T22:36:44.621 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:36:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:45 smithi178 ceph-mon[36614]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:45 smithi031 ceph-mon[31767]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:45 smithi098 ceph-mon[36750]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-06-02T22:36:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 -- 172.21.15.31:0/2260156837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 msgr2=0x7f8ba4104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 --2- 172.21.15.31:0/2260156837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba4104b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009990 tx=0x7f8b90009ca0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 -- 172.21.15.31:0/2260156837 shutdown_connections 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 --2- 172.21.15.31:0/2260156837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba4105070 0x7f8ba4111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 --2- 172.21.15.31:0/2260156837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba410a6b0 0x7f8ba410aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 --2- 172.21.15.31:0/2260156837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba4104b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.060+0000 7f8bac200700 1 -- 172.21.15.31:0/2260156837 >> 172.21.15.31:0/2260156837 conn(0x7f8ba41001a0 msgr2=0x7f8ba41025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.061+0000 7f8bac200700 1 -- 172.21.15.31:0/2260156837 shutdown_connections 2024-06-02T22:36:47.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.061+0000 7f8bac200700 1 -- 172.21.15.31:0/2260156837 wait complete. 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 Processor -- start 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 -- start start 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 0x7f8ba419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4114a90 con 0x7f8ba4105070 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4114910 con 0x7f8ba410a6b0 2024-06-02T22:36:47.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.062+0000 7f8bac200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba4114c10 con 0x7f8ba41046b0 2024-06-02T22:36:47.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8ba8e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 0x7f8ba419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48486/0 (socket says 172.21.15.31:48486) 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8ba8e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 0x7f8ba419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37666/0 (socket says 172.21.15.31:37666) 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 -- 172.21.15.31:0/3792190329 learned_addr learned my addr 172.21.15.31:0/3792190329 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8ba9800700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 -- 172.21.15.31:0/3792190329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 msgr2=0x7f8ba419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 -- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 msgr2=0x7f8ba419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 0x7f8ba419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.063+0000 7f8baa200700 1 -- 172.21.15.31:0/3792190329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba419fe50 con 0x7f8ba410a6b0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8baa200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ef30 tx=0x7f8b9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0092e0 con 0x7f8ba410a6b0 2024-06-02T22:36:47.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba41a00e0 con 0x7f8ba410a6b0 2024-06-02T22:36:47.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b9c004bb0 con 0x7f8ba410a6b0 2024-06-02T22:36:47.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba41a79c0 con 0x7f8ba410a6b0 2024-06-02T22:36:47.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.064+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c004280 con 0x7f8ba410a6b0 2024-06-02T22:36:47.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.065+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4069180 con 0x7f8ba410a6b0 2024-06-02T22:36:47.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.067+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8b9c01b030 con 0x7f8ba410a6b0 2024-06-02T22:36:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.069+0000 7f8ba2000700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 0x7f8b8c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.069+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8b9c0cf800 con 0x7f8ba410a6b0 2024-06-02T22:36:47.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.069+0000 7f8ba9800700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 0x7f8b8c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:47.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.070+0000 7f8ba9800700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 0x7f8b8c0a5160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009be0 tx=0x7f8b98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:47.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.071+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8b9c022020 con 0x7f8ba410a6b0 2024-06-02T22:36:47.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.351+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8ba419c1a0 con 0x7f8ba410a6b0 2024-06-02T22:36:47.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.352+0000 7f8ba2000700 1 -- 172.21.15.31:0/3792190329 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f8b9c010040 con 0x7f8ba410a6b0 2024-06-02T22:36:47.352 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 msgr2=0x7f8b8c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 0x7f8b8c0a5160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009be0 tx=0x7f8b98009260 comp rx=0 tx=0).stop 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 msgr2=0x7f8ba419f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ef30 tx=0x7f8b9c00c3a0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 shutdown_connections 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8b8c0a2ca0 0x7f8b8c0a5160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ba410a6b0 0x7f8ba419f710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ba41046b0 0x7f8ba419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 --2- 172.21.15.31:0/3792190329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ba4105070 0x7f8ba419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:47.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.356+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 >> 172.21.15.31:0/3792190329 conn(0x7f8ba41001a0 msgr2=0x7f8ba41006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:47.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.357+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 shutdown_connections 2024-06-02T22:36:47.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:47.357+0000 7f8bac200700 1 -- 172.21.15.31:0/3792190329 wait complete. 2024-06-02T22:36:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:48 smithi031 ceph-mon[31767]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T22:36:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:48 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3792190329' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:36:48.296 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T22:36:48.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T22:36:48.573 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-06-02T22:36:48.573 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T22:36:48.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-06-02T22:36:48.574 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T22:36:48.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T22:36:48.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T22:36:48.574 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-06-02T22:36:48.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:48.576 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-06-02T22:36:48.577 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:48 smithi098 ceph-mon[36750]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T22:36:48.578 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:48 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3792190329' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:36:48.578 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:48 smithi178 ceph-mon[36614]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-06-02T22:36:48.579 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:48 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3792190329' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T22:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-06-02T22:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T22:36:48.647 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-06-02T22:36:48.647 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-06-02T22:36:48.647 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-02T22:36:48.647 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41682sec preferred_lft 41682sec 2024-06-02T22:36:48.648 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link noprefixroute 2024-06-02T22:36:48.648 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-06-02T22:36:48.648 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T22:36:48.648 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-06-02T22:36:48.649 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-06-02T22:36:48.649 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T22:36:48.650 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:36:48.650 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:36:48.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-06-02T22:36:48.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-06-02T22:36:48.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-06-02T22:36:48.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T22:36:48.651 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:36:48.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:48.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:48.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:48.915 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T22:36:48.986 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-06-02T22:36:48.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:48.990 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-06-02T22:36:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-06-02T22:36:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T22:36:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-02T22:36:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-02T22:36:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-02T22:36:49.045 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:36:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:49.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:49.273 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-06-02T22:36:49.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:49.320 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-06-02T22:36:49.420 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:36:49.420 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:36:49.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--tmp-cephfs 2024-06-02T22:36:49.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-06-02T22:36:49.420 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:36:49.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:49.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:49.611 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-06-02T22:36:49.612 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:36:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:49.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:49.893 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T22:36:49.893 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-06-02T22:36:49.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-06-02T22:36:49.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T22:36:49.894 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-06-02T22:36:49.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:50.067 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:50 smithi031 ceph-mon[31767]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-06-02T22:36:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:50.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:36:50.101 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /tmp/cephfs 2024-06-02T22:36:50.149 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/tmp/cephfs' 2024-06-02T22:36:50.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T22:36:50.150 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /tmp/cephfs 2024-06-02T22:36:50.248 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-02T22:36:50.248 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-02T22:36:50.248 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/b0cabd1e-a4c8-49e8-8144-5366b656c495 2024-06-02T22:36:50.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:50.248 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/b0cabd1e-a4c8-49e8-8144-5366b656c495 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-06-02T22:36:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:50 smithi178 ceph-mon[36614]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-06-02T22:36:50.374 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-06-02T22:36:50.374 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-06-02T22:36:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:50 smithi098 ceph-mon[36750]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-06-02T22:36:51.106 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-06-02T22:36:51.106 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-06-02T22:36:51.106 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.98:3300,172.21.15.178:3300" 2024-06-02T22:36:51.106 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@52c9257e-212e-11ef-bc9b-c7b262605968.cephfs=/volumes/qa/sv_1/b0cabd1e-a4c8-49e8-8144-5366b656c495 2024-06-02T22:36:51.106 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.31:3300/172.21.15.98:3300/172.21.15.178:3300" will pass to kernel 2024-06-02T22:36:51.119 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T22:36:51.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:36:51.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /tmp/cephfs 2024-06-02T22:36:51.205 DEBUG:teuthology.orchestra.run.smithi031:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T22:36:51.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T22:36:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:51.334 INFO:teuthology.orchestra.run.smithi031.stdout:client15090 2024-06-02T22:36:51.334 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:36:51.334 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:36:51.385 DEBUG:teuthology.orchestra.run.smithi031:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T22:36:51.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T22:36:51.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:51.558 INFO:teuthology.orchestra.run.smithi031.stdout:client15090 2024-06-02T22:36:51.558 DEBUG:teuthology.orchestra.run.smithi031:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T22:36:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T22:36:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:51.675 INFO:teuthology.orchestra.run.smithi031.stdout:client15090 2024-06-02T22:36:51.676 DEBUG:teuthology.orchestra.run.smithi031:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52c9257e-212e-11ef-bc9b-c7b262605968.client15090/status') 2024-06-02T22:36:51.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T22:36:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:instance: client.15090 (3)192.168.0.1:0/3289093234 2024-06-02T22:36:51.822 INFO:teuthology.orchestra.run.smithi031.stdout:blocklisted: false 2024-06-02T22:36:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2024-06-02T22:36:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2024-06-02T22:36:51.822 INFO:teuthology.orchestra.run.smithi031.stderr:70 bytes copied, 8.4113e-05 s, 832 kB/s 2024-06-02T22:36:51.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T22:36:51.834 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T22:36:51.844 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T22:36:51.844 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:36:51.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-06-02T22:36:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.049+0000 7fb553e00640 1 -- 172.21.15.31:0/1070693790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 msgr2=0x7fb5540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.049+0000 7fb553e00640 1 --2- 172.21.15.31:0/1070693790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5540787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009860 tx=0x7fb54c02a340 comp rx=0 tx=0).stop 2024-06-02T22:36:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.049+0000 7fb553e00640 1 -- 172.21.15.31:0/1070693790 shutdown_connections 2024-06-02T22:36:52.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 --2- 172.21.15.31:0/1070693790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5540787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 --2- 172.21.15.31:0/1070693790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 0x7fb554077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 --2- 172.21.15.31:0/1070693790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb554076780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 -- 172.21.15.31:0/1070693790 >> 172.21.15.31:0/1070693790 conn(0x7fb5540fefd0 msgr2=0x7fb554101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 -- 172.21.15.31:0/1070693790 shutdown_connections 2024-06-02T22:36:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.050+0000 7fb553e00640 1 -- 172.21.15.31:0/1070693790 wait complete. 2024-06-02T22:36:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 Processor -- start 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 -- start start 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 0x7fb55419e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5541a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb554113af0 con 0x7fb554076360 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb554113970 con 0x7fb554077f40 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.051+0000 7fb553e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb554113c70 con 0x7fb5540775a0 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb552a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb552a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36550/0 (socket says 172.21.15.31:36550) 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb552a00640 1 -- 172.21.15.31:0/893485991 learned_addr learned my addr 172.21.15.31:0/893485991 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5541a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:52.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb54a000640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 0x7fb55419e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 -- 172.21.15.31:0/893485991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 msgr2=0x7fb55419e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 0x7fb55419e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 -- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 msgr2=0x7fb55419e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 -- 172.21.15.31:0/893485991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5541a5d30 con 0x7fb554077f40 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb552a00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:36:52.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.052+0000 7fb553400640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5541a56c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb54c02a930 tx=0x7fb54c033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.053+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c037040 con 0x7fb554077f40 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.053+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb54c040070 con 0x7fb554077f40 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.053+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5541a5fc0 con 0x7fb554077f40 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.053+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0046c0 con 0x7fb554077f40 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.053+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5541a6420 con 0x7fb554077f40 2024-06-02T22:36:52.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.054+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5541103d0 con 0x7fb554077f40 2024-06-02T22:36:52.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.056+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fb54c004040 con 0x7fb554077f40 2024-06-02T22:36:52.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.057+0000 7fb54be00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 0x7fb5380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:52.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.058+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fb54c0ef470 con 0x7fb554077f40 2024-06-02T22:36:52.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.058+0000 7fb552a00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 0x7fb5380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:52.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.059+0000 7fb552a00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 0x7fb5380a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e860 tx=0x7fb544010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:52.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.062+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb54c0bbfe0 con 0x7fb554077f40 2024-06-02T22:36:52.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:52 smithi031 ceph-mon[31767]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-06-02T22:36:52.264 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:52 smithi098 ceph-mon[36750]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-06-02T22:36:52.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:52.310+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fb5540625a0 con 0x7fb554077f40 2024-06-02T22:36:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:52 smithi178 ceph-mon[36614]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-06-02T22:36:53.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.028+0000 7fb54be00640 1 -- 172.21.15.31:0/893485991 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7fb54c0bb8e0 con 0x7fb554077f40 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 msgr2=0x7fb5380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 0x7fb5380a5040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e860 tx=0x7fb544010040 comp rx=0 tx=0).stop 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 msgr2=0x7fb5541a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5541a56c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb54c02a930 tx=0x7fb54c033d90 comp rx=0 tx=0).stop 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 shutdown_connections 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb5380a2b80 0x7fb5380a5040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb554077f40 0x7fb5541a56c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5540775a0 0x7fb55419e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 --2- 172.21.15.31:0/893485991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb554076360 0x7fb55419e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.032+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 >> 172.21.15.31:0/893485991 conn(0x7fb5540fefd0 msgr2=0x7fb554100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.033+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 shutdown_connections 2024-06-02T22:36:53.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.033+0000 7fb553e00640 1 -- 172.21.15.31:0/893485991 wait complete. 2024-06-02T22:36:53.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-06-02T22:36:53.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 -- 172.21.15.31:0/1063903472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c077f40 msgr2=0x7f7d2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 --2- 172.21.15.31:0/1063903472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c077f40 0x7f7d2c0787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009be0 tx=0x7f7d2402a6d0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 -- 172.21.15.31:0/1063903472 shutdown_connections 2024-06-02T22:36:53.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 --2- 172.21.15.31:0/1063903472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c077f40 0x7f7d2c0787e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 --2- 172.21.15.31:0/1063903472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 0x7f7d2c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 --2- 172.21.15.31:0/1063903472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c076360 0x7f7d2c076780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.266+0000 7f7d33800640 1 -- 172.21.15.31:0/1063903472 >> 172.21.15.31:0/1063903472 conn(0x7f7d2c0ff190 msgr2=0x7f7d2c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:53.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.267+0000 7f7d33800640 1 -- 172.21.15.31:0/1063903472 shutdown_connections 2024-06-02T22:36:53.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.267+0000 7f7d33800640 1 -- 172.21.15.31:0/1063903472 wait complete. 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 Processor -- start 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 -- start start 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 0x7f7d2c19e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 0x7f7d2c1a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c113cb0 con 0x7f7d2c077f40 2024-06-02T22:36:53.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c113b30 con 0x7f7d2c0775a0 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d33800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2c113e30 con 0x7f7d2c076360 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d31800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 0x7f7d2c1a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.268+0000 7f7d30e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42286/0 (socket says 172.21.15.31:42286) 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 -- 172.21.15.31:0/25788083 learned_addr learned my addr 172.21.15.31:0/25788083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d31800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 0x7f7d2c1a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36568/0 (socket says 172.21.15.31:36568) 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d2be00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 0x7f7d2c19e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 -- 172.21.15.31:0/25788083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 msgr2=0x7f7d2c19e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 0x7f7d2c19e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 -- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 msgr2=0x7f7d2c1a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 0x7f7d2c1a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 -- 172.21.15.31:0/25788083 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2c1a5e70 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d30e00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000e9c0 tx=0x7f7d2000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.269+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2000cde0 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.270+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d200035f0 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.270+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2c1a6160 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.270+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20010690 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.270+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2c1a66b0 con 0x7f7d2c076360 2024-06-02T22:36:53.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.271+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c110590 con 0x7f7d2c076360 2024-06-02T22:36:53.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.273+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7d200037a0 con 0x7f7d2c076360 2024-06-02T22:36:53.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.274+0000 7f7d29600640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 0x7f7d140a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:36:53.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.274+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7d200cf720 con 0x7f7d2c076360 2024-06-02T22:36:53.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.275+0000 7f7d2be00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 0x7f7d140a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:36:53.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.275+0000 7f7d2be00640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 0x7f7d140a50f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c19f760 tx=0x7f7d18005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:36:53.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.279+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d2009c290 con 0x7f7d2c076360 2024-06-02T22:36:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:53 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/893485991' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:53 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/893485991' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:53 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/893485991' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:53 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T22:36:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.515+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 --> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f7d2c061e80 con 0x7f7d140a2c30 2024-06-02T22:36:53.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.541+0000 7f7d29600640 1 -- 172.21.15.31:0/25788083 <== mgr.14152 v2:172.21.15.31:6800/784266653 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f7d2c061e80 con 0x7f7d140a2c30 2024-06-02T22:36:53.540 INFO:teuthology.orchestra.run.smithi031.stdout:{} 2024-06-02T22:36:53.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 msgr2=0x7f7d140a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 0x7f7d140a50f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c19f760 tx=0x7f7d18005f90 comp rx=0 tx=0).stop 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 msgr2=0x7f7d2c19e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000e9c0 tx=0x7f7d2000ee80 comp rx=0 tx=0).stop 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 shutdown_connections 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7d140a2c30 0x7f7d140a50f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d2c077f40 0x7f7d2c1a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d2c0775a0 0x7f7d2c19e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 --2- 172.21.15.31:0/25788083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d2c076360 0x7f7d2c19e2a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:36:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 >> 172.21.15.31:0/25788083 conn(0x7f7d2c0ff190 msgr2=0x7f7d2c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:36:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 shutdown_connections 2024-06-02T22:36:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:36:53.543+0000 7f7d33800640 1 -- 172.21.15.31:0/25788083 wait complete. 2024-06-02T22:36:53.562 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-02T22:36:53.582 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-02T22:36:53.670 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:36:53.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-02T22:36:53.679 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T22:36:53.795 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T22:36:53.795 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:36:53.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-06-02T22:36:53.796 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:36:53.524+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:36:53.796 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:36:53.524+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:36:53.796 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:36:53.524+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:36:53.796 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:36:53.524+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:36:53.796 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:36:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:36:53.524+0000 7fa7e0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T22:36:53.907 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:36:53.966 INFO:teuthology.orchestra.run.smithi031.stdout:Filesystem Size Used Avail Use% Mounted on 2024-06-02T22:36:53.966 INFO:teuthology.orchestra.run.smithi031.stdout:0@52c9257e-212e-11ef-bc9b-c7b262605968.cephfs=/volumes/qa/sv_1/b0cabd1e-a4c8-49e8-8144-5366b656c495 1.1T 376M 1.1T 1% /tmp/cephfs 2024-06-02T22:36:53.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-06-02T22:36:54.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-06-02T22:36:54.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-06-02T22:36:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:54 smithi178 ceph-mon[36614]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T22:36:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:54 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T22:36:54.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:54 smithi178 ceph-mon[36614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:36:54.319 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:54 smithi031 ceph-mon[31767]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T22:36:54.319 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:54 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T22:36:54.319 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:54 smithi031 ceph-mon[31767]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:36:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:54 smithi098 ceph-mon[36750]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T22:36:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:54 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T22:36:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:54 smithi098 ceph-mon[36750]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T22:36:55.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:55 smithi178 ceph-mon[36614]: from='client.25204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:55.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:55 smithi031 ceph-mon[31767]: from='client.25204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:55.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:55 smithi098 ceph-mon[36750]: from='client.25204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T22:36:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:56 smithi178 ceph-mon[36614]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-06-02T22:36:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:56 smithi178 ceph-mon[36614]: mgrmap e19: x(active, since 14m), standbys: z, y 2024-06-02T22:36:56.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:56 smithi031 ceph-mon[31767]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-06-02T22:36:56.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:56 smithi031 ceph-mon[31767]: mgrmap e19: x(active, since 14m), standbys: z, y 2024-06-02T22:36:56.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-06-02T22:36:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:56 smithi098 ceph-mon[36750]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-06-02T22:36:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:56 smithi098 ceph-mon[36750]: mgrmap e19: x(active, since 14m), standbys: z, y 2024-06-02T22:36:56.493 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-06-02T22:36:56.499 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-06-02T22:36:56.608 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T22:36:56.708 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/: 2024-06-02T22:36:56.708 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 data 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data: 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:36:56.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:36:56.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-06-02T22:36:56.848 INFO:teuthology.orchestra.run.smithi031.stdout:[Service] 2024-06-02T22:36:56.848 INFO:teuthology.orchestra.run.smithi031.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-06-02T22:36:56.848 INFO:teuthology.orchestra.run.smithi031.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-06-02T22:36:56.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-06-02T22:36:57.056 INFO:teuthology.orchestra.run.smithi031.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-06-02T22:36:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:36:58 smithi178 ceph-mon[36614]: pgmap v510: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-06-02T22:36:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:36:58 smithi031 ceph-mon[31767]: pgmap v510: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-06-02T22:36:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:36:58 smithi098 ceph-mon[36750]: pgmap v510: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-06-02T22:37:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:00 smithi178 ceph-mon[36614]: pgmap v511: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-06-02T22:37:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:00 smithi031 ceph-mon[31767]: pgmap v511: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-06-02T22:37:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:00 smithi098 ceph-mon[36750]: pgmap v511: 129 pgs: 129 active+clean; 665 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-06-02T22:37:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:02 smithi178 ceph-mon[36614]: pgmap v512: 129 pgs: 129 active+clean; 2.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 126 KiB/s wr, 16 op/s 2024-06-02T22:37:02.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:02 smithi031 ceph-mon[31767]: pgmap v512: 129 pgs: 129 active+clean; 2.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 126 KiB/s wr, 16 op/s 2024-06-02T22:37:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:02 smithi098 ceph-mon[36750]: pgmap v512: 129 pgs: 129 active+clean; 2.0 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 126 KiB/s wr, 16 op/s 2024-06-02T22:37:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:04 smithi031 ceph-mon[31767]: pgmap v513: 129 pgs: 129 active+clean; 23 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 30 op/s 2024-06-02T22:37:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:04 smithi098 ceph-mon[36750]: pgmap v513: 129 pgs: 129 active+clean; 23 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 30 op/s 2024-06-02T22:37:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:04 smithi178 ceph-mon[36614]: pgmap v513: 129 pgs: 129 active+clean; 23 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 1.8 MiB/s wr, 30 op/s 2024-06-02T22:37:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:06 smithi031 ceph-mon[31767]: pgmap v514: 129 pgs: 129 active+clean; 24 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.9 MiB/s wr, 34 op/s 2024-06-02T22:37:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:06 smithi098 ceph-mon[36750]: pgmap v514: 129 pgs: 129 active+clean; 24 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.9 MiB/s wr, 34 op/s 2024-06-02T22:37:06.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:06 smithi178 ceph-mon[36614]: pgmap v514: 129 pgs: 129 active+clean; 24 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 1.9 MiB/s wr, 34 op/s 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 -- 172.21.15.31:0/2950130403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce141057d0 msgr2=0x7fce1410c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 --2- 172.21.15.31:0/2950130403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce141057d0 0x7fce1410c060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009be0 tx=0x7fce0c02a6c0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 -- 172.21.15.31:0/2950130403 shutdown_connections 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 --2- 172.21.15.31:0/2950130403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce141057d0 0x7fce1410c060 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 --2- 172.21.15.31:0/2950130403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14104e10 0x7fce14105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 --2- 172.21.15.31:0/2950130403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce14103c20 0x7fce14104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.959+0000 7fce1a000640 1 -- 172.21.15.31:0/2950130403 >> 172.21.15.31:0/2950130403 conn(0x7fce140ff190 msgr2=0x7fce141015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:06.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.960+0000 7fce1a000640 1 -- 172.21.15.31:0/2950130403 shutdown_connections 2024-06-02T22:37:06.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.960+0000 7fce1a000640 1 -- 172.21.15.31:0/2950130403 wait complete. 2024-06-02T22:37:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 Processor -- start 2024-06-02T22:37:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 -- start start 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 0x7fce14199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce141057d0 0x7fce141a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce1410f850 con 0x7fce14103c20 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce1410f6d0 con 0x7fce141057d0 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce1a000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fce1410f9d0 con 0x7fce14104e10 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce0aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce13400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 0x7fce14199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce0aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42640/0 (socket says 172.21.15.31:42640) 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce0aa00640 1 -- 172.21.15.31:0/782800046 learned_addr learned my addr 172.21.15.31:0/782800046 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.961+0000 7fce13e00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce141057d0 0x7fce141a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 -- 172.21.15.31:0/782800046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce141057d0 msgr2=0x7fce141a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce141057d0 0x7fce141a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 -- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 msgr2=0x7fce14199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 0x7fce14199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 -- 172.21.15.31:0/782800046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce141a1a00 con 0x7fce14104e10 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce13400640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 0x7fce14199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.962+0000 7fce0aa00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e9c0 tx=0x7fcdfc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.963+0000 7fce10c00640 1 -- 172.21.15.31:0/782800046 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00cde0 con 0x7fce14104e10 2024-06-02T22:37:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.963+0000 7fce10c00640 1 -- 172.21.15.31:0/782800046 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdfc0035f0 con 0x7fce14104e10 2024-06-02T22:37:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.963+0000 7fce10c00640 1 -- 172.21.15.31:0/782800046 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc010690 con 0x7fce14104e10 2024-06-02T22:37:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.963+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce141a1cf0 con 0x7fce14104e10 2024-06-02T22:37:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.963+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce141a2190 con 0x7fce14104e10 2024-06-02T22:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.966+0000 7fce1ce2f740 1 Processor -- start 2024-06-02T22:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 -- start start 2024-06-02T22:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce10c00640 1 -- 172.21.15.31:0/782800046 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 137884+0+0 (secure 0 0 0) 0x7fcdfc003fe0 con 0x7fce14104e10 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fbffff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fc07bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f85fb63420 con 0x55f85fbffbd0 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f85fb0ac50 con 0x55f85fc05730 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f85fb5f3e0 con 0x55f85fc005c0 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fbffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce13400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fbffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40276/0 (socket says 172.21.15.31:40276) 2024-06-02T22:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.967+0000 7fce13e00640 1 -- 172.21.15.31:0/1558806758 learned_addr learned my addr 172.21.15.31:0/1558806758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:06.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce0aa00640 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fc07bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 -- 172.21.15.31:0/1558806758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 msgr2=0x55f85fc07bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fc07bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 -- 172.21.15.31:0/1558806758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 msgr2=0x55f85fbffff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fbffff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 -- 172.21.15.31:0/1558806758 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85f877210 con 0x55f85fc005c0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.968+0000 7fce13400640 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc050c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fa0 tx=0x7fce040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e3df949147c236d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce03e00640 1 -- 172.21.15.31:0/1558806758 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04004030 con 0x55f85fc005c0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce03e00640 1 -- 172.21.15.31:0/1558806758 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce040041d0 con 0x55f85fc005c0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce03e00640 1 -- 172.21.15.31:0/1558806758 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0400f8d0 con 0x55f85fc005c0 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce10c00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 0x7fcdf80a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce10c00640 1 -- 172.21.15.31:0/782800046 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fcdfc0cf780 con 0x7fce14104e10 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce13e00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 0x7fcdf80a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce1ce2f740 1 -- 172.21.15.31:0/1558806758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 msgr2=0x55f85fc050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.969+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc050c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fce04009fa0 tx=0x7fce040118d0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 -- 172.21.15.31:0/1558806758 shutdown_connections 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fc07bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc050c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/1558806758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fbffff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 -- 172.21.15.31:0/1558806758 >> 172.21.15.31:0/1558806758 conn(0x55f85fbc7f80 msgr2=0x55f85fbfb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 -- 172.21.15.31:0/1558806758 shutdown_connections 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 -- 172.21.15.31:0/1558806758 wait complete. 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce1ce2f740 1 -- start start 2024-06-02T22:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.970+0000 7fce13e00640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 0x7fcdf80a5210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55f85fc00e20 tx=0x7fce0c004a60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 Processor -- start 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fbffbd0 0x55f85fc09f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc0a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f85fc086e0 con 0x55f85fc05730 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f85fb1e0b0 con 0x55f85fbffbd0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f85fc08860 con 0x55f85fc005c0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce1ce2f740 10 client.0 _ll_register_callbacks cb 0x55f85fb09f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.971+0000 7fce13400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fbffbd0 0x55f85fc09f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40278/0 (socket says 172.21.15.31:40278) 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce13e00640 1 -- 172.21.15.31:0/2421440831 learned_addr learned my addr 172.21.15.31:0/2421440831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc0a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 -- 172.21.15.31:0/2421440831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fbffbd0 msgr2=0x55f85fc09f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fbffbd0 0x55f85fc09f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 -- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 msgr2=0x55f85fc114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 -- 172.21.15.31:0/2421440831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85f943620 con 0x55f85fc005c0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce13e00640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc0a470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ccda0 tx=0x7fcdfc09b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72ac194f36e90db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.972+0000 7fce00c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc09fea0 con 0x55f85fc005c0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fcdfc0ccff0 con 0x55f85fc005c0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce040041d0 con 0x55f85fc005c0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcdfc0a4760 con 0x55f85fc005c0 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce1ce2f740 10 client.25222 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f85fc14890 con 0x55f85fc005c0 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce040041d0 con 0x55f85fc005c0 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.973+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fcdfc09abb0 con 0x55f85fc005c0 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 10 client.25222 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 10 client.25222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 20 client.25222 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc16020 0x55f85fc184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 4 client.25222 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f85fb70b50 con 0x55f85fc16020 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.974+0000 7fce13400640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc16020 0x55f85fc184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.975+0000 7fce13400640 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc16020 0x55f85fc184a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77a1675fac8fc4b5 server_cookie=c278702f583bd28d in_seq=0 out_seq=0 2024-06-02T22:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.975+0000 7fce00c00640 10 client.25222 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce00c00640 1 -- 172.21.15.31:0/2421440831 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f85fb70b50 con 0x55f85fc16020 2024-06-02T22:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce00c00640 10 client.25222 handle_command_reply: tid=0 2024-06-02T22:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 client.25222 shutdown 2024-06-02T22:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 msgr2=0x55f85fc0a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc0a470 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0ccda0 tx=0x7fcdfc09b450 comp rx=0 tx=0).stop 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 shutdown_connections 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc16020 0x55f85fc184a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc05730 0x55f85fc114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce00c00640 0 client.25222 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.976+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc005c0 0x55f85fc0a470 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2421440831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fbffbd0 0x55f85fc09f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 >> 172.21.15.31:0/2421440831 conn(0x55f85fbc7f80 msgr2=0x55f85fbfa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 shutdown_connections 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2421440831 wait complete. 2024-06-02T22:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.977+0000 7fce1ce2f740 20 client.25222 trim_cache size 0 max 16384 2024-06-02T22:37:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 Processor -- start 2024-06-02T22:37:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 -- start start 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 0x55f85fc09910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fbf68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf000fb80 con 0x55f85fc005c0 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00116c0 con 0x55f85fc05730 2024-06-02T22:37:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.995+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0010250 con 0x55f85fbffbd0 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce0aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 0x55f85fc09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce0aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40286/0 (socket says 172.21.15.31:40286) 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce0aa00640 1 -- 172.21.15.31:0/513509349 learned_addr learned my addr 172.21.15.31:0/513509349 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13e00640 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fbf68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13400640 1 -- 172.21.15.31:0/513509349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 msgr2=0x55f85fbf68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13400640 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fbf68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13400640 1 -- 172.21.15.31:0/513509349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 msgr2=0x55f85fc11470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.996+0000 7fce13400640 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce13400640 1 -- 172.21.15.31:0/513509349 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85fc04b50 con 0x55f85fbffbd0 2024-06-02T22:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce0aa00640 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce13400640 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 0x55f85fc09910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f85fbfc500 tx=0x7fce040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a35c98cf9ccf1d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce03400640 1 -- 172.21.15.31:0/513509349 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04005040 con 0x55f85fbffbd0 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce03400640 1 -- 172.21.15.31:0/513509349 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce040035f0 con 0x55f85fbffbd0 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.997+0000 7fce03400640 1 -- 172.21.15.31:0/513509349 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0400f5a0 con 0x55f85fbffbd0 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 -- 172.21.15.31:0/513509349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 msgr2=0x55f85fc09910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 0x55f85fc09910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f85fbfc500 tx=0x7fce040118d0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 -- 172.21.15.31:0/513509349 shutdown_connections 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc05730 0x55f85fbf68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fc005c0 0x55f85fc11470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/513509349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fbffbd0 0x55f85fc09910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 -- 172.21.15.31:0/513509349 >> 172.21.15.31:0/513509349 conn(0x55f85fbc7f80 msgr2=0x55f85fc09200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 -- 172.21.15.31:0/513509349 shutdown_connections 2024-06-02T22:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.998+0000 7fce1ce2f740 1 -- 172.21.15.31:0/513509349 wait complete. 2024-06-02T22:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.999+0000 7fce1ce2f740 1 -- start start 2024-06-02T22:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:06.999+0000 7fce1ce2f740 1 Processor -- start 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 0x55f85fc0ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc05730 0x55f85fc0fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0010ff0 con 0x55f85fbffbd0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf0010920 con 0x55f85fc005c0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf000db60 con 0x55f85fc05730 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce1ce2f740 10 client.0 _ll_register_callbacks cb 0x7fcdfc097e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40290/0 (socket says 172.21.15.31:40290) 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 -- 172.21.15.31:0/2889871851 learned_addr learned my addr 172.21.15.31:0/2889871851 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 0x55f85fc0ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13e00640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc05730 0x55f85fc0fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 -- 172.21.15.31:0/2889871851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc05730 msgr2=0x55f85fc0fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc05730 0x55f85fc0fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 -- 172.21.15.31:0/2889871851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 msgr2=0x55f85fc0ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 0x55f85fc0ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce13400640 1 -- 172.21.15.31:0/2889871851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f85fc10180 con 0x55f85fbffbd0 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.000+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 0x55f85fc0ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.001+0000 7fce13400640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fce0401b040 tx=0x7fce04004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abbfc272c63b24 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.001+0000 7fce00c00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.001+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040037a0 con 0x55f85fbffbd0 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.001+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fce04003940 con 0x55f85fbffbd0 2024-06-02T22:37:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.001+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce040035f0 con 0x55f85fbffbd0 2024-06-02T22:37:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce04042050 con 0x55f85fbffbd0 2024-06-02T22:37:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 10 client.15126 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f85fc11490 con 0x55f85fbffbd0 2024-06-02T22:37:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce040035f0 con 0x55f85fbffbd0 2024-06-02T22:37:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fce04033480 con 0x55f85fbffbd0 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 10 client.15126 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 10 client.15126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 20 client.15126 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc81070 0x55f85fc83460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.002+0000 7fce1ce2f740 4 client.15126 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.003+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f85fb6aea0 con 0x55f85fc81070 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.003+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc81070 0x55f85fc83460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.003+0000 7fce0aa00640 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc81070 0x55f85fc83460 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42351015ca92f139 server_cookie=b976f0757973c36 in_seq=0 out_seq=0 2024-06-02T22:37:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.003+0000 7fce00c00640 10 client.15126 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce00c00640 1 -- 172.21.15.31:0/2889871851 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f85fb6aea0 con 0x55f85fc81070 2024-06-02T22:37:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce00c00640 10 client.15126 handle_command_reply: tid=0 2024-06-02T22:37:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 client.15126 shutdown 2024-06-02T22:37:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 msgr2=0x55f85fc0e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:07.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fce0401b040 tx=0x7fce04004180 comp rx=0 tx=0).stop 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 shutdown_connections 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f85fc81070 0x55f85fc83460 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f85fc05730 0x55f85fc0fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.837+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f85fc005c0 0x55f85fc0ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce1ce2f740 1 --2- 172.21.15.31:0/2889871851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f85fbffbd0 0x55f85fc0e6b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 >> 172.21.15.31:0/2889871851 conn(0x55f85fbc7f80 msgr2=0x55f85fbfe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce00c00640 0 client.15126 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 shutdown_connections 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce1ce2f740 1 -- 172.21.15.31:0/2889871851 wait complete. 2024-06-02T22:37:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.838+0000 7fce1ce2f740 20 client.15126 trim_cache size 0 max 16384 2024-06-02T22:37:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:37:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:37:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.839+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 msgr2=0x7fcdf80a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.839+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 0x7fcdf80a5210 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55f85fc00e20 tx=0x7fce0c004a60 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.839+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 msgr2=0x7fce1419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.839+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e9c0 tx=0x7fcdfc00ee80 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 shutdown_connections 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcdf80a2d50 0x7fcdf80a5210 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce141057d0 0x7fce141a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce14104e10 0x7fce1419a320 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 --2- 172.21.15.31:0/782800046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce14103c20 0x7fce14199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 >> 172.21.15.31:0/782800046 conn(0x7fce140ff190 msgr2=0x7fce14108110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 shutdown_connections 2024-06-02T22:37:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:07.840+0000 7fce1a000640 1 -- 172.21.15.31:0/782800046 wait complete. 2024-06-02T22:37:08.364 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:08 smithi178 ceph-mon[36614]: pgmap v515: 129 pgs: 129 active+clean; 24 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.0 MiB/s wr, 38 op/s 2024-06-02T22:37:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:08 smithi031 ceph-mon[31767]: pgmap v515: 129 pgs: 129 active+clean; 24 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.0 MiB/s wr, 38 op/s 2024-06-02T22:37:08.404 INFO:teuthology.orchestra.run.smithi031.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-06-02T22:37:08.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T22:37:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:08 smithi098 ceph-mon[36750]: pgmap v515: 129 pgs: 129 active+clean; 24 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.0 MiB/s wr, 38 op/s 2024-06-02T22:37:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/: 2024-06-02T22:37:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:37:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:37:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 data 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data: 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:total 35 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 . 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 base 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Jun 2 22:37 global 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 log 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_commit_ts 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_dynshmem 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Jun 2 22:36 pg_hba.conf 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 22:36 pg_ident.conf 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 pg_logical 2024-06-02T22:37:08.535 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 pg_multixact 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_notify 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_replslot 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_serial 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_snapshots 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_stat 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_stat_tmp 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 pg_subtrans 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_tblspc 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_twophase 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:36 PG_VERSION 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 pg_wal 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 pg_xact 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 22:36 postgresql.auto.conf 2024-06-02T22:37:08.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 Jun 2 22:36 postgresql.conf 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 . 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 1 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 13493 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 13494 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:total 7777 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 . 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 .. 2024-06-02T22:37:08.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 112 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 113 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:37 1259 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:37:08.538 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:37:08.539 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 1417 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 1418 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 174 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 175 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2187 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2224 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2328 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2336 2024-06-02T22:37:08.540 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2337 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:37:08.541 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2604 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:37:08.542 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2611 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2613 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:37:08.543 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Jun 2 22:37 2619 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2619_fsm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2620 2024-06-02T22:37:08.544 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2650 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2651 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2652 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2653 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2654 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2655 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2656 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2657 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2660 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2661 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:37:08.545 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2668 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2669 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2670 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2680 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2683 2024-06-02T22:37:08.546 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2686 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2687 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2688 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:36 2689 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2696 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2699 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2701 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2702 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:37:08.547 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2754 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2755 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2756 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2757 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2830 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2831 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2832 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2833 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2834 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2835 2024-06-02T22:37:08.548 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2836 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2837 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2995 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2996 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:37:08.549 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3118 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3119 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3256 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3257 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3258 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3350 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3351 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3379 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3380 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3381 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:37:08.550 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3429 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3430 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3431 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3433 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3439 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3440 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3466 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3467 2024-06-02T22:37:08.551 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3468 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3501 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3502 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3503 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3534 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3542 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3574 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3575 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3576 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3596 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3597 2024-06-02T22:37:08.552 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3598 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3599 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:37:08.553 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3606 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3607 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3997 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4143 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4144 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4145 2024-06-02T22:37:08.554 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4146 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4147 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4148 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4149 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4150 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4151 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4152 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4153 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4154 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4155 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4156 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4157 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4158 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4159 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4160 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4161 2024-06-02T22:37:08.555 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4162 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4163 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4164 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4165 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4166 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4167 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4168 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4169 2024-06-02T22:37:08.556 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4170 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4171 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4172 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4173 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4174 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 5002 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 548 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 549 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6102 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6104 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6106 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6110 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6111 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6112 2024-06-02T22:37:08.557 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6113 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6117 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 826 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 827 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 828 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:36 pg_filenode.map 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:36 PG_VERSION 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:total 7777 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 . 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 .. 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 112 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 113 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:37:08.558 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:37 1259 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:37:08.559 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:37:08.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1417 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1418 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 174 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 175 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2187 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2224 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2328 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2336 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2337 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:37:08.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2604 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:37:08.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:37:08.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2611 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2613 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:37:08.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Jun 2 22:37 2619 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2619_fsm 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2620 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2650 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2651 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2652 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2653 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2654 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2655 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2656 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2657 2024-06-02T22:37:08.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2660 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2661 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2668 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2669 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2670 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:37:08.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2680 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2683 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2686 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2687 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2688 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2689 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:37:08.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2696 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2699 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2701 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2702 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2754 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2755 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2756 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2757 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2830 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2831 2024-06-02T22:37:08.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2832 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2833 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2834 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2835 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2836 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2837 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2995 2024-06-02T22:37:08.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2996 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3118 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3119 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3256 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3257 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3258 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3350 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3351 2024-06-02T22:37:08.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3379 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3380 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3381 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3429 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3430 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3431 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3433 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3439 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3440 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:37:08.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3466 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3467 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3468 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3501 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3502 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3503 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3534 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3542 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3574 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3575 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3576 2024-06-02T22:37:08.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3596 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3597 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3598 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3599 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:37:08.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3606 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3607 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3997 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4143 2024-06-02T22:37:08.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4144 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4145 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4146 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4147 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4148 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4149 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4150 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4151 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4152 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4153 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4154 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4155 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4156 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4157 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4158 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4159 2024-06-02T22:37:08.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4160 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4161 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4162 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4163 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4164 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4165 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4166 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4167 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4168 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4169 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4170 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4171 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4172 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4173 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4174 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 5002 2024-06-02T22:37:08.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 548 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 549 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6102 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6104 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6106 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6110 2024-06-02T22:37:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6111 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6112 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6113 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6117 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 826 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 827 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 828 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:37 pg_filenode.map 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 PG_VERSION 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:total 7777 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 . 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 .. 2024-06-02T22:37:08.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 112 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 113 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:37 1259 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:37:08.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:37:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1417 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1418 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 174 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 175 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2187 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2224 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2328 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2336 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2337 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:37:08.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2604 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:37:08.583 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2611 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:37:08.584 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2613 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Jun 2 22:37 2619 2024-06-02T22:37:08.585 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2619_fsm 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2620 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2650 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2651 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2652 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2653 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2654 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2655 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2656 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2657 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2660 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2661 2024-06-02T22:37:08.586 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2668 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2669 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2670 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2680 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:37:08.587 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2683 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2686 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2687 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2688 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2689 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2696 2024-06-02T22:37:08.588 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2699 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2701 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2702 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2754 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2755 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2756 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2757 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2830 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2831 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2832 2024-06-02T22:37:08.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2833 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2834 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2835 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2836 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2837 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:37:08.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2995 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2996 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3118 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3119 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3256 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3257 2024-06-02T22:37:08.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3258 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3350 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3351 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3379 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3380 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3381 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3429 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3430 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3431 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3433 2024-06-02T22:37:08.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3439 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3440 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3466 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3467 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3468 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3501 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3502 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3503 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3534 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:37:08.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3542 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3574 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3575 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3576 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3596 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3597 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3598 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3599 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:37:08.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3606 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3607 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:37:08.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3997 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4143 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4144 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4145 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4146 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4147 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4148 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4149 2024-06-02T22:37:08.596 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4150 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4151 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4152 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4153 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4154 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4155 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4156 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4157 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4158 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4159 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4160 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4161 2024-06-02T22:37:08.597 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4162 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4163 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4164 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4165 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4166 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4167 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4168 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4169 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4170 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4171 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4172 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4173 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4174 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 5002 2024-06-02T22:37:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 548 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 549 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6102 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6104 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6106 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6110 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6111 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6112 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6113 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6117 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 826 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 827 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 828 2024-06-02T22:37:08.599 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:37 pg_filenode.map 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 PG_VERSION 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:total 537 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Jun 2 22:37 . 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1213 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1213_fsm 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1213_vm 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1214 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1214_fsm 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1214_vm 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 1232 2024-06-02T22:37:08.600 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 1233 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1260 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1260_fsm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1260_vm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1261 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1261_fsm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1261_vm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1262 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1262_fsm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1262_vm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2396 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2396_fsm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2396_vm 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2397 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2671 2024-06-02T22:37:08.601 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2672 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2676 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2677 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2694 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2695 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2697 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2698 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2846 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2847 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2964 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2965 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2966 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2967 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3592 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3593 2024-06-02T22:37:08.602 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4060 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4061 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4175 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4176 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4177 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4178 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4181 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4182 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4183 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4184 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4185 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4186 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6000 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6001 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6002 2024-06-02T22:37:08.603 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6100 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6114 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6115 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 pg_control 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:36 pg_filenode.map 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 . 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.604 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:total 1 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 . 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 mappings 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 22:37 replorigin_checkpoint 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 snapshots 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.605 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 .. 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 .. 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 . 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.606 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 members 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 offsets 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 .. 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 0000 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 .. 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 0000 2024-06-02T22:37:08.607 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.610 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 0000 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.611 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:total 16384 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 . 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:37 000000010000000000000001 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 archive_status 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.612 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 .. 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 22:37 .. 2024-06-02T22:37:08.613 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 0000 2024-06-02T22:37:08.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-06-02T22:37:08.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-06-02T22:37:09.052 INFO:teuthology.orchestra.run.smithi031.stderr:dropping old tables... 2024-06-02T22:37:09.053 INFO:teuthology.orchestra.run.smithi031.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-06-02T22:37:09.053 INFO:teuthology.orchestra.run.smithi031.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-06-02T22:37:09.053 INFO:teuthology.orchestra.run.smithi031.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-06-02T22:37:09.053 INFO:teuthology.orchestra.run.smithi031.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-06-02T22:37:09.053 INFO:teuthology.orchestra.run.smithi031.stderr:creating tables... 2024-06-02T22:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:generating data (client-side)... 2024-06-02T22:37:09.271 INFO:teuthology.orchestra.run.smithi031.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.12 s, remaining 3.87 s) 2024-06-02T22:37:09.700 INFO:teuthology.orchestra.run.smithi031.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.55 s, remaining 8.29 s) 2024-06-02T22:37:09.865 INFO:teuthology.orchestra.run.smithi031.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.72 s, remaining 6.94 s) 2024-06-02T22:37:10.295 INFO:teuthology.orchestra.run.smithi031.stderr:400000 of 3200000 tuples (12%) done (elapsed 1.15 s, remaining 8.04 s) 2024-06-02T22:37:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:10 smithi031 ceph-mon[31767]: pgmap v516: 129 pgs: 129 active+clean; 25 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.1 MiB/s wr, 77 op/s 2024-06-02T22:37:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:10 smithi098 ceph-mon[36750]: pgmap v516: 129 pgs: 129 active+clean; 25 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.1 MiB/s wr, 77 op/s 2024-06-02T22:37:10.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:10 smithi178 ceph-mon[36614]: pgmap v516: 129 pgs: 129 active+clean; 25 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.1 MiB/s wr, 77 op/s 2024-06-02T22:37:10.635 INFO:teuthology.orchestra.run.smithi031.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.49 s, remaining 8.04 s) 2024-06-02T22:37:10.807 INFO:teuthology.orchestra.run.smithi031.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.66 s, remaining 7.19 s) 2024-06-02T22:37:11.201 INFO:teuthology.orchestra.run.smithi031.stderr:700000 of 3200000 tuples (21%) done (elapsed 2.05 s, remaining 7.34 s) 2024-06-02T22:37:11.573 INFO:teuthology.orchestra.run.smithi031.stderr:800000 of 3200000 tuples (25%) done (elapsed 2.43 s, remaining 7.28 s) 2024-06-02T22:37:11.758 INFO:teuthology.orchestra.run.smithi031.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.61 s, remaining 6.67 s) 2024-06-02T22:37:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:1000000 of 3200000 tuples (31%) done (elapsed 3.00 s, remaining 6.59 s) 2024-06-02T22:37:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:12 smithi031 ceph-mon[31767]: pgmap v517: 129 pgs: 129 active+clean; 33 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.9 MiB/s wr, 206 op/s 2024-06-02T22:37:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:12 smithi098 ceph-mon[36750]: pgmap v517: 129 pgs: 129 active+clean; 33 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.9 MiB/s wr, 206 op/s 2024-06-02T22:37:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:12 smithi178 ceph-mon[36614]: pgmap v517: 129 pgs: 129 active+clean; 33 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.9 MiB/s wr, 206 op/s 2024-06-02T22:37:12.614 INFO:teuthology.orchestra.run.smithi031.stderr:1100000 of 3200000 tuples (34%) done (elapsed 3.47 s, remaining 6.62 s) 2024-06-02T22:37:12.856 INFO:teuthology.orchestra.run.smithi031.stderr:1200000 of 3200000 tuples (37%) done (elapsed 3.71 s, remaining 6.18 s) 2024-06-02T22:37:13.298 INFO:teuthology.orchestra.run.smithi031.stderr:1300000 of 3200000 tuples (40%) done (elapsed 4.15 s, remaining 6.07 s) 2024-06-02T22:37:13.803 INFO:teuthology.orchestra.run.smithi031.stderr:1400000 of 3200000 tuples (43%) done (elapsed 4.66 s, remaining 5.99 s) 2024-06-02T22:37:14.014 INFO:teuthology.orchestra.run.smithi031.stderr:1500000 of 3200000 tuples (46%) done (elapsed 4.87 s, remaining 5.52 s) 2024-06-02T22:37:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:14 smithi031 ceph-mon[31767]: pgmap v518: 129 pgs: 129 active+clean; 64 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 8.4 MiB/s wr, 401 op/s 2024-06-02T22:37:14.420 INFO:teuthology.orchestra.run.smithi031.stderr:1600000 of 3200000 tuples (50%) done (elapsed 5.27 s, remaining 5.27 s) 2024-06-02T22:37:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:14 smithi098 ceph-mon[36750]: pgmap v518: 129 pgs: 129 active+clean; 64 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 8.4 MiB/s wr, 401 op/s 2024-06-02T22:37:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:14 smithi178 ceph-mon[36614]: pgmap v518: 129 pgs: 129 active+clean; 64 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 8.4 MiB/s wr, 401 op/s 2024-06-02T22:37:14.809 INFO:teuthology.orchestra.run.smithi031.stderr:1700000 of 3200000 tuples (53%) done (elapsed 5.66 s, remaining 5.00 s) 2024-06-02T22:37:14.919 INFO:teuthology.orchestra.run.smithi031.stderr:1800000 of 3200000 tuples (56%) done (elapsed 5.77 s, remaining 4.49 s) 2024-06-02T22:37:15.463 INFO:teuthology.orchestra.run.smithi031.stderr:1900000 of 3200000 tuples (59%) done (elapsed 6.32 s, remaining 4.32 s) 2024-06-02T22:37:15.857 INFO:teuthology.orchestra.run.smithi031.stderr:2000000 of 3200000 tuples (62%) done (elapsed 6.71 s, remaining 4.03 s) 2024-06-02T22:37:15.964 INFO:teuthology.orchestra.run.smithi031.stderr:2100000 of 3200000 tuples (65%) done (elapsed 6.82 s, remaining 3.57 s) 2024-06-02T22:37:16.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:16 smithi031 ceph-mon[31767]: pgmap v519: 129 pgs: 129 active+clean; 124 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 17 MiB/s wr, 392 op/s 2024-06-02T22:37:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:16 smithi098 ceph-mon[36750]: pgmap v519: 129 pgs: 129 active+clean; 124 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 17 MiB/s wr, 392 op/s 2024-06-02T22:37:16.465 INFO:teuthology.orchestra.run.smithi031.stderr:2200000 of 3200000 tuples (68%) done (elapsed 7.32 s, remaining 3.33 s) 2024-06-02T22:37:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:16 smithi178 ceph-mon[36614]: pgmap v519: 129 pgs: 129 active+clean; 124 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 17 MiB/s wr, 392 op/s 2024-06-02T22:37:16.584 INFO:teuthology.orchestra.run.smithi031.stderr:2300000 of 3200000 tuples (71%) done (elapsed 7.44 s, remaining 2.91 s) 2024-06-02T22:37:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2400000 of 3200000 tuples (75%) done (elapsed 7.85 s, remaining 2.62 s) 2024-06-02T22:37:17.449 INFO:teuthology.orchestra.run.smithi031.stderr:2500000 of 3200000 tuples (78%) done (elapsed 8.30 s, remaining 2.32 s) 2024-06-02T22:37:17.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:17 smithi098 ceph-mon[36750]: pgmap v520: 129 pgs: 129 active+clean; 196 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 29 MiB/s wr, 398 op/s 2024-06-02T22:37:17.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:17 smithi178 ceph-mon[36614]: pgmap v520: 129 pgs: 129 active+clean; 196 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 29 MiB/s wr, 398 op/s 2024-06-02T22:37:17.563 INFO:teuthology.orchestra.run.smithi031.stderr:2600000 of 3200000 tuples (81%) done (elapsed 8.42 s, remaining 1.94 s) 2024-06-02T22:37:17.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:17 smithi031 ceph-mon[31767]: pgmap v520: 129 pgs: 129 active+clean; 196 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 29 MiB/s wr, 398 op/s 2024-06-02T22:37:17.993 INFO:teuthology.orchestra.run.smithi031.stderr:2700000 of 3200000 tuples (84%) done (elapsed 8.85 s, remaining 1.64 s) 2024-06-02T22:37:18.198 INFO:teuthology.orchestra.run.smithi031.stderr:2800000 of 3200000 tuples (87%) done (elapsed 9.05 s, remaining 1.29 s) 2024-06-02T22:37:18.594 INFO:teuthology.orchestra.run.smithi031.stderr:2900000 of 3200000 tuples (90%) done (elapsed 9.45 s, remaining 0.98 s) 2024-06-02T22:37:18.973 INFO:teuthology.orchestra.run.smithi031.stderr:3000000 of 3200000 tuples (93%) done (elapsed 9.83 s, remaining 0.66 s) 2024-06-02T22:37:19.159 INFO:teuthology.orchestra.run.smithi031.stderr:3100000 of 3200000 tuples (96%) done (elapsed 10.01 s, remaining 0.32 s) 2024-06-02T22:37:19.525 INFO:teuthology.orchestra.run.smithi031.stderr:3200000 of 3200000 tuples (100%) done (elapsed 10.38 s, remaining 0.00 s) 2024-06-02T22:37:19.605 INFO:teuthology.orchestra.run.smithi031.stderr:vacuuming... 2024-06-02T22:37:19.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:19 smithi178 ceph-mon[36614]: pgmap v521: 129 pgs: 129 active+clean; 244 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 36 MiB/s wr, 397 op/s 2024-06-02T22:37:19.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:19 smithi031 ceph-mon[31767]: pgmap v521: 129 pgs: 129 active+clean; 244 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 36 MiB/s wr, 397 op/s 2024-06-02T22:37:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:19 smithi098 ceph-mon[36750]: pgmap v521: 129 pgs: 129 active+clean; 244 MiB data, 503 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 36 MiB/s wr, 397 op/s 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 -- 172.21.15.31:0/3273366214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b7010de10 msgr2=0x7f3b70110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 --2- 172.21.15.31:0/3273366214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b7010de10 0x7f3b70110200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009cd0 tx=0x7f3b6802a8e0 comp rx=0 tx=0).stop 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 -- 172.21.15.31:0/3273366214 shutdown_connections 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 --2- 172.21.15.31:0/3273366214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b7010de10 0x7f3b70110200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 --2- 172.21.15.31:0/3273366214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b70074400 0x7f3b70074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 --2- 172.21.15.31:0/3273366214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b700759e0 0x7f3b70073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 -- 172.21.15.31:0/3273366214 >> 172.21.15.31:0/3273366214 conn(0x7f3b700fcdb0 msgr2=0x7f3b700ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 -- 172.21.15.31:0/3273366214 shutdown_connections 2024-06-02T22:37:20.998 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.997+0000 7f3b76c00640 1 -- 172.21.15.31:0/3273366214 wait complete. 2024-06-02T22:37:20.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.999+0000 7f3b76c00640 1 Processor -- start 2024-06-02T22:37:20.999 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.999+0000 7f3b76c00640 1 -- start start 2024-06-02T22:37:21.000 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.999+0000 7f3b76c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:20.999+0000 7f3b76c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b700759e0 0x7f3b7019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 0x7f3b701a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70113a90 con 0x7f3b700759e0 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70113910 con 0x7f3b70074400 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70113c10 con 0x7f3b7010de10 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58976/0 (socket says 172.21.15.31:58976) 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 -- 172.21.15.31:0/1127407708 learned_addr learned my addr 172.21.15.31:0/1127407708 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b74e00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b700759e0 0x7f3b7019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76200640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 0x7f3b701a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 -- 172.21.15.31:0/1127407708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 msgr2=0x7f3b701a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 0x7f3b701a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 -- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b700759e0 msgr2=0x7f3b7019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b700759e0 0x7f3b7019e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 -- 172.21.15.31:0/1127407708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b701a5d20 con 0x7f3b70074400 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b76200640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 0x7f3b701a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:37:21.002 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.000+0000 7f3b75800640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ea60 tx=0x7f3b6400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.001+0000 7f3b6e000640 1 -- 172.21.15.31:0/1127407708 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400cde0 con 0x7f3b70074400 2024-06-02T22:37:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.001+0000 7f3b6e000640 1 -- 172.21.15.31:0/1127407708 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b640035f0 con 0x7f3b70074400 2024-06-02T22:37:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.001+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b701a5fb0 con 0x7f3b70074400 2024-06-02T22:37:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.001+0000 7f3b6e000640 1 -- 172.21.15.31:0/1127407708 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64010670 con 0x7f3b70074400 2024-06-02T22:37:21.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.001+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b701a6470 con 0x7f3b70074400 2024-06-02T22:37:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.004+0000 7f3b7b1ac740 1 Processor -- start 2024-06-02T22:37:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.004+0000 7f3b7b1ac740 1 -- start start 2024-06-02T22:37:21.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.004+0000 7f3b6e000640 1 -- 172.21.15.31:0/1127407708 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 137884+0+0 (secure 0 0 0) 0x7f3b640037a0 con 0x7f3b70074400 2024-06-02T22:37:21.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3693f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c36944280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c36946d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c368a2420 con 0x561c369448f0 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561c36849c50 con 0x561c3693ed90 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561c3689e3e0 con 0x561c3693f780 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c36946d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b75800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c36944280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c36946d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39558/0 (socket says 172.21.15.31:39558) 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b76200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3693f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b74e00640 1 -- 172.21.15.31:0/1179684917 learned_addr learned my addr 172.21.15.31:0/1179684917 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.005+0000 7f3b76200640 1 -- 172.21.15.31:0/1179684917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 msgr2=0x561c36944280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b76200640 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c36944280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b76200640 1 -- 172.21.15.31:0/1179684917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 msgr2=0x561c36946d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b76200640 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c36946d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b76200640 1 -- 172.21.15.31:0/1179684917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c365b6210 con 0x561c3693ed90 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b76200640 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3693f1b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b68005cc0 tx=0x7f3b68009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78caea68c0c7918 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b6e000640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 0x7f3b580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b62a00640 1 -- 172.21.15.31:0/1179684917 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680319c0 con 0x561c3693ed90 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b62a00640 1 -- 172.21.15.31:0/1179684917 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b68036040 con 0x561c3693ed90 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.006+0000 7f3b62a00640 1 -- 172.21.15.31:0/1179684917 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68004720 con 0x561c3693ed90 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b75800640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 0x7f3b580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/1179684917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 msgr2=0x561c3693f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3693f1b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b68005cc0 tx=0x7f3b68009a20 comp rx=0 tx=0).stop 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b6e000640 1 -- 172.21.15.31:0/1127407708 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3b640cfa00 con 0x7f3b70074400 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b75800640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 0x7f3b580a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x561c3693fb80 tx=0x7f3b640d5510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/1179684917 shutdown_connections 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c36946d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c36944280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/1179684917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3693f1b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/1179684917 >> 172.21.15.31:0/1179684917 conn(0x561c36906f80 msgr2=0x561c3693a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:21.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/1179684917 shutdown_connections 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.007+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/1179684917 wait complete. 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 -- start start 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 Processor -- start 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c369495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c36950610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.008+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561c36947840 con 0x561c3693ed90 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561c3685d0b0 con 0x561c369448f0 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561c369479c0 con 0x561c3693f780 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b7b1ac740 10 client.0 _ll_register_callbacks cb 0x561c36848f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39572/0 (socket says 172.21.15.31:39572) 2024-06-02T22:37:21.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 -- 172.21.15.31:0/4242433065 learned_addr learned my addr 172.21.15.31:0/4242433065 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b74e00640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c369495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c36950610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 -- 172.21.15.31:0/4242433065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 msgr2=0x561c369495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c369495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 -- 172.21.15.31:0/4242433065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 msgr2=0x561c36950610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c36950610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b76200640 1 -- 172.21.15.31:0/4242433065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c36682620 con 0x561c3693ed90 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.009+0000 7f3b74e00640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c369495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.010+0000 7f3b76200640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009620 tx=0x7f3b68009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d540b74dc503db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.010+0000 7f3b57400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.010+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68003970 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.010+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3b68003b10 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.010+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b68036040 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b68003d10 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 10 client.15138 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561c36953980 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b68036040 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3b68030070 con 0x561c3693ed90 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 10 client.15138 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 10 client.15138 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 20 client.15138 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:21.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c36954cd0 0x561c369570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 4 client.15138 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.011+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c368afb50 con 0x561c36954cd0 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.012+0000 7f3b74e00640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c36954cd0 0x561c369570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.012+0000 7f3b74e00640 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c36954cd0 0x561c369570c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964ed3a7c91a8c49 server_cookie=3970b334464868e5 in_seq=0 out_seq=0 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.012+0000 7f3b57400640 10 client.15138 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.013+0000 7f3b57400640 1 -- 172.21.15.31:0/4242433065 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561c368afb50 con 0x561c36954cd0 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.013+0000 7f3b57400640 10 client.15138 handle_command_reply: tid=0 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.013+0000 7f3b7b1ac740 1 client.15138 shutdown 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.013+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 msgr2=0x561c36949090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.013+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009620 tx=0x7f3b68009800 comp rx=0 tx=0).stop 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 shutdown_connections 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c36954cd0 0x561c369570c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c36950610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c369495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/4242433065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c36949090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b57400640 0 client.15138 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 >> 172.21.15.31:0/4242433065 conn(0x561c36906f80 msgr2=0x561c36939970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 shutdown_connections 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/4242433065 wait complete. 2024-06-02T22:37:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.014+0000 7f3b7b1ac740 20 client.15138 trim_cache size 0 max 16384 2024-06-02T22:37:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 Processor -- start 2024-06-02T22:37:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 -- start start 2024-06-02T22:37:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3693a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c369505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b0af0 con 0x561c3693ed90 2024-06-02T22:37:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b2630 con 0x561c369448f0 2024-06-02T22:37:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b11c0 con 0x561c3693f780 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39584/0 (socket says 172.21.15.31:39584) 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.031+0000 7f3b76200640 1 -- 172.21.15.31:0/3657962179 learned_addr learned my addr 172.21.15.31:0/3657962179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b74e00640 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3693a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c369505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 -- 172.21.15.31:0/3657962179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 msgr2=0x561c3693a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3693a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 -- 172.21.15.31:0/3657962179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 msgr2=0x561c369505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c369505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 -- 172.21.15.31:0/3657962179 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3693e320 con 0x561c3693ed90 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b76200640 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b6802ae00 tx=0x7f3b680021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1204eab5b9874ebf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.032+0000 7f3b62000640 1 -- 172.21.15.31:0/3657962179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68031430 con 0x561c3693ed90 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b62000640 1 -- 172.21.15.31:0/3657962179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b68036040 con 0x561c3693ed90 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b62000640 1 -- 172.21.15.31:0/3657962179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68053e60 con 0x561c3693ed90 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/3657962179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 msgr2=0x561c3693a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b6802ae00 tx=0x7f3b680021f0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/3657962179 shutdown_connections 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c369448f0 0x561c369505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3693a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/3657962179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c3693ed90 0x561c3693a0f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/3657962179 >> 172.21.15.31:0/3657962179 conn(0x561c36906f80 msgr2=0x561c3693d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.033+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/3657962179 shutdown_connections 2024-06-02T22:37:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.034+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/3657962179 wait complete. 2024-06-02T22:37:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.034+0000 7f3b7b1ac740 1 -- start start 2024-06-02T22:37:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.034+0000 7f3b7b1ac740 1 Processor -- start 2024-06-02T22:37:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.034+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3694d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c369bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b1f60 con 0x561c369448f0 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701b1890 con 0x561c3693ed90 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701aead0 con 0x561c3693f780 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b7b1ac740 10 client.0 _ll_register_callbacks cb 0x7f3b6803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b76200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3694d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c369bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37168/0 (socket says 172.21.15.31:37168) 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 -- 172.21.15.31:0/659081793 learned_addr learned my addr 172.21.15.31:0/659081793 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 -- 172.21.15.31:0/659081793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 msgr2=0x561c3694d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3694d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 -- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 msgr2=0x561c369bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c369bd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.035+0000 7f3b74e00640 1 -- 172.21.15.31:0/659081793 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c369bdce0 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b74e00640 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c004620 tx=0x7f3b5c012b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e62e9be2634cfdc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b57400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c01fcc0 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b68036040 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3b5c01d410 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b5c034050 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b7b1ac740 10 client.25243 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.036+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561c369bef70 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b68036040 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3b5c026590 con 0x561c3693f780 2024-06-02T22:37:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 10 client.25243 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 20 client.25243 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c369bf950 0x561c369c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 4 client.25243 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c368a9ea0 con 0x561c369bf950 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.037+0000 7f3b76200640 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c369bf950 0x561c369c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.038+0000 7f3b76200640 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c369bf950 0x561c369c1d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdefd1ed9fc248d1 server_cookie=3f954d7147ca3bd4 in_seq=0 out_seq=0 2024-06-02T22:37:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.038+0000 7f3b57400640 10 client.25243 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b57400640 1 -- 172.21.15.31:0/659081793 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561c368a9ea0 con 0x561c369bf950 2024-06-02T22:37:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b57400640 10 client.25243 handle_command_reply: tid=0 2024-06-02T22:37:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 client.25243 shutdown 2024-06-02T22:37:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 msgr2=0x561c3694d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c004620 tx=0x7f3b5c012b40 comp rx=0 tx=0).stop 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 shutdown_connections 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561c369bf950 0x561c369c1d70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561c369448f0 0x561c369bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c3693f780 0x561c3694d9c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 --2- 172.21.15.31:0/659081793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561c3693ed90 0x561c3694d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b57400640 0 client.25243 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.126+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 >> 172.21.15.31:0/659081793 conn(0x561c36906f80 msgr2=0x561c36948ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.127+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 shutdown_connections 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.127+0000 7f3b7b1ac740 1 -- 172.21.15.31:0/659081793 wait complete. 2024-06-02T22:37:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.127+0000 7f3b7b1ac740 20 client.25243 trim_cache size 0 max 16384 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 msgr2=0x7f3b580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 0x7f3b580a50d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x561c3693fb80 tx=0x7f3b640d5510 comp rx=0 tx=0).stop 2024-06-02T22:37:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 msgr2=0x7f3b7019e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ea60 tx=0x7f3b6400ef20 comp rx=0 tx=0).stop 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 shutdown_connections 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3b580a2c10 0x7f3b580a50d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7010de10 0x7f3b701a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b700759e0 0x7f3b7019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 --2- 172.21.15.31:0/1127407708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b70074400 0x7f3b7019e100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 >> 172.21.15.31:0/1127407708 conn(0x7f3b700fcdb0 msgr2=0x7f3b701011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 shutdown_connections 2024-06-02T22:37:21.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:21.128+0000 7f3b76c00640 1 -- 172.21.15.31:0/1127407708 wait complete. 2024-06-02T22:37:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:21 smithi178 ceph-mon[36614]: pgmap v522: 129 pgs: 129 active+clean; 312 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 47 MiB/s wr, 366 op/s 2024-06-02T22:37:21.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:21 smithi031 ceph-mon[31767]: pgmap v522: 129 pgs: 129 active+clean; 312 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 47 MiB/s wr, 366 op/s 2024-06-02T22:37:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:21 smithi098 ceph-mon[36750]: pgmap v522: 129 pgs: 129 active+clean; 312 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 47 MiB/s wr, 366 op/s 2024-06-02T22:37:22.148 INFO:teuthology.orchestra.run.smithi031.stderr:creating primary keys... 2024-06-02T22:37:23.764 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:23 smithi098 ceph-mon[36750]: pgmap v523: 129 pgs: 129 active+clean; 348 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 53 MiB/s wr, 245 op/s 2024-06-02T22:37:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:23 smithi178 ceph-mon[36614]: pgmap v523: 129 pgs: 129 active+clean; 348 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 53 MiB/s wr, 245 op/s 2024-06-02T22:37:23.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:23 smithi031 ceph-mon[31767]: pgmap v523: 129 pgs: 129 active+clean; 348 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 53 MiB/s wr, 245 op/s 2024-06-02T22:37:25.040 INFO:teuthology.orchestra.run.smithi031.stderr:done in 15.99 s (drop tables 0.00 s, create tables 0.03 s, client-side generate 10.52 s, vacuum 2.54 s, primary keys 2.89 s). 2024-06-02T22:37:25.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-06-02T22:37:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:starting vacuum...end. 2024-06-02T22:37:25.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:25 smithi178 ceph-mon[36614]: pgmap v524: 129 pgs: 129 active+clean; 372 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 MiB/s wr, 56 op/s 2024-06-02T22:37:25.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:25 smithi031 ceph-mon[31767]: pgmap v524: 129 pgs: 129 active+clean; 372 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 MiB/s wr, 56 op/s 2024-06-02T22:37:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:25 smithi098 ceph-mon[36750]: pgmap v524: 129 pgs: 129 active+clean; 372 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 51 MiB/s wr, 56 op/s 2024-06-02T22:37:27.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:27 smithi031 ceph-mon[31767]: pgmap v525: 129 pgs: 129 active+clean; 449 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 51 MiB/s wr, 80 op/s 2024-06-02T22:37:27.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:27 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:37:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:27 smithi178 ceph-mon[36614]: pgmap v525: 129 pgs: 129 active+clean; 449 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 51 MiB/s wr, 80 op/s 2024-06-02T22:37:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:27 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:37:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:27 smithi098 ceph-mon[36750]: pgmap v525: 129 pgs: 129 active+clean; 449 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 51 MiB/s wr, 80 op/s 2024-06-02T22:37:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:27 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:37:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:29 smithi178 ceph-mon[36614]: pgmap v526: 129 pgs: 129 active+clean; 485 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 68 op/s 2024-06-02T22:37:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:37:29.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:37:29.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:37:29.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:29 smithi031 ceph-mon[31767]: pgmap v526: 129 pgs: 129 active+clean; 485 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 68 op/s 2024-06-02T22:37:29.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:37:29.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:37:29.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:37:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:29 smithi098 ceph-mon[36750]: pgmap v526: 129 pgs: 129 active+clean; 485 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 MiB/s wr, 68 op/s 2024-06-02T22:37:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:37:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:37:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:37:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 5.0 s, 2208.4 tps, lat 42.923 ms stddev 47.381 2024-06-02T22:37:31.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:31 smithi178 ceph-mon[36614]: pgmap v527: 129 pgs: 129 active+clean; 526 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 38 MiB/s wr, 71 op/s 2024-06-02T22:37:31.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:31 smithi031 ceph-mon[31767]: pgmap v527: 129 pgs: 129 active+clean; 526 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 38 MiB/s wr, 71 op/s 2024-06-02T22:37:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:31 smithi098 ceph-mon[36750]: pgmap v527: 129 pgs: 129 active+clean; 526 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 38 MiB/s wr, 71 op/s 2024-06-02T22:37:33.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:33 smithi178 ceph-mon[36614]: pgmap v528: 129 pgs: 129 active+clean; 661 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 131 op/s 2024-06-02T22:37:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:33 smithi031 ceph-mon[31767]: pgmap v528: 129 pgs: 129 active+clean; 661 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 131 op/s 2024-06-02T22:37:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:33 smithi098 ceph-mon[36750]: pgmap v528: 129 pgs: 129 active+clean; 661 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 131 op/s 2024-06-02T22:37:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 -- 172.21.15.31:0/3217771310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c100e20 msgr2=0x7f0c4c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 --2- 172.21.15.31:0/3217771310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c100e20 0x7f0c4c1012a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0c340074e0 tx=0x7f0c3402b060 comp rx=0 tx=0).stop 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 -- 172.21.15.31:0/3217771310 shutdown_connections 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 --2- 172.21.15.31:0/3217771310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c1017e0 0x7f0c4c108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 --2- 172.21.15.31:0/3217771310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c100e20 0x7f0c4c1012a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 --2- 172.21.15.31:0/3217771310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0ffc30 0x7f0c4c100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.325+0000 7f0c52200640 1 -- 172.21.15.31:0/3217771310 >> 172.21.15.31:0/3217771310 conn(0x7f0c4c0fb1c0 msgr2=0x7f0c4c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.326+0000 7f0c52200640 1 -- 172.21.15.31:0/3217771310 shutdown_connections 2024-06-02T22:37:34.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.326+0000 7f0c52200640 1 -- 172.21.15.31:0/3217771310 wait complete. 2024-06-02T22:37:34.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 Processor -- start 2024-06-02T22:37:34.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 -- start start 2024-06-02T22:37:34.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c0ffc30 0x7f0c4c199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c1017e0 0x7f0c4c1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10d680 con 0x7f0c4c0ffc30 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10d500 con 0x7f0c4c1017e0 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.327+0000 7f0c52200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c10d800 con 0x7f0c4c100e20 2024-06-02T22:37:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56150/0 (socket says 172.21.15.31:56150) 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 -- 172.21.15.31:0/3001412421 learned_addr learned my addr 172.21.15.31:0/3001412421 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c4b400640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c0ffc30 0x7f0c4c199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c4be00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c1017e0 0x7f0c4c1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 -- 172.21.15.31:0/3001412421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c1017e0 msgr2=0x7f0c4c1a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c1017e0 0x7f0c4c1a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 -- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c0ffc30 msgr2=0x7f0c4c199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c0ffc30 0x7f0c4c199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.328+0000 7f0c43e00640 1 -- 172.21.15.31:0/3001412421 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c06b4f0 con 0x7f0c4c100e20 2024-06-02T22:37:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.329+0000 7f0c43e00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c34004980 tx=0x7f0c34009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.330+0000 7f0c48c00640 1 -- 172.21.15.31:0/3001412421 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3402bd30 con 0x7f0c4c100e20 2024-06-02T22:37:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.330+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c06b780 con 0x7f0c4c100e20 2024-06-02T22:37:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.330+0000 7f0c48c00640 1 -- 172.21.15.31:0/3001412421 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c34004b50 con 0x7f0c4c100e20 2024-06-02T22:37:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.330+0000 7f0c48c00640 1 -- 172.21.15.31:0/3001412421 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3402bd30 con 0x7f0c4c100e20 2024-06-02T22:37:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.330+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c06bcc0 con 0x7f0c4c100e20 2024-06-02T22:37:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.339+0000 7f0c54f6e740 1 Processor -- start 2024-06-02T22:37:34.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.339+0000 7f0c54f6e740 1 -- start start 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.342+0000 7f0c48c00640 1 -- 172.21.15.31:0/3001412421 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 19) ==== 137884+0+0 (secure 0 0 0) 0x7f0c34043020 con 0x7f0c4c100e20 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e346755ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e3467565c0 0x55e34675b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34675dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e3466b9420 con 0x55e3467565c0 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e346660c50 con 0x55e34675b730 2024-06-02T22:37:34.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e3466b53e0 con 0x55e346755bd0 2024-06-02T22:37:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34675dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e346755ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e346755ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56158/0 (socket says 172.21.15.31:56158) 2024-06-02T22:37:34.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.343+0000 7f0c4be00640 1 -- 172.21.15.31:0/1485155939 learned_addr learned my addr 172.21.15.31:0/1485155939 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.344+0000 7f0c43e00640 1 -- 172.21.15.31:0/1485155939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 msgr2=0x55e346755ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.344+0000 7f0c43e00640 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e346755ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.344+0000 7f0c43e00640 1 -- 172.21.15.31:0/1485155939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e3467565c0 msgr2=0x55e34675b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.344+0000 7f0c43e00640 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e3467565c0 0x55e34675b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.345+0000 7f0c43e00640 1 -- 172.21.15.31:0/1485155939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3463cd210 con 0x55e34675b730 2024-06-02T22:37:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.345+0000 7f0c43e00640 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34675dbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ebab0 tx=0x7f0c340f6320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19442ec4b1a4af84 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.346+0000 7f0c3be00640 1 -- 172.21.15.31:0/1485155939 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340f00d0 con 0x55e34675b730 2024-06-02T22:37:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.346+0000 7f0c3be00640 1 -- 172.21.15.31:0/1485155939 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c340fb030 con 0x55e34675b730 2024-06-02T22:37:34.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.346+0000 7f0c3be00640 1 -- 172.21.15.31:0/1485155939 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c340ff630 con 0x55e34675b730 2024-06-02T22:37:34.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.347+0000 7f0c48c00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 0x7f0c300a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.348+0000 7f0c48c00640 1 -- 172.21.15.31:0/3001412421 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c34038040 con 0x7f0c4c100e20 2024-06-02T22:37:34.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.348+0000 7f0c4be00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 0x7f0c300a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.349+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1485155939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 msgr2=0x55e34675dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.349+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34675dbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ebab0 tx=0x7f0c340f6320 comp rx=0 tx=0).stop 2024-06-02T22:37:34.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1485155939 shutdown_connections 2024-06-02T22:37:34.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34675dbc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e3467565c0 0x55e34675b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1485155939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e346755ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1485155939 >> 172.21.15.31:0/1485155939 conn(0x55e34671df80 msgr2=0x55e346751650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c4be00640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 0x7f0c300a5400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e346756e20 tx=0x7f0c44007740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.350+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1485155939 shutdown_connections 2024-06-02T22:37:34.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.351+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1485155939 wait complete. 2024-06-02T22:37:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.352+0000 7f0c54f6e740 1 -- start start 2024-06-02T22:37:34.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.352+0000 7f0c54f6e740 1 Processor -- start 2024-06-02T22:37:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 0x55e3467684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e3467689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e34676fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e34675e4a0 con 0x55e34675b730 2024-06-02T22:37:34.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e3466740b0 con 0x55e346755bd0 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e34675e620 con 0x55e3467565c0 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c54f6e740 10 client.0 _ll_register_callbacks cb 0x55e34665ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.355+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e3467689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 0x55e3467684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e3467689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56164/0 (socket says 172.21.15.31:56164) 2024-06-02T22:37:34.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c43e00640 1 -- 172.21.15.31:0/1095850481 learned_addr learned my addr 172.21.15.31:0/1095850481 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 -- 172.21.15.31:0/1095850481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 msgr2=0x55e3467689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e3467689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 -- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 msgr2=0x55e34676fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e34676fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.356+0000 7f0c4b400640 1 -- 172.21.15.31:0/1095850481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e346499620 con 0x55e346755bd0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c4b400640 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 0x55e3467684a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55e346752500 tx=0x7f0c3c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e925ff09d681d9e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c38c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c01c680 con 0x55e346755bd0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c3c01c820 con 0x55e346755bd0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c340fb030 con 0x55e346755bd0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c3c01ca20 con 0x55e346755bd0 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c54f6e740 10 client.25247 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:34.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.357+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e346772e00 con 0x55e346755bd0 2024-06-02T22:37:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.358+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c3c021020 con 0x55e346755bd0 2024-06-02T22:37:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.358+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c3c01b3e0 con 0x55e346755bd0 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.358+0000 7f0c54f6e740 10 client.25247 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.358+0000 7f0c54f6e740 10 client.25247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.358+0000 7f0c54f6e740 20 client.25247 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.359+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e346774540 0x55e346776930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.359+0000 7f0c54f6e740 4 client.25247 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.359+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3466c6b50 con 0x55e346774540 2024-06-02T22:37:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.359+0000 7f0c43e00640 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e346774540 0x55e346776930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.361+0000 7f0c43e00640 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e346774540 0x55e346776930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541fde8ca01a5c0 server_cookie=b27c4b70b28b244a in_seq=0 out_seq=0 2024-06-02T22:37:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.361+0000 7f0c38c00640 10 client.25247 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.363+0000 7f0c38c00640 1 -- 172.21.15.31:0/1095850481 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e3466c6b50 con 0x55e346774540 2024-06-02T22:37:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.363+0000 7f0c38c00640 10 client.25247 handle_command_reply: tid=0 2024-06-02T22:37:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.364+0000 7f0c54f6e740 1 client.25247 shutdown 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.365+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 msgr2=0x55e3467684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.365+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 0x55e3467684a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55e346752500 tx=0x7f0c3c0107a0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 shutdown_connections 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e346774540 0x55e346776930 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e34676fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c38c00640 0 client.25247 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e3467689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/1095850481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e346755bd0 0x55e3467684a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.366+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 >> 172.21.15.31:0/1095850481 conn(0x55e34671df80 msgr2=0x55e346750810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.367+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 shutdown_connections 2024-06-02T22:37:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.367+0000 7f0c54f6e740 1 -- 172.21.15.31:0/1095850481 wait complete. 2024-06-02T22:37:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.367+0000 7f0c54f6e740 20 client.25247 trim_cache size 0 max 16384 2024-06-02T22:37:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.414+0000 7f0c54f6e740 1 Processor -- start 2024-06-02T22:37:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.415+0000 7f0c54f6e740 1 -- start start 2024-06-02T22:37:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.415+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.415+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3467565c0 0x55e34676f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.415+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e346767ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c071e50 con 0x55e34675b730 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c073990 con 0x55e3467565c0 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c072520 con 0x55e346755bd0 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.415+0000 7f0c4b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56170/0 (socket says 172.21.15.31:56170) 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 -- 172.21.15.31:0/3139467758 learned_addr learned my addr 172.21.15.31:0/3139467758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c43e00640 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3467565c0 0x55e34676f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 -- 172.21.15.31:0/3139467758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3467565c0 msgr2=0x55e34676f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3467565c0 0x55e34676f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 -- 172.21.15.31:0/3139467758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 msgr2=0x55e346767ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e346767ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 -- 172.21.15.31:0/3139467758 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e346752300 con 0x55e346755bd0 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.416+0000 7f0c4b400640 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c01b820 tx=0x7f0c3c01be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e4fb01eaa6538e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.417+0000 7f0c3b400640 1 -- 172.21.15.31:0/3139467758 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00b8f0 con 0x55e346755bd0 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.417+0000 7f0c3b400640 1 -- 172.21.15.31:0/3139467758 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c3c021030 con 0x55e346755bd0 2024-06-02T22:37:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.417+0000 7f0c3b400640 1 -- 172.21.15.31:0/3139467758 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c029450 con 0x55e346755bd0 2024-06-02T22:37:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.418+0000 7f0c54f6e740 1 -- 172.21.15.31:0/3139467758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 msgr2=0x55e34675af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.418+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c01b820 tx=0x7f0c3c01be60 comp rx=0 tx=0).stop 2024-06-02T22:37:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 -- 172.21.15.31:0/3139467758 shutdown_connections 2024-06-02T22:37:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e34675b730 0x55e346767ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3467565c0 0x55e34676f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/3139467758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e346755bd0 0x55e34675af70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 -- 172.21.15.31:0/3139467758 >> 172.21.15.31:0/3139467758 conn(0x55e34671df80 msgr2=0x55e3467510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 -- 172.21.15.31:0/3139467758 shutdown_connections 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.419+0000 7f0c54f6e740 1 -- 172.21.15.31:0/3139467758 wait complete. 2024-06-02T22:37:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.420+0000 7f0c54f6e740 1 -- start start 2024-06-02T22:37:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 Processor -- start 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e34676d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34676e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0732c0 con 0x55e346755bd0 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.421+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c072bf0 con 0x55e34675b730 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c54f6e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c06fe30 con 0x55e3467565c0 2024-06-02T22:37:34.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c54f6e740 10 client.0 _ll_register_callbacks cb 0x7f0c3c00b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34676e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c4b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c4b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58510/0 (socket says 172.21.15.31:58510) 2024-06-02T22:37:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.422+0000 7f0c4b400640 1 -- 172.21.15.31:0/533553884 learned_addr learned my addr 172.21.15.31:0/533553884 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:34.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c43e00640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e34676d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4be00640 1 -- 172.21.15.31:0/533553884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 msgr2=0x55e34676d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4be00640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e34676d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4be00640 1 -- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 msgr2=0x55e34676cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4be00640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4be00640 1 -- 172.21.15.31:0/533553884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34676e860 con 0x55e34675b730 2024-06-02T22:37:34.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.423+0000 7f0c4b400640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:37:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.424+0000 7f0c4be00640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34676e270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011ca0 tx=0x7f0c4401c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ff4ecd6f2304b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.424+0000 7f0c38c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:37:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.425+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44003b80 con 0x55e34675b730 2024-06-02T22:37:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.425+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c44003d20 con 0x55e34675b730 2024-06-02T22:37:34.425 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.425+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c3c021030 con 0x55e34675b730 2024-06-02T22:37:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.425+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c44004050 con 0x55e34675b730 2024-06-02T22:37:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.426+0000 7f0c54f6e740 10 client.25253 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.426+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e34676fbe0 con 0x55e34675b730 2024-06-02T22:37:34.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.426+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c3c021030 con 0x55e34675b730 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.426+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c44023070 con 0x55e34675b730 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 10 client.25253 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 10 client.25253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 20 client.25253 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e34675f070 0x55e346761490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 4 client.25253 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:37:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3466c0ea0 con 0x55e34675f070 2024-06-02T22:37:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.427+0000 7f0c4b400640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e34675f070 0x55e346761490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.428+0000 7f0c4b400640 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e34675f070 0x55e346761490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abea5dc29fbc5f41 server_cookie=b533130d0385efd0 in_seq=0 out_seq=0 2024-06-02T22:37:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.429+0000 7f0c38c00640 10 client.25253 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.491+0000 7f0c38c00640 1 -- 172.21.15.31:0/533553884 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e3466c0ea0 con 0x55e34675f070 2024-06-02T22:37:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c38c00640 10 client.25253 handle_command_reply: tid=0 2024-06-02T22:37:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c54f6e740 1 client.25253 shutdown 2024-06-02T22:37:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 msgr2=0x55e34676e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34676e270 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0c44011ca0 tx=0x7f0c4401c7d0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 shutdown_connections 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.492+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e34675f070 0x55e346761490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e34675b730 0x55e34676e270 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3467565c0 0x55e34676d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c54f6e740 1 --2- 172.21.15.31:0/533553884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e346755bd0 0x55e34676cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c38c00640 0 client.25253 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 >> 172.21.15.31:0/533553884 conn(0x55e34671df80 msgr2=0x55e346754590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.493+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 shutdown_connections 2024-06-02T22:37:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.494+0000 7f0c54f6e740 1 -- 172.21.15.31:0/533553884 wait complete. 2024-06-02T22:37:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.494+0000 7f0c54f6e740 20 client.25253 trim_cache size 0 max 16384 2024-06-02T22:37:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:37:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:37:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:37:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.495+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 msgr2=0x7f0c300a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.495+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 0x7f0c300a5400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e346756e20 tx=0x7f0c44007740 comp rx=0 tx=0).stop 2024-06-02T22:37:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.495+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 msgr2=0x7f0c4c19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.495+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c34004980 tx=0x7f0c34009fb0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 shutdown_connections 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c300a2f40 0x7f0c300a5400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c4c1017e0 0x7f0c4c1a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c100e20 0x7f0c4c19a340 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c34004980 tx=0x7f0c34009fb0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 --2- 172.21.15.31:0/3001412421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c4c0ffc30 0x7f0c4c199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 >> 172.21.15.31:0/3001412421 conn(0x7f0c4c0fb1c0 msgr2=0x7f0c4c109980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.496+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 shutdown_connections 2024-06-02T22:37:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:34.497+0000 7f0c52200640 1 -- 172.21.15.31:0/3001412421 wait complete. 2024-06-02T22:37:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 10.0 s, 1945.0 tps, lat 51.982 ms stddev 76.770 2024-06-02T22:37:35.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:35 smithi178 ceph-mon[36614]: pgmap v529: 129 pgs: 129 active+clean; 781 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 212 op/s 2024-06-02T22:37:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:35 smithi031 ceph-mon[31767]: pgmap v529: 129 pgs: 129 active+clean; 781 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 212 op/s 2024-06-02T22:37:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:35 smithi098 ceph-mon[36750]: pgmap v529: 129 pgs: 129 active+clean; 781 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 23 MiB/s wr, 212 op/s 2024-06-02T22:37:37.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:37 smithi178 ceph-mon[36614]: pgmap v530: 129 pgs: 129 active+clean; 888 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 313 op/s 2024-06-02T22:37:37.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:37 smithi031 ceph-mon[31767]: pgmap v530: 129 pgs: 129 active+clean; 888 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 313 op/s 2024-06-02T22:37:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:37 smithi098 ceph-mon[36750]: pgmap v530: 129 pgs: 129 active+clean; 888 MiB data, 815 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 19 MiB/s wr, 313 op/s 2024-06-02T22:37:39.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:39 smithi178 ceph-mon[36614]: pgmap v531: 129 pgs: 129 active+clean; 895 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 401 op/s 2024-06-02T22:37:39.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:39 smithi031 ceph-mon[31767]: pgmap v531: 129 pgs: 129 active+clean; 895 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 401 op/s 2024-06-02T22:37:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:39 smithi098 ceph-mon[36750]: pgmap v531: 129 pgs: 129 active+clean; 895 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 401 op/s 2024-06-02T22:37:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 15.0 s, 2052.0 tps, lat 48.239 ms stddev 57.179 2024-06-02T22:37:41.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:41 smithi178 ceph-mon[36614]: pgmap v532: 129 pgs: 129 active+clean; 909 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 488 op/s 2024-06-02T22:37:41.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:41 smithi031 ceph-mon[31767]: pgmap v532: 129 pgs: 129 active+clean; 909 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 488 op/s 2024-06-02T22:37:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:41 smithi098 ceph-mon[36750]: pgmap v532: 129 pgs: 129 active+clean; 909 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 488 op/s 2024-06-02T22:37:43.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:43 smithi178 ceph-mon[36614]: pgmap v533: 129 pgs: 129 active+clean; 922 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2024-06-02T22:37:43.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:43 smithi031 ceph-mon[31767]: pgmap v533: 129 pgs: 129 active+clean; 922 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2024-06-02T22:37:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:43 smithi098 ceph-mon[36750]: pgmap v533: 129 pgs: 129 active+clean; 922 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 629 op/s 2024-06-02T22:37:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 20.0 s, 1805.8 tps, lat 55.054 ms stddev 62.112 2024-06-02T22:37:45.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:45 smithi178 ceph-mon[36614]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 621 op/s 2024-06-02T22:37:45.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:45 smithi031 ceph-mon[31767]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 621 op/s 2024-06-02T22:37:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:45 smithi098 ceph-mon[36750]: pgmap v534: 129 pgs: 129 active+clean; 929 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 621 op/s 2024-06-02T22:37:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 -- 172.21.15.31:0/2887976057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 msgr2=0x7f181010bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 --2- 172.21.15.31:0/2887976057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f181010bd30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f180c009be0 tx=0x7f180c02a750 comp rx=0 tx=0).stop 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 -- 172.21.15.31:0/2887976057 shutdown_connections 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 --2- 172.21.15.31:0/2887976057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f181010bd30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 --2- 172.21.15.31:0/2887976057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18100743a0 0x7f1810074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 --2- 172.21.15.31:0/2887976057 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1810075980 0x7f1810073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 -- 172.21.15.31:0/2887976057 >> 172.21.15.31:0/2887976057 conn(0x7f18100fcf90 msgr2=0x7f18100ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 -- 172.21.15.31:0/2887976057 shutdown_connections 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.692+0000 7f1818800640 1 -- 172.21.15.31:0/2887976057 wait complete. 2024-06-02T22:37:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.693+0000 7f1818800640 1 Processor -- start 2024-06-02T22:37:47.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 -- start start 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18100743a0 0x7f181019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f18101a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1810101d10 con 0x7f18100743a0 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1810101b90 con 0x7f1810075980 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.694+0000 7f1818800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1810101e90 con 0x7f1810109890 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46304/0 (socket says 172.21.15.31:46304) 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 -- 172.21.15.31:0/2139289007 learned_addr learned my addr 172.21.15.31:0/2139289007 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:47.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1816800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f18101a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815e00640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18100743a0 0x7f181019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 -- 172.21.15.31:0/2139289007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 msgr2=0x7f18101a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f18101a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 -- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18100743a0 msgr2=0x7f181019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18100743a0 0x7f181019e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 -- 172.21.15.31:0/2139289007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18101a5db0 con 0x7f1810075980 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.695+0000 7f1815400640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f180000e9c0 tx=0x7f180000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.696+0000 7f180aa00640 1 -- 172.21.15.31:0/2139289007 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180000ccc0 con 0x7f1810075980 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.696+0000 7f180aa00640 1 -- 172.21.15.31:0/2139289007 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1800005500 con 0x7f1810075980 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.696+0000 7f180aa00640 1 -- 172.21.15.31:0/2139289007 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800010430 con 0x7f1810075980 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.696+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18101a60a0 con 0x7f1810075980 2024-06-02T22:37:47.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.696+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a65a0 con 0x7f1810075980 2024-06-02T22:37:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.705+0000 7f181b7a1740 1 Processor -- start 2024-06-02T22:37:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.706+0000 7f180aa00640 1 -- 172.21.15.31:0/2139289007 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 137884+0+0 (secure 0 0 0) 0x7f18000105d0 con 0x7f1810075980 2024-06-02T22:37:47.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.706+0000 7f181b7a1740 1 -- start start 2024-06-02T22:37:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.708+0000 7f180aa00640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 0x7f17f80a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.709+0000 7f180aa00640 1 -- 172.21.15.31:0/2139289007 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f18000cfb10 con 0x7f1810075980 2024-06-02T22:37:47.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.709+0000 7f1816800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 0x7f17f80a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.709 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5584b131c420 con 0x5584b13b8bd0 2024-06-02T22:37:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584b12c3c50 con 0x5584b13be730 2024-06-02T22:37:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f181b7a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5584b13183e0 con 0x5584b13b95c0 2024-06-02T22:37:47.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.710+0000 7f1816800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 0x7f17f80a52d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f180c02ac70 tx=0x7f180c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46314/0 (socket says 172.21.15.31:46314) 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 -- 172.21.15.31:0/3446695965 learned_addr learned my addr 172.21.15.31:0/3446695965 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1815e00640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1815400640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 -- 172.21.15.31:0/3446695965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 msgr2=0x5584b13be0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13be0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 -- 172.21.15.31:0/3446695965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 msgr2=0x5584b13b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.711 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1816800640 1 -- 172.21.15.31:0/3446695965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b1030210 con 0x5584b13be730 2024-06-02T22:37:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.711+0000 7f1815400640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:37:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.712+0000 7f1816800640 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f180c009be0 tx=0x7f180c03d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2da81af63bccc8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.712+0000 7f17ff000640 1 -- 172.21.15.31:0/3446695965 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c036040 con 0x5584b13be730 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.712+0000 7f17ff000640 1 -- 172.21.15.31:0/3446695965 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f180c04e070 con 0x5584b13be730 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.712+0000 7f17ff000640 1 -- 172.21.15.31:0/3446695965 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c036040 con 0x5584b13be730 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 -- 172.21.15.31:0/3446695965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 msgr2=0x5584b13c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f180c009be0 tx=0x7f180c03d000 comp rx=0 tx=0).stop 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 -- 172.21.15.31:0/3446695965 shutdown_connections 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13c0bc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13be0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 --2- 172.21.15.31:0/3446695965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 -- 172.21.15.31:0/3446695965 >> 172.21.15.31:0/3446695965 conn(0x5584b1380f80 msgr2=0x5584b13b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 -- 172.21.15.31:0/3446695965 shutdown_connections 2024-06-02T22:37:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.713+0000 7f181b7a1740 1 -- 172.21.15.31:0/3446695965 wait complete. 2024-06-02T22:37:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.714+0000 7f181b7a1740 1 -- start start 2024-06-02T22:37:47.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.715+0000 7f181b7a1740 1 Processor -- start 2024-06-02T22:37:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5584b13c1680 con 0x5584b13b8bd0 2024-06-02T22:37:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5584b12d70b0 con 0x5584b13be730 2024-06-02T22:37:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5584b13c1800 con 0x5584b13b95c0 2024-06-02T22:37:47.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f181b7a1740 10 client.0 _ll_register_callbacks cb 0x5584b12c2f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.716+0000 7f1815e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39082/0 (socket says 172.21.15.31:39082) 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 -- 172.21.15.31:0/1831607522 learned_addr learned my addr 172.21.15.31:0/1831607522 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1816800640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815400640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 -- 172.21.15.31:0/1831607522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 msgr2=0x5584b13c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 -- 172.21.15.31:0/1831607522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 msgr2=0x5584b13ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.717+0000 7f1815e00640 1 -- 172.21.15.31:0/1831607522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b10fc620 con 0x5584b13b8bd0 2024-06-02T22:37:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.718+0000 7f1815e00640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1804012420 tx=0x7f18040128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e48c673febfe06 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.718+0000 7f17f3400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:37:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.720+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804010900 con 0x5584b13b8bd0 2024-06-02T22:37:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.720+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f1804010aa0 con 0x5584b13b8bd0 2024-06-02T22:37:47.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.720+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f180c04e070 con 0x5584b13b8bd0 2024-06-02T22:37:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.721+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1804027050 con 0x5584b13b8bd0 2024-06-02T22:37:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.721+0000 7f181b7a1740 10 client.15159 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.721+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584b13de7c0 con 0x5584b13b8bd0 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f180c04e070 con 0x5584b13b8bd0 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f180400f040 con 0x5584b13b8bd0 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 10 client.15159 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 10 client.15159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 20 client.15159 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b13dff00 0x5584b13e2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 4 client.15159 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:37:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.722+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584b1329b50 con 0x5584b13dff00 2024-06-02T22:37:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.724+0000 7f1815400640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b13dff00 0x5584b13e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.726+0000 7f17f3400640 10 client.15159 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:47.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.728+0000 7f1815400640 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b13dff00 0x5584b13e2330 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85054184244575e server_cookie=115b591742ff1ac0 in_seq=0 out_seq=0 2024-06-02T22:37:47.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f17f3400640 1 -- 172.21.15.31:0/1831607522 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5584b1329b50 con 0x5584b13dff00 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f17f3400640 10 client.15159 handle_command_reply: tid=0 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f181b7a1740 1 client.15159 shutdown 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 msgr2=0x5584b13c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1804012420 tx=0x7f18040128e0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.730+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 shutdown_connections 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b13dff00 0x5584b13e2330 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13be730 0x5584b13ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1831607522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b8bd0 0x5584b13c2e80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 >> 172.21.15.31:0/1831607522 conn(0x5584b1380f80 msgr2=0x5584b13b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f17f3400640 0 client.15159 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 shutdown_connections 2024-06-02T22:37:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 1 -- 172.21.15.31:0/1831607522 wait complete. 2024-06-02T22:37:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.731+0000 7f181b7a1740 20 client.15159 trim_cache size 0 max 16384 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.761+0000 7f181b7a1740 1 Processor -- start 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.761+0000 7f181b7a1740 1 -- start start 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b95c0 0x5584b13ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13be730 0x5584b13c3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f18101a8370 con 0x5584b13b95c0 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f18101a9eb0 con 0x5584b13b8bd0 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f181b7a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f18101a8a40 con 0x5584b13be730 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b95c0 0x5584b13ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46332/0 (socket says 172.21.15.31:46332) 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 -- 172.21.15.31:0/1039377505 learned_addr learned my addr 172.21.15.31:0/1039377505 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1816800640 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13be730 0x5584b13c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 -- 172.21.15.31:0/1039377505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13be730 msgr2=0x5584b13c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13be730 0x5584b13c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 -- 172.21.15.31:0/1039377505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b95c0 msgr2=0x5584b13ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b95c0 0x5584b13ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.762+0000 7f1815e00640 1 -- 172.21.15.31:0/1039377505 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b13b99a0 con 0x5584b13b8bd0 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.763+0000 7f1815e00640 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1804005eb0 tx=0x7f1804009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e551530266ffc1ef server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.763+0000 7f17fe600640 1 -- 172.21.15.31:0/1039377505 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804012110 con 0x5584b13b8bd0 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.763+0000 7f17fe600640 1 -- 172.21.15.31:0/1039377505 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f180400e630 con 0x5584b13b8bd0 2024-06-02T22:37:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.763+0000 7f17fe600640 1 -- 172.21.15.31:0/1039377505 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804005470 con 0x5584b13b8bd0 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 -- 172.21.15.31:0/1039377505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 msgr2=0x5584b13b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1804005eb0 tx=0x7f1804009c60 comp rx=0 tx=0).stop 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 -- 172.21.15.31:0/1039377505 shutdown_connections 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13be730 0x5584b13c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13b95c0 0x5584b13ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 --2- 172.21.15.31:0/1039377505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13b7cb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 -- 172.21.15.31:0/1039377505 >> 172.21.15.31:0/1039377505 conn(0x5584b1380f80 msgr2=0x5584b13b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 -- 172.21.15.31:0/1039377505 shutdown_connections 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.764+0000 7f181b7a1740 1 -- 172.21.15.31:0/1039377505 wait complete. 2024-06-02T22:37:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.765+0000 7f181b7a1740 1 -- start start 2024-06-02T22:37:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.765+0000 7f181b7a1740 1 Processor -- start 2024-06-02T22:37:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.765+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 0x5584b1448c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f18101a97e0 con 0x5584b13be730 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f18101a9110 con 0x5584b13b8bd0 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1810117200 con 0x5584b13b95c0 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f181b7a1740 10 client.0 _ll_register_callbacks cb 0x7f1804009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f1815e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f1815e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46340/0 (socket says 172.21.15.31:46340) 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f1815e00640 1 -- 172.21.15.31:0/603397375 learned_addr learned my addr 172.21.15.31:0/603397375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f1816800640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 0x5584b1448c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.766+0000 7f1815e00640 1 -- 172.21.15.31:0/603397375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 msgr2=0x5584b13c7500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1815400640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1815e00640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1815e00640 1 -- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 msgr2=0x5584b1448c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1815e00640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 0x5584b1448c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1815e00640 1 -- 172.21.15.31:0/603397375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b13ca5d0 con 0x5584b13b8bd0 2024-06-02T22:37:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.767+0000 7f1816800640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 0x5584b1448c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.768+0000 7f1815e00640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f180400e4e0 tx=0x7f1804005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea052c3e4b5ad81 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.768+0000 7f17f3400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804031070 con 0x5584b13b8bd0 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f180400e630 con 0x5584b13b8bd0 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f180400eb50 con 0x5584b13b8bd0 2024-06-02T22:37:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f180403d050 con 0x5584b13b8bd0 2024-06-02T22:37:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f181b7a1740 10 client.25271 fetch_fsmap learned FSMap version 30 2024-06-02T22:37:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5584b144a030 con 0x5584b13b8bd0 2024-06-02T22:37:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.769+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f180400e630 con 0x5584b13b8bd0 2024-06-02T22:37:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1804005470 con 0x5584b13b8bd0 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 10 client.25271 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 10 client.25271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 20 client.25271 populate_metadata read hostname 'smithi031' 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b144a8c0 0x5584b144cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 4 client.25271 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.770+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584b1323ea0 con 0x5584b144a8c0 2024-06-02T22:37:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.771+0000 7f1815400640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b144a8c0 0x5584b144cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:37:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.772+0000 7f1815400640 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b144a8c0 0x5584b144cce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bf1d9483619fb4f server_cookie=13901032dfef1d76 in_seq=0 out_seq=0 2024-06-02T22:37:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.772+0000 7f17f3400640 10 client.25271 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:47.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:47 smithi178 ceph-mon[36614]: pgmap v535: 129 pgs: 129 active+clean; 931 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 646 op/s 2024-06-02T22:37:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f17f3400640 1 -- 172.21.15.31:0/603397375 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5584b1323ea0 con 0x5584b144a8c0 2024-06-02T22:37:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f17f3400640 10 client.25271 handle_command_reply: tid=0 2024-06-02T22:37:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 client.25271 shutdown 2024-06-02T22:37:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 msgr2=0x5584b13c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f180400e4e0 tx=0x7f1804005f90 comp rx=0 tx=0).stop 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 shutdown_connections 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5584b144a8c0 0x5584b144cce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5584b13be730 0x5584b1448c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584b13b95c0 0x5584b13c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 --2- 172.21.15.31:0/603397375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5584b13b8bd0 0x5584b13c6fc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f17f3400640 0 client.25271 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.823+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 >> 172.21.15.31:0/603397375 conn(0x5584b1380f80 msgr2=0x5584b13b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.824+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 shutdown_connections 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.824+0000 7f181b7a1740 1 -- 172.21.15.31:0/603397375 wait complete. 2024-06-02T22:37:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.824+0000 7f181b7a1740 20 client.25271 trim_cache size 0 max 16384 2024-06-02T22:37:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:37:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:37:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:37:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.826+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 msgr2=0x7f17f80a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.826+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 0x7f17f80a52d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f180c02ac70 tx=0x7f180c005fd0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.826+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 msgr2=0x7f181019e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:37:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.826+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f180000e9c0 tx=0x7f180000ee80 comp rx=0 tx=0).stop 2024-06-02T22:37:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 shutdown_connections 2024-06-02T22:37:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17f80a2e10 0x7f17f80a52d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1810109890 0x7f18101a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1810075980 0x7f181019e6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 --2- 172.21.15.31:0/2139289007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18100743a0 0x7f181019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.829+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 >> 172.21.15.31:0/2139289007 conn(0x7f18100fcf90 msgr2=0x7f18101026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.830+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 shutdown_connections 2024-06-02T22:37:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:37:47.830+0000 7f1818800640 1 -- 172.21.15.31:0/2139289007 wait complete. 2024-06-02T22:37:47.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:47 smithi031 ceph-mon[31767]: pgmap v535: 129 pgs: 129 active+clean; 931 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 646 op/s 2024-06-02T22:37:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:47 smithi098 ceph-mon[36750]: pgmap v535: 129 pgs: 129 active+clean; 931 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.8 MiB/s wr, 646 op/s 2024-06-02T22:37:49.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:49 smithi178 ceph-mon[36614]: pgmap v536: 129 pgs: 129 active+clean; 936 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 630 op/s 2024-06-02T22:37:49.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:49 smithi031 ceph-mon[31767]: pgmap v536: 129 pgs: 129 active+clean; 936 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 630 op/s 2024-06-02T22:37:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:49 smithi098 ceph-mon[36750]: pgmap v536: 129 pgs: 129 active+clean; 936 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 630 op/s 2024-06-02T22:37:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 25.0 s, 1748.2 tps, lat 57.999 ms stddev 78.207 2024-06-02T22:37:51.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:51 smithi031 ceph-mon[31767]: pgmap v537: 129 pgs: 129 active+clean; 950 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T22:37:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:51 smithi098 ceph-mon[36750]: pgmap v537: 129 pgs: 129 active+clean; 950 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T22:37:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:51 smithi178 ceph-mon[36614]: pgmap v537: 129 pgs: 129 active+clean; 950 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 700 op/s 2024-06-02T22:37:53.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:53 smithi031 ceph-mon[31767]: pgmap v538: 129 pgs: 129 active+clean; 954 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-06-02T22:37:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:53 smithi098 ceph-mon[36750]: pgmap v538: 129 pgs: 129 active+clean; 954 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-06-02T22:37:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:53 smithi178 ceph-mon[36614]: pgmap v538: 129 pgs: 129 active+clean; 954 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 715 op/s 2024-06-02T22:37:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 30.0 s, 1973.0 tps, lat 50.607 ms stddev 57.261 2024-06-02T22:37:55.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:55 smithi031 ceph-mon[31767]: pgmap v539: 129 pgs: 129 active+clean; 970 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 629 op/s 2024-06-02T22:37:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:55 smithi098 ceph-mon[36750]: pgmap v539: 129 pgs: 129 active+clean; 970 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 629 op/s 2024-06-02T22:37:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:55 smithi178 ceph-mon[36614]: pgmap v539: 129 pgs: 129 active+clean; 970 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.9 MiB/s wr, 629 op/s 2024-06-02T22:37:56.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:56 smithi031 ceph-mon[31767]: mgrmap e20: x(active, since 15m), standbys: z, y 2024-06-02T22:37:56.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:56 smithi098 ceph-mon[36750]: mgrmap e20: x(active, since 15m), standbys: z, y 2024-06-02T22:37:57.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:56 smithi178 ceph-mon[36614]: mgrmap e20: x(active, since 15m), standbys: z, y 2024-06-02T22:37:57.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:57 smithi031 ceph-mon[31767]: pgmap v540: 129 pgs: 129 active+clean; 967 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 754 op/s 2024-06-02T22:37:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:57 smithi098 ceph-mon[36750]: pgmap v540: 129 pgs: 129 active+clean; 967 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 754 op/s 2024-06-02T22:37:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:57 smithi178 ceph-mon[36614]: pgmap v540: 129 pgs: 129 active+clean; 967 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 13 MiB/s wr, 754 op/s 2024-06-02T22:37:59.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:37:59 smithi031 ceph-mon[31767]: pgmap v541: 129 pgs: 129 active+clean; 953 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 702 op/s 2024-06-02T22:37:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:37:59 smithi098 ceph-mon[36750]: pgmap v541: 129 pgs: 129 active+clean; 953 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 702 op/s 2024-06-02T22:38:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:37:59 smithi178 ceph-mon[36614]: pgmap v541: 129 pgs: 129 active+clean; 953 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 702 op/s 2024-06-02T22:38:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 35.0 s, 2073.3 tps, lat 48.177 ms stddev 58.841 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 -- 172.21.15.31:0/1431854261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c1057d0 msgr2=0x7f208c10c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 --2- 172.21.15.31:0/1431854261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c1057d0 0x7f208c10c060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2084009900 tx=0x7f208402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 -- 172.21.15.31:0/1431854261 shutdown_connections 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 --2- 172.21.15.31:0/1431854261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c1057d0 0x7f208c10c060 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 --2- 172.21.15.31:0/1431854261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c104e10 0x7f208c105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 --2- 172.21.15.31:0/1431854261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 0x7f208c104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 -- 172.21.15.31:0/1431854261 >> 172.21.15.31:0/1431854261 conn(0x7f208c0ff190 msgr2=0x7f208c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 -- 172.21.15.31:0/1431854261 shutdown_connections 2024-06-02T22:38:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.024+0000 7f2092200640 1 -- 172.21.15.31:0/1431854261 wait complete. 2024-06-02T22:38:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.026+0000 7f2092200640 1 Processor -- start 2024-06-02T22:38:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.026+0000 7f2092200640 1 -- start start 2024-06-02T22:38:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.026+0000 7f2092200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 0x7f208c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2092200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2092200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1057d0 0x7f208c1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2092200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10f8d0 con 0x7f208c103c20 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2092200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10f750 con 0x7f208c1057d0 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2092200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f208c10fa50 con 0x7f208c104e10 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2083e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f208be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1057d0 0x7f208c1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2083e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35192/0 (socket says 172.21.15.31:35192) 2024-06-02T22:38:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f2083e00640 1 -- 172.21.15.31:0/1746354519 learned_addr learned my addr 172.21.15.31:0/1746354519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.027+0000 7f208b400640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 0x7f208c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 -- 172.21.15.31:0/1746354519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1057d0 msgr2=0x7f208c1a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1057d0 0x7f208c1a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 -- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 msgr2=0x7f208c199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 0x7f208c199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 -- 172.21.15.31:0/1746354519 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208c1a1a40 con 0x7f208c104e10 2024-06-02T22:38:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.028+0000 7f2083e00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207400ebc0 tx=0x7f207400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.029+0000 7f2088c00640 1 -- 172.21.15.31:0/1746354519 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074010630 con 0x7f208c104e10 2024-06-02T22:38:01.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.029+0000 7f2088c00640 1 -- 172.21.15.31:0/1746354519 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2074010cb0 con 0x7f208c104e10 2024-06-02T22:38:01.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.029+0000 7f2088c00640 1 -- 172.21.15.31:0/1746354519 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074018bd0 con 0x7f208c104e10 2024-06-02T22:38:01.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.029+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208c1a1d30 con 0x7f208c104e10 2024-06-02T22:38:01.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.029+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208c1a21d0 con 0x7f208c104e10 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.034+0000 7f2095033740 1 Processor -- start 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.034+0000 7f2095033740 1 -- start start 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c760748d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c760773d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2088c00640 1 -- 172.21.15.31:0/1746354519 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f20740173d0 con 0x7f208c104e10 2024-06-02T22:38:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559c75fca420 con 0x559c7606fdd0 2024-06-02T22:38:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559c75f71c50 con 0x559c76074f40 2024-06-02T22:38:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2095033740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559c75fc63e0 con 0x559c7606f3e0 2024-06-02T22:38:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f208be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f208be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35202/0 (socket says 172.21.15.31:35202) 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f2083e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c760773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f208be00640 1 -- 172.21.15.31:0/569047217 learned_addr learned my addr 172.21.15.31:0/569047217 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.035+0000 7f208b400640 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c760748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 -- 172.21.15.31:0/569047217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 msgr2=0x559c7606f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 -- 172.21.15.31:0/569047217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 msgr2=0x559c760748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c760748d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 -- 172.21.15.31:0/569047217 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c75cde210 con 0x559c76074f40 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f2083e00640 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c760773d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f20740cd110 tx=0x7f20740d72a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92109b55384c0896 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f207be00640 1 -- 172.21.15.31:0/569047217 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20740de070 con 0x559c76074f40 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f207be00640 1 -- 172.21.15.31:0/569047217 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20740da900 con 0x559c76074f40 2024-06-02T22:38:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.036+0000 7f207be00640 1 -- 172.21.15.31:0/569047217 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20740d9960 con 0x559c76074f40 2024-06-02T22:38:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.037+0000 7f2088c00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 0x7f206c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.037+0000 7f2088c00640 1 -- 172.21.15.31:0/1746354519 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f20740cfa60 con 0x7f208c104e10 2024-06-02T22:38:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.038+0000 7f2095033740 1 -- 172.21.15.31:0/569047217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 msgr2=0x559c760773d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.038+0000 7f2095033740 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c760773d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f20740cd110 tx=0x7f20740d72a0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.038+0000 7f208be00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 0x7f206c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.039+0000 7f2095033740 1 -- 172.21.15.31:0/569047217 shutdown_connections 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.039+0000 7f2095033740 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c760773d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.039+0000 7f2095033740 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c760748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.039+0000 7f2095033740 1 --2- 172.21.15.31:0/569047217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.040+0000 7f2095033740 1 -- 172.21.15.31:0/569047217 >> 172.21.15.31:0/569047217 conn(0x559c7602ef80 msgr2=0x559c7606ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.040+0000 7f2095033740 1 -- 172.21.15.31:0/569047217 shutdown_connections 2024-06-02T22:38:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.040+0000 7f208be00640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 0x7f206c0a51f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f20840096c0 tx=0x7f20840315d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.040+0000 7f2095033740 1 -- 172.21.15.31:0/569047217 wait complete. 2024-06-02T22:38:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.041+0000 7f2095033740 1 -- start start 2024-06-02T22:38:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.041+0000 7f2095033740 1 Processor -- start 2024-06-02T22:38:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c76079c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c76080cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559c76077ef0 con 0x559c76074f40 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559c75f850b0 con 0x559c7606f3e0 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.042+0000 7f2095033740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559c76078070 con 0x559c7606fdd0 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.043+0000 7f2095033740 10 client.0 _ll_register_callbacks cb 0x559c75f70f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.043+0000 7f208b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.043+0000 7f208b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46280/0 (socket says 172.21.15.31:46280) 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.043+0000 7f208b400640 1 -- 172.21.15.31:0/4128758081 learned_addr learned my addr 172.21.15.31:0/4128758081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208be00640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c76080cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f2083e00640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c76079c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208b400640 1 -- 172.21.15.31:0/4128758081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 msgr2=0x559c76079c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208b400640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c76079c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208b400640 1 -- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 msgr2=0x559c76080cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208b400640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c76080cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.044+0000 7f208b400640 1 -- 172.21.15.31:0/4128758081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c75daa620 con 0x559c7606f3e0 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.045+0000 7f208b400640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f207c013710 tx=0x7f207c013bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8658555f893ae174 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.045+0000 7f2078c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.045+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c011dd0 con 0x559c7606f3e0 2024-06-02T22:38:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.045+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f207c004030 con 0x559c7606f3e0 2024-06-02T22:38:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.046+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20740da900 con 0x559c7606f3e0 2024-06-02T22:38:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.046+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f207c004270 con 0x559c7606f3e0 2024-06-02T22:38:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.047+0000 7f2095033740 10 client.25283 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.047+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c760840a0 con 0x559c7606f3e0 2024-06-02T22:38:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.048+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20740da900 con 0x559c7606f3e0 2024-06-02T22:38:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.048+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f207c01a070 con 0x559c7606f3e0 2024-06-02T22:38:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 10 client.25283 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 10 client.25283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 20 client.25283 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c76085790 0x559c76087c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 4 client.25283 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.049+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c75fd7b50 con 0x559c76085790 2024-06-02T22:38:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.050+0000 7f2083e00640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c76085790 0x559c76087c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.051+0000 7f2083e00640 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c76085790 0x559c76087c00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=137087efb41770f8 server_cookie=89977fd64c37ce89 in_seq=0 out_seq=0 2024-06-02T22:38:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.051+0000 7f2078c00640 10 client.25283 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:01.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.053+0000 7f2078c00640 1 -- 172.21.15.31:0/4128758081 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559c75fd7b50 con 0x559c76085790 2024-06-02T22:38:01.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.054+0000 7f2078c00640 10 client.25283 handle_command_reply: tid=0 2024-06-02T22:38:01.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.054+0000 7f2095033740 1 client.25283 shutdown 2024-06-02T22:38:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.054+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 msgr2=0x559c76079740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f207c013710 tx=0x7f207c013bd0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 shutdown_connections 2024-06-02T22:38:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c76085790 0x559c76087c00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c76080cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c76079c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 --2- 172.21.15.31:0/4128758081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c76079740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 >> 172.21.15.31:0/4128758081 conn(0x559c7602ef80 msgr2=0x559c76061810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2078c00640 0 client.25283 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 shutdown_connections 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.055+0000 7f2095033740 1 -- 172.21.15.31:0/4128758081 wait complete. 2024-06-02T22:38:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.056+0000 7f2095033740 20 client.25283 trim_cache size 0 max 16384 2024-06-02T22:38:01.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.086+0000 7f2095033740 1 Processor -- start 2024-06-02T22:38:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.087+0000 7f2095033740 1 -- start start 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c76080c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c7606e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1a8600 con 0x559c7606fdd0 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1aa140 con 0x559c76074f40 2024-06-02T22:38:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2095033740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1a8cd0 con 0x559c7606f3e0 2024-06-02T22:38:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f208b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.089+0000 7f208b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35228/0 (socket says 172.21.15.31:35228) 2024-06-02T22:38:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.089+0000 7f208b400640 1 -- 172.21.15.31:0/3801292678 learned_addr learned my addr 172.21.15.31:0/3801292678 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.089+0000 7f208be00640 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c7606e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.088+0000 7f2083e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c76080c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.091+0000 7f208b400640 1 -- 172.21.15.31:0/3801292678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 msgr2=0x559c7606e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.091+0000 7f208b400640 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c7606e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.091+0000 7f208b400640 1 -- 172.21.15.31:0/3801292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 msgr2=0x559c76080c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.091+0000 7f208b400640 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c76080c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.091+0000 7f208b400640 1 -- 172.21.15.31:0/3801292678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c760701b0 con 0x559c7606f3e0 2024-06-02T22:38:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.093+0000 7f208b400640 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f207c0136e0 tx=0x7f207c009ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7587c93c75beab server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.093+0000 7f207b400640 1 -- 172.21.15.31:0/3801292678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c000e60 con 0x559c7606f3e0 2024-06-02T22:38:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.093+0000 7f207b400640 1 -- 172.21.15.31:0/3801292678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207c025470 con 0x559c7606f3e0 2024-06-02T22:38:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.093+0000 7f207b400640 1 -- 172.21.15.31:0/3801292678 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207c000e60 con 0x559c7606f3e0 2024-06-02T22:38:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.095+0000 7f2095033740 1 -- 172.21.15.31:0/3801292678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 msgr2=0x559c7606a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.095+0000 7f2095033740 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f207c0136e0 tx=0x7f207c009ce0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 -- 172.21.15.31:0/3801292678 shutdown_connections 2024-06-02T22:38:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c76074f40 0x559c7606e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c7606fdd0 0x559c76080c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 --2- 172.21.15.31:0/3801292678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606f3e0 0x559c7606a940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 -- 172.21.15.31:0/3801292678 >> 172.21.15.31:0/3801292678 conn(0x559c7602ef80 msgr2=0x559c7606db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.096+0000 7f2095033740 1 -- 172.21.15.31:0/3801292678 shutdown_connections 2024-06-02T22:38:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.097+0000 7f2095033740 1 -- 172.21.15.31:0/3801292678 wait complete. 2024-06-02T22:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.097+0000 7f2095033740 1 -- start start 2024-06-02T22:38:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.098+0000 7f2095033740 1 Processor -- start 2024-06-02T22:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c7607d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c7607def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1a9a70 con 0x559c76074f40 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1a93a0 con 0x559c7606f3e0 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f208c1a65e0 con 0x559c7606fdd0 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f2095033740 10 client.0 _ll_register_callbacks cb 0x7f207c009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f208b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c7607d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.099+0000 7f208be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45714/0 (socket says 172.21.15.31:45714) 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 -- 172.21.15.31:0/3067838106 learned_addr learned my addr 172.21.15.31:0/3067838106 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f2083e00640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c7607def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 -- 172.21.15.31:0/3067838106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 msgr2=0x559c7607def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c7607def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 -- 172.21.15.31:0/3067838106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 msgr2=0x559c7607d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c7607d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208be00640 1 -- 172.21.15.31:0/3067838106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7607e530 con 0x559c76074f40 2024-06-02T22:38:01.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.100+0000 7f208b400640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c7607d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:38:01.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.101+0000 7f208be00640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2084009230 tx=0x7f2084009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789916fdb306635f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:01.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.101+0000 7f2078c00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:38:01.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.102+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084035040 con 0x559c76074f40 2024-06-02T22:38:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.103+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2084003b80 con 0x559c76074f40 2024-06-02T22:38:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.103+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207c025470 con 0x559c76074f40 2024-06-02T22:38:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.103+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f208405e050 con 0x559c76074f40 2024-06-02T22:38:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.103+0000 7f2095033740 10 client.15183 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.103+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c760efb40 con 0x559c76074f40 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f207c025470 con 0x559c76074f40 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2084053020 con 0x559c76074f40 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 10 client.15183 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 10 client.15183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 20 client.15183 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c760f04d0 0x559c760f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 4 client.15183 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.104+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c75fd1ea0 con 0x559c760f04d0 2024-06-02T22:38:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.105+0000 7f208b400640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c760f04d0 0x559c760f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.107+0000 7f2078c00640 10 client.15183 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.107+0000 7f208b400640 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c760f04d0 0x559c760f28f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b071c90d3ae8d6b server_cookie=87c311a2906b9746 in_seq=0 out_seq=0 2024-06-02T22:38:01.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.135+0000 7f2078c00640 1 -- 172.21.15.31:0/3067838106 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x559c75fd1ea0 con 0x559c760f04d0 2024-06-02T22:38:01.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.135+0000 7f2078c00640 10 client.15183 handle_command_reply: tid=0 2024-06-02T22:38:01.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.135+0000 7f2095033740 1 client.15183 shutdown 2024-06-02T22:38:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 msgr2=0x559c760ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2084009230 tx=0x7f2084009260 comp rx=0 tx=0).stop 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 shutdown_connections 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x559c760f04d0 0x559c760f28f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559c76074f40 0x559c760ee4d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559c7606fdd0 0x559c7607def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 --2- 172.21.15.31:0/3067838106 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559c7606f3e0 0x559c7607d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 >> 172.21.15.31:0/3067838106 conn(0x559c7602ef80 msgr2=0x559c76061810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.136+0000 7f2078c00640 0 client.15183 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.137+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 shutdown_connections 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.137+0000 7f2095033740 1 -- 172.21.15.31:0/3067838106 wait complete. 2024-06-02T22:38:01.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.137+0000 7f2095033740 20 client.15183 trim_cache size 0 max 16384 2024-06-02T22:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:38:01.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 msgr2=0x7f206c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 0x7f206c0a51f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f20840096c0 tx=0x7f20840315d0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 msgr2=0x7f208c19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f207400ebc0 tx=0x7f207400c6a0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 shutdown_connections 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f206c0a2d30 0x7f206c0a51f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f208c1057d0 0x7f208c1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f208c104e10 0x7f208c19a360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 --2- 172.21.15.31:0/1746354519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f208c103c20 0x7f208c199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 >> 172.21.15.31:0/1746354519 conn(0x7f208c0ff190 msgr2=0x7f208c108040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 shutdown_connections 2024-06-02T22:38:01.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:01.138+0000 7f2092200640 1 -- 172.21.15.31:0/1746354519 wait complete. 2024-06-02T22:38:01.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:01 smithi031 ceph-mon[31767]: pgmap v542: 129 pgs: 129 active+clean; 949 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 705 op/s 2024-06-02T22:38:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:01 smithi098 ceph-mon[36750]: pgmap v542: 129 pgs: 129 active+clean; 949 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 705 op/s 2024-06-02T22:38:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:01 smithi178 ceph-mon[36614]: pgmap v542: 129 pgs: 129 active+clean; 949 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 705 op/s 2024-06-02T22:38:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:03 smithi098 ceph-mon[36750]: pgmap v543: 129 pgs: 129 active+clean; 957 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 683 op/s 2024-06-02T22:38:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:03 smithi178 ceph-mon[36614]: pgmap v543: 129 pgs: 129 active+clean; 957 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 683 op/s 2024-06-02T22:38:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:03 smithi031 ceph-mon[31767]: pgmap v543: 129 pgs: 129 active+clean; 957 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 12 MiB/s wr, 683 op/s 2024-06-02T22:38:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 40.0 s, 1730.5 tps, lat 57.564 ms stddev 77.971 2024-06-02T22:38:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:05 smithi098 ceph-mon[36750]: pgmap v544: 129 pgs: 129 active+clean; 958 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 647 op/s 2024-06-02T22:38:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:05 smithi178 ceph-mon[36614]: pgmap v544: 129 pgs: 129 active+clean; 958 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 647 op/s 2024-06-02T22:38:06.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:05 smithi031 ceph-mon[31767]: pgmap v544: 129 pgs: 129 active+clean; 958 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 647 op/s 2024-06-02T22:38:07.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:07 smithi098 ceph-mon[36750]: pgmap v545: 129 pgs: 129 active+clean; 959 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-06-02T22:38:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:07 smithi178 ceph-mon[36614]: pgmap v545: 129 pgs: 129 active+clean; 959 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-06-02T22:38:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:07 smithi031 ceph-mon[31767]: pgmap v545: 129 pgs: 129 active+clean; 959 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-06-02T22:38:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:09 smithi098 ceph-mon[36750]: pgmap v546: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 599 op/s 2024-06-02T22:38:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:09 smithi178 ceph-mon[36614]: pgmap v546: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 599 op/s 2024-06-02T22:38:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:09 smithi031 ceph-mon[31767]: pgmap v546: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 599 op/s 2024-06-02T22:38:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 45.0 s, 3384.0 tps, lat 29.764 ms stddev 31.187 2024-06-02T22:38:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:11 smithi098 ceph-mon[36750]: pgmap v547: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-06-02T22:38:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:11 smithi178 ceph-mon[36614]: pgmap v547: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-06-02T22:38:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:11 smithi031 ceph-mon[31767]: pgmap v547: 129 pgs: 129 active+clean; 959 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 757 op/s 2024-06-02T22:38:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:13 smithi098 ceph-mon[36750]: pgmap v548: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 741 op/s 2024-06-02T22:38:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:13 smithi178 ceph-mon[36614]: pgmap v548: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 741 op/s 2024-06-02T22:38:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:13 smithi031 ceph-mon[31767]: pgmap v548: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.9 MiB/s wr, 741 op/s 2024-06-02T22:38:14.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.330+0000 7f8496a00640 1 -- 172.21.15.31:0/2553270963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84901095b0 msgr2=0x7f84900729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.330+0000 7f8496a00640 1 --2- 172.21.15.31:0/2553270963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84901095b0 0x7f84900729d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8484009900 tx=0x7f848402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 -- 172.21.15.31:0/2553270963 shutdown_connections 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 --2- 172.21.15.31:0/2553270963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849010fce0 0x7f84901120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 --2- 172.21.15.31:0/2553270963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8490072f10 0x7f8490073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 --2- 172.21.15.31:0/2553270963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84901095b0 0x7f84900729d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 -- 172.21.15.31:0/2553270963 >> 172.21.15.31:0/2553270963 conn(0x7f849006e840 msgr2=0x7f8490070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 -- 172.21.15.31:0/2553270963 shutdown_connections 2024-06-02T22:38:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.331+0000 7f8496a00640 1 -- 172.21.15.31:0/2553270963 wait complete. 2024-06-02T22:38:14.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.333+0000 7f8496a00640 1 Processor -- start 2024-06-02T22:38:14.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.333+0000 7f8496a00640 1 -- start start 2024-06-02T22:38:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8490072f10 0x7f84901a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84901095b0 0x7f84901a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f849010af60 con 0x7f8490072f10 2024-06-02T22:38:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f849010ade0 con 0x7f84901095b0 2024-06-02T22:38:14.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f849010b0e0 con 0x7f849010fce0 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57310/0 (socket says 172.21.15.31:57310) 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.334+0000 7f8496000640 1 -- 172.21.15.31:0/295551994 learned_addr learned my addr 172.21.15.31:0/295551994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8494c00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84901095b0 0x7f84901a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8496000640 1 -- 172.21.15.31:0/295551994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84901095b0 msgr2=0x7f84901a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8496000640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84901095b0 0x7f84901a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8496000640 1 -- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8490072f10 msgr2=0x7f84901a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8496000640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8490072f10 0x7f84901a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.335+0000 7f8496000640 1 -- 172.21.15.31:0/295551994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84901ae5b0 con 0x7f849010fce0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.336+0000 7f8496000640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f847c00d750 tx=0x7f847c00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.336+0000 7f848e000640 1 -- 172.21.15.31:0/295551994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c017070 con 0x7f849010fce0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.336+0000 7f848e000640 1 -- 172.21.15.31:0/295551994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f847c005500 con 0x7f849010fce0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.337+0000 7f848e000640 1 -- 172.21.15.31:0/295551994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c004d60 con 0x7f849010fce0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.337+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84901ae8a0 con 0x7f849010fce0 2024-06-02T22:38:14.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.337+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84901aeda0 con 0x7f849010fce0 2024-06-02T22:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.349+0000 7f848e000640 1 -- 172.21.15.31:0/295551994 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f847c010460 con 0x7f849010fce0 2024-06-02T22:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.349+0000 7f849adee740 1 Processor -- start 2024-06-02T22:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 -- start start 2024-06-02T22:38:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56378e454420 con 0x56378e4f1780 2024-06-02T22:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56378e3fbc50 con 0x56378e4f0d90 2024-06-02T22:38:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.350+0000 7f849adee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56378e4503e0 con 0x56378e4f68f0 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.351+0000 7f8495600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.351+0000 7f8495600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59976/0 (socket says 172.21.15.31:59976) 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.351+0000 7f8495600640 1 -- 172.21.15.31:0/3181650304 learned_addr learned my addr 172.21.15.31:0/3181650304 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.352+0000 7f8495600640 1 -- 172.21.15.31:0/3181650304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 msgr2=0x56378e4f8d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.352+0000 7f8495600640 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4f8d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.352+0000 7f8495600640 1 -- 172.21.15.31:0/3181650304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 msgr2=0x56378e4f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.353+0000 7f8494c00640 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.353+0000 7f8495600640 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.353+0000 7f8495600640 1 -- 172.21.15.31:0/3181650304 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378e168210 con 0x56378e4f1780 2024-06-02T22:38:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.353+0000 7f848e000640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 0x7f84780a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.353+0000 7f8494c00640 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:38:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.355+0000 7f8494c00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 0x7f84780a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.355+0000 7f848e000640 1 -- 172.21.15.31:0/295551994 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f847c0cee00 con 0x7f849010fce0 2024-06-02T22:38:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.355+0000 7f8495600640 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8484031610 tx=0x7f8484000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428e8ec33044583c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.357+0000 7f8482600640 1 -- 172.21.15.31:0/3181650304 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484040020 con 0x56378e4f1780 2024-06-02T22:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.357+0000 7f8482600640 1 -- 172.21.15.31:0/3181650304 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84840318b0 con 0x56378e4f1780 2024-06-02T22:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.357+0000 7f8482600640 1 -- 172.21.15.31:0/3181650304 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484035040 con 0x56378e4f1780 2024-06-02T22:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 -- 172.21.15.31:0/3181650304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 msgr2=0x56378e4f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8484031610 tx=0x7f8484000bc0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f8494c00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 0x7f84780a5100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56378e4f1fe0 tx=0x7f8488009540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 -- 172.21.15.31:0/3181650304 shutdown_connections 2024-06-02T22:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f1780 0x56378e4f6280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 --2- 172.21.15.31:0/3181650304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.358+0000 7f849adee740 1 -- 172.21.15.31:0/3181650304 >> 172.21.15.31:0/3181650304 conn(0x56378e4b8f80 msgr2=0x56378e4ec810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.359+0000 7f849adee740 1 -- 172.21.15.31:0/3181650304 shutdown_connections 2024-06-02T22:38:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.360+0000 7f849adee740 1 -- 172.21.15.31:0/3181650304 wait complete. 2024-06-02T22:38:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.360+0000 7f849adee740 1 -- start start 2024-06-02T22:38:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.361+0000 7f849adee740 1 Processor -- start 2024-06-02T22:38:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.361+0000 7f849adee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e502c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56378e4f9840 con 0x56378e500820 2024-06-02T22:38:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56378e40f0b0 con 0x56378e4f0d90 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56378e4f99c0 con 0x56378e4f68f0 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f849adee740 10 client.0 _ll_register_callbacks cb 0x56378e3faf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f8495600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.362+0000 7f8495600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52398/0 (socket says 172.21.15.31:52398) 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.363+0000 7f8494c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.363+0000 7f8495600640 1 -- 172.21.15.31:0/1191069113 learned_addr learned my addr 172.21.15.31:0/1191069113 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.363+0000 7f8496000640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e502c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.363+0000 7f8495600640 1 -- 172.21.15.31:0/1191069113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 msgr2=0x56378e4fb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8495600640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4fb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8495600640 1 -- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 msgr2=0x56378e502c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8495600640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e502c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8495600640 1 -- 172.21.15.31:0/1191069113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378e234620 con 0x56378e4f0d90 2024-06-02T22:38:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8495600640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f848402a9e0 tx=0x7f8484005260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddde749977fbb4f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.364+0000 7f8476a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484035040 con 0x56378e4f0d90 2024-06-02T22:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8484004250 con 0x56378e4f0d90 2024-06-02T22:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84840318b0 con 0x56378e4f0d90 2024-06-02T22:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8484040030 con 0x56378e4f0d90 2024-06-02T22:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f849adee740 10 client.25298 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.365+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56378e505ef0 con 0x56378e4f0d90 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84840318b0 con 0x56378e4f0d90 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8484003680 con 0x56378e4f0d90 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 10 client.25298 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 10 client.25298 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 20 client.25298 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e507240 0x56378e509630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 4 client.25298 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:38:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.366+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56378e461b50 con 0x56378e507240 2024-06-02T22:38:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.367+0000 7f8494c00640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e507240 0x56378e509630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.370+0000 7f8494c00640 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e507240 0x56378e509630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5659f94100bb48 server_cookie=830201ffe59ca447 in_seq=0 out_seq=0 2024-06-02T22:38:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.370+0000 7f8476a00640 10 client.25298 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f8476a00640 1 -- 172.21.15.31:0/1191069113 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56378e461b50 con 0x56378e507240 2024-06-02T22:38:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f8476a00640 10 client.25298 handle_command_reply: tid=0 2024-06-02T22:38:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f849adee740 1 client.25298 shutdown 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 msgr2=0x56378e4fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f848402a9e0 tx=0x7f8484005260 comp rx=0 tx=0).stop 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.371+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 shutdown_connections 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e507240 0x56378e509630 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e502c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f68f0 0x56378e4fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 --2- 172.21.15.31:0/1191069113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f0d90 0x56378e4fb2b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 >> 172.21.15.31:0/1191069113 conn(0x56378e4b8f80 msgr2=0x56378e4eb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f8476a00640 0 client.25298 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 shutdown_connections 2024-06-02T22:38:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 1 -- 172.21.15.31:0/1191069113 wait complete. 2024-06-02T22:38:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.372+0000 7f849adee740 20 client.25298 trim_cache size 0 max 16384 2024-06-02T22:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 Processor -- start 2024-06-02T22:38:14.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 -- start start 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f0d90 0x56378e4faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e500820 0x56378e4fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f84901b91f0 con 0x56378e4f0d90 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84901bad30 con 0x56378e4f68f0 2024-06-02T22:38:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.398+0000 7f849adee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f84901b98c0 con 0x56378e500820 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52408/0 (socket says 172.21.15.31:52408) 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 -- 172.21.15.31:0/658081183 learned_addr learned my addr 172.21.15.31:0/658081183 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8496000640 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e500820 0x56378e4fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8495600640 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f0d90 0x56378e4faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 -- 172.21.15.31:0/658081183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e500820 msgr2=0x56378e4fb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e500820 0x56378e4fb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 -- 172.21.15.31:0/658081183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f0d90 msgr2=0x56378e4faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f0d90 0x56378e4faa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 -- 172.21.15.31:0/658081183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378e4f5f10 con 0x56378e4f68f0 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.399+0000 7f8494c00640 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56378e4fc790 tx=0x7f8488015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=793f0cbb4fbf6550 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.400+0000 7f8481c00640 1 -- 172.21.15.31:0/658081183 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488016a80 con 0x56378e4f68f0 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.400+0000 7f8481c00640 1 -- 172.21.15.31:0/658081183 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8488016c20 con 0x56378e4f68f0 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.400+0000 7f8481c00640 1 -- 172.21.15.31:0/658081183 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488025680 con 0x56378e4f68f0 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 -- 172.21.15.31:0/658081183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 msgr2=0x56378e4fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56378e4fc790 tx=0x7f8488015000 comp rx=0 tx=0).stop 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 -- 172.21.15.31:0/658081183 shutdown_connections 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e500820 0x56378e4fb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e4fb060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 --2- 172.21.15.31:0/658081183 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e4f0d90 0x56378e4faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.401+0000 7f849adee740 1 -- 172.21.15.31:0/658081183 >> 172.21.15.31:0/658081183 conn(0x56378e4b8f80 msgr2=0x56378e4f2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.402+0000 7f849adee740 1 -- 172.21.15.31:0/658081183 shutdown_connections 2024-06-02T22:38:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.402+0000 7f849adee740 1 -- 172.21.15.31:0/658081183 wait complete. 2024-06-02T22:38:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.403+0000 7f849adee740 1 -- start start 2024-06-02T22:38:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.403+0000 7f849adee740 1 Processor -- start 2024-06-02T22:38:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f849adee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f849adee740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f849adee740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e519a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f8495600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f8495600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57338/0 (socket says 172.21.15.31:57338) 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.404+0000 7f8494c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52422/0 (socket says 172.21.15.31:52422) 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f84901ba660 con 0x56378e500820 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8495600640 1 -- 172.21.15.31:0/1669822494 learned_addr learned my addr 172.21.15.31:0/1669822494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84901b9f90 con 0x56378e4f68f0 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f84901b71d0 con 0x56378e4f0d90 2024-06-02T22:38:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f849adee740 10 client.0 _ll_register_callbacks cb 0x7f8484005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 -- 172.21.15.31:0/1669822494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 msgr2=0x56378e518520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 -- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 msgr2=0x56378e519a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e519a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.405+0000 7f8494c00640 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378e51a010 con 0x56378e4f68f0 2024-06-02T22:38:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f8495600640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:38:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f8494c00640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56378e4e6da0 tx=0x7f8488009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591c09689aec93b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f8476a00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488034070 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8488016c20 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.406+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f848802e630 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f848802e830 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 10 client.25304 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56378e51b330 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8488016c20 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8488017a00 con 0x56378e4f68f0 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 10 client.25304 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 10 client.25304 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 20 client.25304 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e571fa0 0x56378e574390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 4 client.25304 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:38:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.407+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56378e45bea0 con 0x56378e571fa0 2024-06-02T22:38:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.408+0000 7f8495600640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e571fa0 0x56378e574390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.408+0000 7f8495600640 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e571fa0 0x56378e574390 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47659ffba43f4108 server_cookie=ead41e276cc2b0ee in_seq=0 out_seq=0 2024-06-02T22:38:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.408+0000 7f8476a00640 10 client.25304 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:14.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f8476a00640 1 -- 172.21.15.31:0/1669822494 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56378e45bea0 con 0x56378e571fa0 2024-06-02T22:38:14.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f8476a00640 10 client.25304 handle_command_reply: tid=0 2024-06-02T22:38:14.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 client.25304 shutdown 2024-06-02T22:38:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 msgr2=0x56378e518a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x56378e4e6da0 tx=0x7f8488009ab0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 shutdown_connections 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56378e571fa0 0x56378e574390 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56378e500820 0x56378e519a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56378e4f68f0 0x56378e518a60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 --2- 172.21.15.31:0/1669822494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56378e4f0d90 0x56378e518520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.450+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 >> 172.21.15.31:0/1669822494 conn(0x56378e4b8f80 msgr2=0x56378e4fb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.451+0000 7f8476a00640 0 client.25304 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.451+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 shutdown_connections 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.451+0000 7f849adee740 1 -- 172.21.15.31:0/1669822494 wait complete. 2024-06-02T22:38:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.451+0000 7f849adee740 20 client.25304 trim_cache size 0 max 16384 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.452+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 msgr2=0x7f84780a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.452+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 0x7f84780a5100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x56378e4f1fe0 tx=0x7f8488009540 comp rx=0 tx=0).stop 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.452+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 msgr2=0x7f84901adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.452+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f847c00d750 tx=0x7f847c00dc10 comp rx=0 tx=0).stop 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 shutdown_connections 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f84780a2c40 0x7f84780a5100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849010fce0 0x7f84901adf40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84901095b0 0x7f84901a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 --2- 172.21.15.31:0/295551994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8490072f10 0x7f84901a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.453+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 >> 172.21.15.31:0/295551994 conn(0x7f849006e840 msgr2=0x7f849010b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.454+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 shutdown_connections 2024-06-02T22:38:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:14.454+0000 7f8496a00640 1 -- 172.21.15.31:0/295551994 wait complete. 2024-06-02T22:38:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 50.0 s, 1730.2 tps, lat 56.978 ms stddev 65.187 2024-06-02T22:38:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:15 smithi098 ceph-mon[36750]: pgmap v549: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 647 op/s 2024-06-02T22:38:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:15 smithi178 ceph-mon[36614]: pgmap v549: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 647 op/s 2024-06-02T22:38:16.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:15 smithi031 ceph-mon[31767]: pgmap v549: 129 pgs: 129 active+clean; 972 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 647 op/s 2024-06-02T22:38:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:17 smithi098 ceph-mon[36750]: pgmap v550: 129 pgs: 129 active+clean; 979 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-06-02T22:38:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:17 smithi178 ceph-mon[36614]: pgmap v550: 129 pgs: 129 active+clean; 979 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-06-02T22:38:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:17 smithi031 ceph-mon[31767]: pgmap v550: 129 pgs: 129 active+clean; 979 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-06-02T22:38:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:19 smithi098 ceph-mon[36750]: pgmap v551: 129 pgs: 129 active+clean; 979 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 741 op/s 2024-06-02T22:38:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:19 smithi178 ceph-mon[36614]: pgmap v551: 129 pgs: 129 active+clean; 979 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 741 op/s 2024-06-02T22:38:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:19 smithi031 ceph-mon[31767]: pgmap v551: 129 pgs: 129 active+clean; 979 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 741 op/s 2024-06-02T22:38:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 55.0 s, 2353.8 tps, lat 42.585 ms stddev 52.931 2024-06-02T22:38:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:21 smithi098 ceph-mon[36750]: pgmap v552: 129 pgs: 129 active+clean; 979 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 780 op/s 2024-06-02T22:38:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:21 smithi178 ceph-mon[36614]: pgmap v552: 129 pgs: 129 active+clean; 979 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 780 op/s 2024-06-02T22:38:22.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:21 smithi031 ceph-mon[31767]: pgmap v552: 129 pgs: 129 active+clean; 979 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 780 op/s 2024-06-02T22:38:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:23 smithi098 ceph-mon[36750]: pgmap v553: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-06-02T22:38:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:23 smithi178 ceph-mon[36614]: pgmap v553: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-06-02T22:38:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:23 smithi031 ceph-mon[31767]: pgmap v553: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 745 op/s 2024-06-02T22:38:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 60.0 s, 2796.6 tps, lat 36.010 ms stddev 40.966 2024-06-02T22:38:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:25 smithi098 ceph-mon[36750]: pgmap v554: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 729 op/s 2024-06-02T22:38:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:25 smithi178 ceph-mon[36614]: pgmap v554: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 729 op/s 2024-06-02T22:38:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:25 smithi031 ceph-mon[31767]: pgmap v554: 129 pgs: 129 active+clean; 980 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 729 op/s 2024-06-02T22:38:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.661+0000 7f5639e00640 1 -- 172.21.15.31:0/1505387792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 msgr2=0x7f5634101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.661+0000 7f5639e00640 1 --2- 172.21.15.31:0/1505387792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 0x7f5634101870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f562c009ca0 tx=0x7f562c02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.662+0000 7f5639e00640 1 -- 172.21.15.31:0/1505387792 shutdown_connections 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.662+0000 7f5639e00640 1 --2- 172.21.15.31:0/1505387792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 0x7f5634101870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.662+0000 7f5639e00640 1 --2- 172.21.15.31:0/1505387792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f5634100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.662+0000 7f5639e00640 1 --2- 172.21.15.31:0/1505387792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56341000f0 0x7f5634100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.662+0000 7f5639e00640 1 -- 172.21.15.31:0/1505387792 >> 172.21.15.31:0/1505387792 conn(0x7f56340fbc90 msgr2=0x7f56340fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.663+0000 7f5639e00640 1 -- 172.21.15.31:0/1505387792 shutdown_connections 2024-06-02T22:38:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.663+0000 7f5639e00640 1 -- 172.21.15.31:0/1505387792 wait complete. 2024-06-02T22:38:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.664+0000 7f5639e00640 1 Processor -- start 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.664+0000 7f5639e00640 1 -- start start 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56341000f0 0x7f563419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 0x7f56341a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f563410f7b0 con 0x7f56341000f0 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f563410f630 con 0x7f56341013f0 2024-06-02T22:38:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5639e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f563410f930 con 0x7f5634100a50 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5633e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5633e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:36418/0 (socket says 172.21.15.31:36418) 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.665+0000 7f5633e00640 1 -- 172.21.15.31:0/4254684354 learned_addr learned my addr 172.21.15.31:0/4254684354 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.666+0000 7f5633e00640 1 -- 172.21.15.31:0/4254684354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 msgr2=0x7f56341a57f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.666+0000 7f5633e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 0x7f56341a57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.666+0000 7f5633e00640 1 -- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56341000f0 msgr2=0x7f563419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.666+0000 7f5633e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56341000f0 0x7f563419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.666+0000 7f5633e00640 1 -- 172.21.15.31:0/4254684354 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56341a5e60 con 0x7f5634100a50 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.667+0000 7f5633e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f562800b4a0 tx=0x7f562800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.667+0000 7f5631600640 1 -- 172.21.15.31:0/4254684354 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628014070 con 0x7f5634100a50 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.667+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56341a6150 con 0x7f5634100a50 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.667+0000 7f5631600640 1 -- 172.21.15.31:0/4254684354 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5628010af0 con 0x7f5634100a50 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.668+0000 7f5631600640 1 -- 172.21.15.31:0/4254684354 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628014070 con 0x7f5634100a50 2024-06-02T22:38:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.668+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56341a6770 con 0x7f5634100a50 2024-06-02T22:38:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.675+0000 7f563e1f5740 1 Processor -- start 2024-06-02T22:38:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 -- start start 2024-06-02T22:38:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 0x55bec80f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bec8052420 con 0x55bec80eed90 2024-06-02T22:38:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bec7ff9c50 con 0x55bec80f48f0 2024-06-02T22:38:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f563e1f5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bec804e3e0 con 0x55bec80ef780 2024-06-02T22:38:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.677+0000 7f5631600640 1 -- 172.21.15.31:0/4254684354 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f5628017070 con 0x7f5634100a50 2024-06-02T22:38:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.678+0000 7f5639400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.678+0000 7f5638a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.678+0000 7f5638a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:36426/0 (socket says 172.21.15.31:36426) 2024-06-02T22:38:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.678+0000 7f5638a00640 1 -- 172.21.15.31:0/2391591953 learned_addr learned my addr 172.21.15.31:0/2391591953 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5639400640 1 -- 172.21.15.31:0/2391591953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 msgr2=0x55bec80f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5633e00640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 0x55bec80f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5639400640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5639400640 1 -- 172.21.15.31:0/2391591953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 msgr2=0x55bec80f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5639400640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 0x55bec80f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5639400640 1 -- 172.21.15.31:0/2391591953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec7d66210 con 0x55bec80eed90 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.679+0000 7f5631600640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 0x7f561c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5639400640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80ef1b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f562c02ade0 tx=0x7f562c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396a6ae40d894b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5631600640 1 -- 172.21.15.31:0/4254684354 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f562800d040 con 0x7f5634100a50 2024-06-02T22:38:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5621c00640 1 -- 172.21.15.31:0/2391591953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c031650 con 0x55bec80eed90 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5621c00640 1 -- 172.21.15.31:0/2391591953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f562c03f070 con 0x55bec80eed90 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5638a00640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.680+0000 7f5633e00640 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 0x55bec80f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.681+0000 7f5621c00640 1 -- 172.21.15.31:0/2391591953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c004750 con 0x55bec80eed90 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.681+0000 7f5638a00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 0x7f561c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.682+0000 7f563e1f5740 1 -- 172.21.15.31:0/2391591953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 msgr2=0x55bec80ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.682+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80ef1b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f562c02ade0 tx=0x7f562c0098b0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f5638a00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 0x7f561c0a54d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55bec80efb80 tx=0x7f56240091c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f563e1f5740 1 -- 172.21.15.31:0/2391591953 shutdown_connections 2024-06-02T22:38:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80f48f0 0x55bec80f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80ef780 0x55bec80f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2391591953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80ef1b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.683+0000 7f563e1f5740 1 -- 172.21.15.31:0/2391591953 >> 172.21.15.31:0/2391591953 conn(0x55bec80b6f80 msgr2=0x55bec80ea810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.685+0000 7f563e1f5740 1 -- 172.21.15.31:0/2391591953 shutdown_connections 2024-06-02T22:38:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.685+0000 7f563e1f5740 1 -- 172.21.15.31:0/2391591953 wait complete. 2024-06-02T22:38:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.685+0000 7f563e1f5740 1 -- start start 2024-06-02T22:38:27.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.686+0000 7f563e1f5740 1 Processor -- start 2024-06-02T22:38:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 0x55bec80f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec81006d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bec80f7890 con 0x55bec80ef780 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bec800d0b0 con 0x55bec80eed90 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bec80f7a10 con 0x55bec80f48f0 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.687+0000 7f563e1f5740 10 client.0 _ll_register_callbacks cb 0x55bec7ff8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34572/0 (socket says 172.21.15.31:34572) 2024-06-02T22:38:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 -- 172.21.15.31:0/4000278204 learned_addr learned my addr 172.21.15.31:0/4000278204 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5633e00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 0x55bec80f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5639400640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec81006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 -- 172.21.15.31:0/4000278204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 msgr2=0x55bec81006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec81006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 -- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 msgr2=0x55bec80f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 0x55bec80f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 -- 172.21.15.31:0/4000278204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec7e32620 con 0x55bec80eed90 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5639400640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5633e00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 0x55bec80f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5638a00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5624015730 tx=0x7f5624004840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1766c582dac77a86 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.688+0000 7f5616000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624023020 con 0x55bec80eed90 2024-06-02T22:38:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f56240135c0 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f562c03f070 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f562402e050 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f563e1f5740 10 client.25310 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bec8103a20 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.689+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f562c03f070 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.690+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f562401e030 con 0x55bec80eed90 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 10 client.25310 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 10 client.25310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 20 client.25310 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec8105160 0x55bec81075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 4 client.25310 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:38:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.691+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bec805fb50 con 0x55bec8105160 2024-06-02T22:38:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.694+0000 7f5633e00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec8105160 0x55bec81075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.696+0000 7f5633e00640 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec8105160 0x55bec81075b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c6afb1a5584952 server_cookie=35aedf2500bd2a0f in_seq=0 out_seq=0 2024-06-02T22:38:27.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.696+0000 7f5616000640 10 client.25310 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.698+0000 7f5616000640 1 -- 172.21.15.31:0/4000278204 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bec805fb50 con 0x55bec8105160 2024-06-02T22:38:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.698+0000 7f5616000640 10 client.25310 handle_command_reply: tid=0 2024-06-02T22:38:27.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.698+0000 7f563e1f5740 1 client.25310 shutdown 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 msgr2=0x55bec80f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5624015730 tx=0x7f5624004840 comp rx=0 tx=0).stop 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 shutdown_connections 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec8105160 0x55bec81075b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80ef780 0x55bec80f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 --2- 172.21.15.31:0/4000278204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80eed90 0x55bec80f9150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 >> 172.21.15.31:0/4000278204 conn(0x55bec80b6f80 msgr2=0x55bec80e9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.700+0000 7f5616000640 0 client.25310 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:27.702 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.702+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 shutdown_connections 2024-06-02T22:38:27.702 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.702+0000 7f563e1f5740 1 -- 172.21.15.31:0/4000278204 wait complete. 2024-06-02T22:38:27.702 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.702+0000 7f563e1f5740 20 client.25310 trim_cache size 0 max 16384 2024-06-02T22:38:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 Processor -- start 2024-06-02T22:38:27.734 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 -- start start 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80eed90 0x55bec80f9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 0x55bec80ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f56341b0c90 con 0x55bec80f48f0 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56341b27d0 con 0x55bec80ef780 2024-06-02T22:38:27.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.734+0000 7f563e1f5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f56341b1360 con 0x55bec80eed90 2024-06-02T22:38:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34580/0 (socket says 172.21.15.31:34580) 2024-06-02T22:38:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 -- 172.21.15.31:0/2439380342 learned_addr learned my addr 172.21.15.31:0/2439380342 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:27.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5638a00640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80eed90 0x55bec80f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 -- 172.21.15.31:0/2439380342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80eed90 msgr2=0x55bec80f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80eed90 0x55bec80f9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5633e00640 1 -- 172.21.15.31:0/2439380342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 msgr2=0x55bec80ed750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.735+0000 7f5639400640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 0x55bec80ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.736+0000 7f5633e00640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 0x55bec80ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.736+0000 7f5633e00640 1 -- 172.21.15.31:0/2439380342 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec80f3e10 con 0x55bec80ef780 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.736+0000 7f5639400640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 0x55bec80ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.736+0000 7f5633e00640 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f562800f020 tx=0x7f5628085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704131c5cf5270a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.737+0000 7f5621200640 1 -- 172.21.15.31:0/2439380342 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562801e040 con 0x55bec80ef780 2024-06-02T22:38:27.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.737+0000 7f5621200640 1 -- 172.21.15.31:0/2439380342 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56280cbe50 con 0x55bec80ef780 2024-06-02T22:38:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.737+0000 7f5621200640 1 -- 172.21.15.31:0/2439380342 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628014040 con 0x55bec80ef780 2024-06-02T22:38:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 -- 172.21.15.31:0/2439380342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 msgr2=0x55bec8100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f562800f020 tx=0x7f5628085040 comp rx=0 tx=0).stop 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 -- 172.21.15.31:0/2439380342 shutdown_connections 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80f48f0 0x55bec80ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec8100690 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 --2- 172.21.15.31:0/2439380342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80eed90 0x55bec80f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 -- 172.21.15.31:0/2439380342 >> 172.21.15.31:0/2439380342 conn(0x55bec80b6f80 msgr2=0x55bec80f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.738+0000 7f563e1f5740 1 -- 172.21.15.31:0/2439380342 shutdown_connections 2024-06-02T22:38:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.739+0000 7f563e1f5740 1 -- 172.21.15.31:0/2439380342 wait complete. 2024-06-02T22:38:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.739+0000 7f563e1f5740 1 -- start start 2024-06-02T22:38:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.739+0000 7f563e1f5740 1 Processor -- start 2024-06-02T22:38:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80fdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec80fe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec80ff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f56341b2100 con 0x55bec80eed90 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56341b1a30 con 0x55bec80ef780 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f56341aec70 con 0x55bec80f48f0 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f563e1f5740 10 client.0 _ll_register_callbacks cb 0x7f56240094f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f5638a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f5638a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80fdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44790/0 (socket says 172.21.15.31:44790) 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f5638a00640 1 -- 172.21.15.31:0/13581499 learned_addr learned my addr 172.21.15.31:0/13581499 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:27.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.740+0000 7f5639400640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec80ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5633e00640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec80fe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5639400640 1 -- 172.21.15.31:0/13581499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 msgr2=0x55bec80fe220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5639400640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec80fe220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5639400640 1 -- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 msgr2=0x55bec80fdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5639400640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80fdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.741+0000 7f5639400640 1 -- 172.21.15.31:0/13581499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec80ff820 con 0x55bec80f48f0 2024-06-02T22:38:27.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.742+0000 7f5633e00640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec80fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:38:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.742+0000 7f5639400640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec80ff230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f562c02aeb0 tx=0x7f562c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5af845c7d77ae7b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.743+0000 7f5616000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:38:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.743+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c053060 con 0x55bec80f48f0 2024-06-02T22:38:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.743+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56280cbe50 con 0x55bec80f48f0 2024-06-02T22:38:27.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.743+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f562c04a030 con 0x55bec80f48f0 2024-06-02T22:38:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.743+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f562c053060 con 0x55bec80f48f0 2024-06-02T22:38:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 10 client.25321 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:27.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bec816fe90 con 0x55bec80f48f0 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56280cbe50 con 0x55bec80f48f0 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f562c02f6a0 con 0x55bec80f48f0 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 10 client.25321 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 10 client.25321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 20 client.25321 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec81701b0 0x55bec81725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 4 client.25321 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:38:27.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.744+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bec8059ea0 con 0x55bec81701b0 2024-06-02T22:38:27.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.746+0000 7f5638a00640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec81701b0 0x55bec81725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.747+0000 7f5638a00640 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec81701b0 0x55bec81725d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36e0d85c6bb69bd4 server_cookie=6be2df10c7bba32d in_seq=0 out_seq=0 2024-06-02T22:38:27.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.747+0000 7f5616000640 10 client.25321 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f5616000640 1 -- 172.21.15.31:0/13581499 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bec8059ea0 con 0x55bec81701b0 2024-06-02T22:38:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f5616000640 10 client.25321 handle_command_reply: tid=0 2024-06-02T22:38:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 client.25321 shutdown 2024-06-02T22:38:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 msgr2=0x55bec80ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec80ff230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f562c02aeb0 tx=0x7f562c003ba0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 shutdown_connections 2024-06-02T22:38:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bec81701b0 0x55bec81725d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bec80f48f0 0x55bec80ff230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bec80ef780 0x55bec80fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 --2- 172.21.15.31:0/13581499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bec80eed90 0x55bec80fdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 >> 172.21.15.31:0/13581499 conn(0x55bec80b6f80 msgr2=0x55bec80f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.771+0000 7f5616000640 0 client.25321 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.772+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 shutdown_connections 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.772+0000 7f563e1f5740 1 -- 172.21.15.31:0/13581499 wait complete. 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.772+0000 7f563e1f5740 20 client.25321 trim_cache size 0 max 16384 2024-06-02T22:38:27.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:38:27.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:38:27.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.773+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 msgr2=0x7f561c0a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.773+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 0x7f561c0a54d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55bec80efb80 tx=0x7f56240091c0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.773+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 msgr2=0x7f563419e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.773+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f562800b4a0 tx=0x7f562800b960 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 shutdown_connections 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f561c0a3010 0x7f561c0a54d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56341013f0 0x7f56341a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5634100a50 0x7f563419e780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 --2- 172.21.15.31:0/4254684354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56341000f0 0x7f563419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 >> 172.21.15.31:0/4254684354 conn(0x7f56340fbc90 msgr2=0x7f56340fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.774+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 shutdown_connections 2024-06-02T22:38:27.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:27.775+0000 7f5639e00640 1 -- 172.21.15.31:0/4254684354 wait complete. 2024-06-02T22:38:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:27 smithi098 ceph-mon[36750]: pgmap v555: 129 pgs: 129 active+clean; 980 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-06-02T22:38:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:27 smithi178 ceph-mon[36614]: pgmap v555: 129 pgs: 129 active+clean; 980 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-06-02T22:38:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:27 smithi031 ceph-mon[31767]: pgmap v555: 129 pgs: 129 active+clean; 980 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 853 op/s 2024-06-02T22:38:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:29 smithi178 ceph-mon[36614]: pgmap v556: 129 pgs: 129 active+clean; 980 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.9 MiB/s wr, 705 op/s 2024-06-02T22:38:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:29 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:38:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:29 smithi031 ceph-mon[31767]: pgmap v556: 129 pgs: 129 active+clean; 980 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.9 MiB/s wr, 705 op/s 2024-06-02T22:38:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:29 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:38:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:29 smithi098 ceph-mon[36750]: pgmap v556: 129 pgs: 129 active+clean; 980 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.9 MiB/s wr, 705 op/s 2024-06-02T22:38:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:29 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:38:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 65.0 s, 1946.8 tps, lat 50.643 ms stddev 60.743 2024-06-02T22:38:31.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:38:31.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:38:31.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:30 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:38:31.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:38:31.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:38:31.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:30 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:38:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:38:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:38:31.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:30 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:38:32.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:31 smithi178 ceph-mon[36614]: pgmap v557: 129 pgs: 129 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-06-02T22:38:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:31 smithi031 ceph-mon[31767]: pgmap v557: 129 pgs: 129 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-06-02T22:38:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:31 smithi098 ceph-mon[36750]: pgmap v557: 129 pgs: 129 active+clean; 996 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 799 op/s 2024-06-02T22:38:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:33 smithi178 ceph-mon[36614]: pgmap v558: 129 pgs: 129 active+clean; 997 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 744 op/s 2024-06-02T22:38:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:33 smithi031 ceph-mon[31767]: pgmap v558: 129 pgs: 129 active+clean; 997 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 744 op/s 2024-06-02T22:38:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:33 smithi098 ceph-mon[36750]: pgmap v558: 129 pgs: 129 active+clean; 997 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 744 op/s 2024-06-02T22:38:35.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 70.0 s, 1452.2 tps, lat 69.411 ms stddev 82.404 2024-06-02T22:38:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:35 smithi178 ceph-mon[36614]: pgmap v559: 129 pgs: 129 active+clean; 997 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 634 op/s 2024-06-02T22:38:36.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:35 smithi031 ceph-mon[31767]: pgmap v559: 129 pgs: 129 active+clean; 997 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 634 op/s 2024-06-02T22:38:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:35 smithi098 ceph-mon[36750]: pgmap v559: 129 pgs: 129 active+clean; 997 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.5 MiB/s wr, 634 op/s 2024-06-02T22:38:38.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:37 smithi178 ceph-mon[36614]: pgmap v560: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 753 op/s 2024-06-02T22:38:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:37 smithi031 ceph-mon[31767]: pgmap v560: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 753 op/s 2024-06-02T22:38:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:37 smithi098 ceph-mon[36750]: pgmap v560: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 753 op/s 2024-06-02T22:38:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:39 smithi178 ceph-mon[36614]: pgmap v561: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.9 MiB/s wr, 625 op/s 2024-06-02T22:38:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:39 smithi031 ceph-mon[31767]: pgmap v561: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.9 MiB/s wr, 625 op/s 2024-06-02T22:38:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:39 smithi098 ceph-mon[36750]: pgmap v561: 129 pgs: 129 active+clean; 998 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.9 MiB/s wr, 625 op/s 2024-06-02T22:38:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 75.0 s, 1680.0 tps, lat 59.417 ms stddev 73.640 2024-06-02T22:38:40.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 -- 172.21.15.31:0/2557574185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 msgr2=0x7f9900110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:40.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 --2- 172.21.15.31:0/2557574185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f9900110420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009be0 tx=0x7f98f802a750 comp rx=0 tx=0).stop 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 -- 172.21.15.31:0/2557574185 shutdown_connections 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 --2- 172.21.15.31:0/2557574185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f9900110420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 --2- 172.21.15.31:0/2557574185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f9900074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 --2- 172.21.15.31:0/2557574185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9900075980 0x7f9900073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 -- 172.21.15.31:0/2557574185 >> 172.21.15.31:0/2557574185 conn(0x7f99000fcf70 msgr2=0x7f99000ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 -- 172.21.15.31:0/2557574185 shutdown_connections 2024-06-02T22:38:40.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.978+0000 7f9906600640 1 -- 172.21.15.31:0/2557574185 wait complete. 2024-06-02T22:38:40.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.980+0000 7f9906600640 1 Processor -- start 2024-06-02T22:38:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 -- start start 2024-06-02T22:38:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9900075980 0x7f990019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9900113cf0 con 0x7f9900075980 2024-06-02T22:38:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9900113b70 con 0x7f99000743a0 2024-06-02T22:38:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.982+0000 7f9906600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9900113e70 con 0x7f990010e030 2024-06-02T22:38:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:36652/0 (socket says 172.21.15.31:36652) 2024-06-02T22:38:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50436/0 (socket says 172.21.15.31:50436) 2024-06-02T22:38:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 -- 172.21.15.31:0/3828890282 learned_addr learned my addr 172.21.15.31:0/3828890282 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 -- 172.21.15.31:0/3828890282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 msgr2=0x7f99001a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 -- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9900075980 msgr2=0x7f990019e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9900075980 0x7f990019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ff400640 1 -- 172.21.15.31:0/3828890282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99001a5cc0 con 0x7f99000743a0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.983+0000 7f98ffe00640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f98ff400640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c920 tx=0x7f98f000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f98f7e00640 1 -- 172.21.15.31:0/3828890282 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0007c70 con 0x7f99000743a0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f98f7e00640 1 -- 172.21.15.31:0/3828890282 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f0007e10 con 0x7f99000743a0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f98f7e00640 1 -- 172.21.15.31:0/3828890282 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00189a0 con 0x7f99000743a0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99001a5fb0 con 0x7f99000743a0 2024-06-02T22:38:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.984+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99001a6420 con 0x7f99000743a0 2024-06-02T22:38:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.991+0000 7f98f7e00640 1 -- 172.21.15.31:0/3828890282 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f98f0018b40 con 0x7f99000743a0 2024-06-02T22:38:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.993+0000 7f98f7e00640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 0x7f98e40a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.994+0000 7f98f7e00640 1 -- 172.21.15.31:0/3828890282 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f98f00cf490 con 0x7f99000743a0 2024-06-02T22:38:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.994+0000 7f98fea00640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 0x7f98e40a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:40.996+0000 7f98fea00640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 0x7f98e40a51d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005ab0 tx=0x7f98e8005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.001+0000 7f9909426740 1 Processor -- start 2024-06-02T22:38:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.001+0000 7f9909426740 1 -- start start 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.002+0000 7f9909426740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd449bd0 0x5583cd449ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.002+0000 7f9909426740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44a5c0 0x5583cd44f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f9909426740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f9909426740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583cd3ad420 con 0x5583cd449bd0 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f9909426740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5583cd354c50 con 0x5583cd44f730 2024-06-02T22:38:41.003 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f9909426740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5583cd3a93e0 con 0x5583cd44a5c0 2024-06-02T22:38:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f98ffe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:36660/0 (socket says 172.21.15.31:36660) 2024-06-02T22:38:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f98ffe00640 1 -- 172.21.15.31:0/79885135 learned_addr learned my addr 172.21.15.31:0/79885135 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:41.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.003+0000 7f98fea00640 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44a5c0 0x5583cd44f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.004+0000 7f98ffe00640 1 -- 172.21.15.31:0/79885135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44a5c0 msgr2=0x5583cd44f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.004+0000 7f98ffe00640 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44a5c0 0x5583cd44f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.004+0000 7f98ffe00640 1 -- 172.21.15.31:0/79885135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd449bd0 msgr2=0x5583cd449ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.004+0000 7f98ffe00640 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd449bd0 0x5583cd449ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.004+0000 7f98ffe00640 1 -- 172.21.15.31:0/79885135 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cd0c1210 con 0x5583cd44f730 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.005+0000 7f98ffe00640 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f98f802ad40 tx=0x7f98f8030b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8148622569279dd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.005+0000 7f98f4c00640 1 -- 172.21.15.31:0/79885135 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8041030 con 0x5583cd44f730 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.005+0000 7f98f4c00640 1 -- 172.21.15.31:0/79885135 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8003e50 con 0x5583cd44f730 2024-06-02T22:38:41.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.005+0000 7f98f4c00640 1 -- 172.21.15.31:0/79885135 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8036040 con 0x5583cd44f730 2024-06-02T22:38:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 -- 172.21.15.31:0/79885135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 msgr2=0x5583cd451bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f98f802ad40 tx=0x7f98f8030b20 comp rx=0 tx=0).stop 2024-06-02T22:38:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 -- 172.21.15.31:0/79885135 shutdown_connections 2024-06-02T22:38:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44f730 0x5583cd451bc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44a5c0 0x5583cd44f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 --2- 172.21.15.31:0/79885135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd449bd0 0x5583cd449ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.006+0000 7f9909426740 1 -- 172.21.15.31:0/79885135 >> 172.21.15.31:0/79885135 conn(0x5583cd411f80 msgr2=0x5583cd445650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.008+0000 7f9909426740 1 -- 172.21.15.31:0/79885135 shutdown_connections 2024-06-02T22:38:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.008+0000 7f9909426740 1 -- 172.21.15.31:0/79885135 wait complete. 2024-06-02T22:38:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.008+0000 7f9909426740 1 -- start start 2024-06-02T22:38:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.009+0000 7f9909426740 1 Processor -- start 2024-06-02T22:38:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd44f730 0x5583cd45b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5583cd452680 con 0x5583cd44f730 2024-06-02T22:38:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5583cd3680b0 con 0x5583cd44a5c0 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5583cd452800 con 0x5583cd449bd0 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.011+0000 7f9909426740 10 client.0 _ll_register_callbacks cb 0x5583cd353f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98ff400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:36662/0 (socket says 172.21.15.31:36662) 2024-06-02T22:38:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 -- 172.21.15.31:0/484272319 learned_addr learned my addr 172.21.15.31:0/484272319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 -- 172.21.15.31:0/484272319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd449bd0 msgr2=0x5583cd453f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 -- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd44f730 msgr2=0x5583cd45b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.012+0000 7f98fea00640 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd44f730 0x5583cd45b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.013+0000 7f98fea00640 1 -- 172.21.15.31:0/484272319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583cd18d620 con 0x5583cd44a5c0 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.013+0000 7f98fea00640 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98e800ec90 tx=0x7f98e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a632eb81993e0f9a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.013+0000 7f98ed600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.015+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8022070 con 0x5583cd44a5c0 2024-06-02T22:38:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.015+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f98e8010430 con 0x5583cd44a5c0 2024-06-02T22:38:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.015+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f8003e50 con 0x5583cd44a5c0 2024-06-02T22:38:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.016+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f98e802e050 con 0x5583cd44a5c0 2024-06-02T22:38:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.017+0000 7f9909426740 10 client.25325 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.017+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583cd45e870 con 0x5583cd44a5c0 2024-06-02T22:38:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.018+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8003e50 con 0x5583cd44a5c0 2024-06-02T22:38:41.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.019+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f98e801e840 con 0x5583cd44a5c0 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.019+0000 7f9909426740 10 client.25325 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.020+0000 7f9909426740 10 client.25325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.020+0000 7f9909426740 20 client.25325 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.020+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd45ff60 0x5583cd462350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.020+0000 7f9909426740 4 client.25325 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:38:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.020+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583cd3bab50 con 0x5583cd45ff60 2024-06-02T22:38:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.021+0000 7f98ff400640 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd45ff60 0x5583cd462350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.023+0000 7f98ff400640 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd45ff60 0x5583cd462350 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5955aa0ca8f0aee server_cookie=c949d26df6087cc2 in_seq=0 out_seq=0 2024-06-02T22:38:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.023+0000 7f98ed600640 10 client.25325 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.025+0000 7f98ed600640 1 -- 172.21.15.31:0/484272319 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5583cd3bab50 con 0x5583cd45ff60 2024-06-02T22:38:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.025+0000 7f98ed600640 10 client.25325 handle_command_reply: tid=0 2024-06-02T22:38:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.026+0000 7f9909426740 1 client.25325 shutdown 2024-06-02T22:38:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.026+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 msgr2=0x5583cd454450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.026+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f98e800ec90 tx=0x7f98e80046c0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 shutdown_connections 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd45ff60 0x5583cd462350 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd44f730 0x5583cd45b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd44a5c0 0x5583cd454450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 --2- 172.21.15.31:0/484272319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f98ed600640 0 client.25325 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 >> 172.21.15.31:0/484272319 conn(0x5583cd411f80 msgr2=0x5583cd444810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 shutdown_connections 2024-06-02T22:38:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 1 -- 172.21.15.31:0/484272319 wait complete. 2024-06-02T22:38:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.027+0000 7f9909426740 20 client.25325 trim_cache size 0 max 16384 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 Processor -- start 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 -- start start 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd45b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd44b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99001b0ab0 con 0x5583cd454450 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99001b25f0 con 0x5583cd449bd0 2024-06-02T22:38:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.060+0000 7f9909426740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99001b1180 con 0x5583cd44f730 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98fea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd45b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98fea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd45b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50464/0 (socket says 172.21.15.31:50464) 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98fea00640 1 -- 172.21.15.31:0/2254119966 learned_addr learned my addr 172.21.15.31:0/2254119966 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ffe00640 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd44b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 -- 172.21.15.31:0/2254119966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 msgr2=0x5583cd45b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd45b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 -- 172.21.15.31:0/2254119966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 msgr2=0x5583cd44b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd44b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.061+0000 7f98ff400640 1 -- 172.21.15.31:0/2254119966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cd446300 con 0x5583cd449bd0 2024-06-02T22:38:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.063+0000 7f98ff400640 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5583cd44ae20 tx=0x7f98f0005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22856016bab9f0b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.063+0000 7f98efe00640 1 -- 172.21.15.31:0/2254119966 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0099a00 con 0x5583cd449bd0 2024-06-02T22:38:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.063+0000 7f98efe00640 1 -- 172.21.15.31:0/2254119966 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f0099c60 con 0x5583cd449bd0 2024-06-02T22:38:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.063+0000 7f98efe00640 1 -- 172.21.15.31:0/2254119966 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00a4140 con 0x5583cd449bd0 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.064+0000 7f9909426740 1 -- 172.21.15.31:0/2254119966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 msgr2=0x5583cd453f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5583cd44ae20 tx=0x7f98f0005e40 comp rx=0 tx=0).stop 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 -- 172.21.15.31:0/2254119966 shutdown_connections 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd44b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd45b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 --2- 172.21.15.31:0/2254119966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd453f10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 -- 172.21.15.31:0/2254119966 >> 172.21.15.31:0/2254119966 conn(0x5583cd411f80 msgr2=0x5583cd4450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 -- 172.21.15.31:0/2254119966 shutdown_connections 2024-06-02T22:38:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 -- 172.21.15.31:0/2254119966 wait complete. 2024-06-02T22:38:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.065+0000 7f9909426740 1 -- start start 2024-06-02T22:38:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 Processor -- start 2024-06-02T22:38:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd458b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd459b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99001b1f20 con 0x5583cd454450 2024-06-02T22:38:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99001b1850 con 0x5583cd449bd0 2024-06-02T22:38:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99001aea90 con 0x5583cd44f730 2024-06-02T22:38:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.066+0000 7f9909426740 10 client.0 _ll_register_callbacks cb 0x7f98e8014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:36680/0 (socket says 172.21.15.31:36680) 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 -- 172.21.15.31:0/4002971379 learned_addr learned my addr 172.21.15.31:0/4002971379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98fea00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd458b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ffe00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd459b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 -- 172.21.15.31:0/4002971379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 msgr2=0x5583cd458b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd458b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 -- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 msgr2=0x5583cd459b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd459b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.067+0000 7f98ff400640 1 -- 172.21.15.31:0/4002971379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583cd45a140 con 0x5583cd449bd0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98ff400640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98f0098330 tx=0x7f98f00a4690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66231b9f7d4a4b9e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98ed600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0099a00 con 0x5583cd449bd0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f98f000fba0 con 0x5583cd449bd0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98ffe00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd459b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f98fea00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd458b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.068+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f0099c60 con 0x5583cd449bd0 2024-06-02T22:38:41.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.069+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f98f0097fd0 con 0x5583cd449bd0 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.069+0000 7f9909426740 10 client.25331 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.069+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5583cd45b450 con 0x5583cd449bd0 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f0099c60 con 0x5583cd449bd0 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f98f00860b0 con 0x5583cd449bd0 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 10 client.25331 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 10 client.25331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 20 client.25331 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:41.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd4caf80 0x5583cd4cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 4 client.25331 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:38:41.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.070+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583cd3b4ea0 con 0x5583cd4caf80 2024-06-02T22:38:41.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.072+0000 7f98fea00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd4caf80 0x5583cd4cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:41.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.074+0000 7f98fea00640 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd4caf80 0x5583cd4cd3a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7dcb93f989cdb3c server_cookie=e145dca6de1eb4d6 in_seq=0 out_seq=0 2024-06-02T22:38:41.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.074+0000 7f98ed600640 10 client.25331 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.100+0000 7f98ed600640 1 -- 172.21.15.31:0/4002971379 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5583cd3b4ea0 con 0x5583cd4caf80 2024-06-02T22:38:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.100+0000 7f98ed600640 10 client.25331 handle_command_reply: tid=0 2024-06-02T22:38:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.100+0000 7f9909426740 1 client.25331 shutdown 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 msgr2=0x5583cd458600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f98f0098330 tx=0x7f98f00a4690 comp rx=0 tx=0).stop 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 shutdown_connections 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5583cd4caf80 0x5583cd4cd3a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5583cd454450 0x5583cd459b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5583cd44f730 0x5583cd458b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 --2- 172.21.15.31:0/4002971379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583cd449bd0 0x5583cd458600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 >> 172.21.15.31:0/4002971379 conn(0x5583cd411f80 msgr2=0x5583cd44b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f98ed600640 0 client.25331 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.101+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 shutdown_connections 2024-06-02T22:38:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.102+0000 7f9909426740 1 -- 172.21.15.31:0/4002971379 wait complete. 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.102+0000 7f9909426740 20 client.25331 trim_cache size 0 max 16384 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 msgr2=0x7f98e40a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 0x7f98e40a51d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005ab0 tx=0x7f98e8005a20 comp rx=0 tx=0).stop 2024-06-02T22:38:41.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 msgr2=0x7f990019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c920 tx=0x7f98f000cde0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 shutdown_connections 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f98e40a2d10 0x7f98e40a51d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f990010e030 0x7f99001a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9900075980 0x7f990019e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 --2- 172.21.15.31:0/3828890282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99000743a0 0x7f990019e0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 >> 172.21.15.31:0/3828890282 conn(0x7f99000fcf70 msgr2=0x7f9900101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.103+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 shutdown_connections 2024-06-02T22:38:41.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:41.104+0000 7f9906600640 1 -- 172.21.15.31:0/3828890282 wait complete. 2024-06-02T22:38:42.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:41 smithi178 ceph-mon[36614]: pgmap v562: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 725 op/s 2024-06-02T22:38:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:41 smithi031 ceph-mon[31767]: pgmap v562: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 725 op/s 2024-06-02T22:38:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:41 smithi098 ceph-mon[36750]: pgmap v562: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 725 op/s 2024-06-02T22:38:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:43 smithi178 ceph-mon[36614]: pgmap v563: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-06-02T22:38:44.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:43 smithi031 ceph-mon[31767]: pgmap v563: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-06-02T22:38:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:43 smithi098 ceph-mon[36750]: pgmap v563: 129 pgs: 129 active+clean; 998 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 643 op/s 2024-06-02T22:38:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 80.0 s, 1644.8 tps, lat 60.818 ms stddev 82.200 2024-06-02T22:38:46.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:45 smithi178 ceph-mon[36614]: pgmap v564: 129 pgs: 129 active+clean; 998 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-06-02T22:38:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:45 smithi031 ceph-mon[31767]: pgmap v564: 129 pgs: 129 active+clean; 998 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-06-02T22:38:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:45 smithi098 ceph-mon[36750]: pgmap v564: 129 pgs: 129 active+clean; 998 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 8.6 MiB/s wr, 689 op/s 2024-06-02T22:38:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:47 smithi178 ceph-mon[36614]: pgmap v565: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-06-02T22:38:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:47 smithi031 ceph-mon[31767]: pgmap v565: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-06-02T22:38:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:47 smithi098 ceph-mon[36750]: pgmap v565: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 880 op/s 2024-06-02T22:38:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:49 smithi178 ceph-mon[36614]: pgmap v566: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T22:38:50.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:49 smithi031 ceph-mon[31767]: pgmap v566: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T22:38:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:49 smithi098 ceph-mon[36750]: pgmap v566: 129 pgs: 129 active+clean; 1000 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 789 op/s 2024-06-02T22:38:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 85.0 s, 1928.2 tps, lat 52.106 ms stddev 64.297 2024-06-02T22:38:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:51 smithi178 ceph-mon[36614]: pgmap v567: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-06-02T22:38:52.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:51 smithi031 ceph-mon[31767]: pgmap v567: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-06-02T22:38:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:51 smithi098 ceph-mon[36750]: pgmap v567: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-06-02T22:38:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:53 smithi178 ceph-mon[36614]: pgmap v568: 129 pgs: 129 active+clean; 1016 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-06-02T22:38:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:53 smithi031 ceph-mon[31767]: pgmap v568: 129 pgs: 129 active+clean; 1016 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-06-02T22:38:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:53 smithi098 ceph-mon[36750]: pgmap v568: 129 pgs: 129 active+clean; 1016 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 843 op/s 2024-06-02T22:38:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.308+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3282729290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be80990f0 msgr2=0x7f4be8099570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.308+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3282729290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be80990f0 0x7f4be8099570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009900 tx=0x7f4bdc02a420 comp rx=0 tx=0).stop 2024-06-02T22:38:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.309+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3282729290 shutdown_connections 2024-06-02T22:38:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.309+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3282729290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8099ab0 0x7f4be80a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.309+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3282729290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be80990f0 0x7f4be8099570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.309+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3282729290 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be8097f20 0x7f4be8098360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.309+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3282729290 >> 172.21.15.31:0/3282729290 conn(0x7f4be80934e0 msgr2=0x7f4be8095920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.310+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3282729290 shutdown_connections 2024-06-02T22:38:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.310+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3282729290 wait complete. 2024-06-02T22:38:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 Processor -- start 2024-06-02T22:38:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 -- start start 2024-06-02T22:38:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 0x7f4be812e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be80990f0 0x7f4be812e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4be80a3c20 con 0x7f4be8097f20 2024-06-02T22:38:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4be80a3aa0 con 0x7f4be80990f0 2024-06-02T22:38:54.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.312+0000 7f4bf5c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4be80a3da0 con 0x7f4be8099ab0 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.313+0000 7f4bf5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.313+0000 7f4bf5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40788/0 (socket says 172.21.15.31:40788) 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.313+0000 7f4bf5200640 1 -- 172.21.15.31:0/3302538062 learned_addr learned my addr 172.21.15.31:0/3302538062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.313+0000 7f4befe00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 0x7f4be812e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.313+0000 7f4bef400640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be80990f0 0x7f4be812e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 -- 172.21.15.31:0/3302538062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 msgr2=0x7f4be8135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 -- 172.21.15.31:0/3302538062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be80990f0 msgr2=0x7f4be812e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be80990f0 0x7f4be812e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 -- 172.21.15.31:0/3302538062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be8135ea0 con 0x7f4be8097f20 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4bf5200640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.314+0000 7f4befe00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 0x7f4be812e280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4be400e9c0 tx=0x7f4be400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.315+0000 7f4becc00640 1 -- 172.21.15.31:0/3302538062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be400ccc0 con 0x7f4be8097f20 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.315+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be8136190 con 0x7f4be8097f20 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.315+0000 7f4becc00640 1 -- 172.21.15.31:0/3302538062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be40035f0 con 0x7f4be8097f20 2024-06-02T22:38:54.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.315+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be8136700 con 0x7f4be8097f20 2024-06-02T22:38:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.315+0000 7f4becc00640 1 -- 172.21.15.31:0/3302538062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be400ce60 con 0x7f4be8097f20 2024-06-02T22:38:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.322+0000 7f4bfa1b4740 1 Processor -- start 2024-06-02T22:38:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.322+0000 7f4bfa1b4740 1 -- start start 2024-06-02T22:38:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.323+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365c8f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.323+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8ffb0 0x565365c94ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.323+0000 7f4becc00640 1 -- 172.21.15.31:0/3302538062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f4be4010670 con 0x7f4be8097f20 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.323+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 0x565365c975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565365bea420 con 0x565365c8f5c0 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565365b91c50 con 0x565365c95120 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565365be63e0 con 0x565365c8ffb0 2024-06-02T22:38:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bf5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365c8f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bf5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365c8f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41024/0 (socket says 172.21.15.31:41024) 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bf5200640 1 -- 172.21.15.31:0/2118808196 learned_addr learned my addr 172.21.15.31:0/2118808196 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 0x565365c975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 -- 172.21.15.31:0/2118808196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8ffb0 msgr2=0x565365c94ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8ffb0 0x565365c94ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 -- 172.21.15.31:0/2118808196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 msgr2=0x565365c8f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365c8f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.324+0000 7f4bef400640 1 -- 172.21.15.31:0/2118808196 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653658fe210 con 0x565365c95120 2024-06-02T22:38:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.325+0000 7f4bef400640 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 0x565365c975b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009230 tx=0x7f4bdc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9f3e4cb6eb858 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.325+0000 7f4be1600640 1 -- 172.21.15.31:0/2118808196 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc0048c0 con 0x565365c95120 2024-06-02T22:38:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.325+0000 7f4be1600640 1 -- 172.21.15.31:0/2118808196 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc0054e0 con 0x565365c95120 2024-06-02T22:38:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.325+0000 7f4be1600640 1 -- 172.21.15.31:0/2118808196 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc031ca0 con 0x565365c95120 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.325+0000 7f4becc00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 0x7f4bd80a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.326+0000 7f4becc00640 1 -- 172.21.15.31:0/3302538062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4be40cf7e0 con 0x7f4be8097f20 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.326+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/2118808196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 msgr2=0x565365c975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.326+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 0x565365c975b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009230 tx=0x7f4bdc000bc0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.326+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/2118808196 shutdown_connections 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.327+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c95120 0x565365c975b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.327+0000 7f4bf5200640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 0x7f4bd80a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.327+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8ffb0 0x565365c94ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.327+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/2118808196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365c8f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.327+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/2118808196 >> 172.21.15.31:0/2118808196 conn(0x565365c4ef80 msgr2=0x565365c8b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.328+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/2118808196 shutdown_connections 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.328+0000 7f4bf5200640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 0x7f4bd80a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x565365c90810 tx=0x7f4bf004fe60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.329+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/2118808196 wait complete. 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.329+0000 7f4bfa1b4740 1 -- start start 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 Processor -- start 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 0x565365c998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c95120 0x565365ca0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x565365c98070 con 0x565365c95120 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565365ba50b0 con 0x565365c8ffb0 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.330+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565365c981f0 con 0x565365c8f5c0 2024-06-02T22:38:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4bfa1b4740 10 client.0 _ll_register_callbacks cb 0x565365b90f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4bef400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 0x565365c998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4bef400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60134/0 (socket says 172.21.15.31:60134) 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4bef400640 1 -- 172.21.15.31:0/588361732 learned_addr learned my addr 172.21.15.31:0/588361732 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 -- 172.21.15.31:0/588361732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 msgr2=0x565365c99e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 -- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c95120 msgr2=0x565365ca0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c95120 0x565365ca0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.331+0000 7f4befe00640 1 -- 172.21.15.31:0/588361732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653659ca620 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4befe00640 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 0x565365c998c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x565365c90a20 tx=0x7f4be409c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23f4b1c69be0fc4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bd6000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40a4920 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4be4098320 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc0054e0 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4be40037a0 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bfa1b4740 10 client.25348 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.332+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565365ca4220 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4be4003940 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4be409ad70 con 0x565365c8f5c0 2024-06-02T22:38:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 10 client.25348 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 10 client.25348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 20 client.25348 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365ca5960 0x565365ca7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 4 client.25348 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.333+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4bdc0054e0 con 0x565365ca5960 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.334+0000 7f4bef400640 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365ca5960 0x565365ca7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.335+0000 7f4bef400640 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365ca5960 0x565365ca7d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c93474820181a5 server_cookie=bb29a043e70decd4 in_seq=0 out_seq=0 2024-06-02T22:38:54.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.335+0000 7f4bd6000640 10 client.25348 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:54.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.336+0000 7f4bd6000640 1 -- 172.21.15.31:0/588361732 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f4bdc0054e0 con 0x565365ca5960 2024-06-02T22:38:54.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.336+0000 7f4bd6000640 10 client.25348 handle_command_reply: tid=0 2024-06-02T22:38:54.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.336+0000 7f4bfa1b4740 1 client.25348 shutdown 2024-06-02T22:38:54.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.337+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 msgr2=0x565365c998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.337+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 0x565365c998c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x565365c90a20 tx=0x7f4be409c4f0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.337+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 shutdown_connections 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.337+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365ca5960 0x565365ca7d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.338+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c95120 0x565365ca0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.338+0000 7f4bd6000640 0 client.25348 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.338+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.338+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/588361732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c8f5c0 0x565365c998c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.338+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 >> 172.21.15.31:0/588361732 conn(0x565365c4ef80 msgr2=0x565365c81970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.339+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 shutdown_connections 2024-06-02T22:38:54.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.340+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/588361732 wait complete. 2024-06-02T22:38:54.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.341+0000 7f4bfa1b4740 20 client.25348 trim_cache size 0 max 16384 2024-06-02T22:38:54.370 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.371+0000 7f4bfa1b4740 1 Processor -- start 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.371+0000 7f4bfa1b4740 1 -- start start 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.371+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.371+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813c700 con 0x565365c8f5c0 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813e240 con 0x565365c8ffb0 2024-06-02T22:38:54.371 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813cdd0 con 0x565365c4ef80 2024-06-02T22:38:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4befe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4befe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40802/0 (socket says 172.21.15.31:40802) 2024-06-02T22:38:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4befe00640 1 -- 172.21.15.31:0/637934041 learned_addr learned my addr 172.21.15.31:0/637934041 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:54.372 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41054/0 (socket says 172.21.15.31:41054) 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bf5200640 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 -- 172.21.15.31:0/637934041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 msgr2=0x565365c98ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 -- 172.21.15.31:0/637934041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 msgr2=0x565365c99420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4bef400640 1 -- 172.21.15.31:0/637934041 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565365c8bcf0 con 0x565365c8f5c0 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.372+0000 7f4befe00640 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:38:54.373 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.373+0000 7f4bef400640 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc004fa0 tx=0x7f4bdc004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c64efa11bcdaa6f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.374 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.374+0000 7f4be0c00640 1 -- 172.21.15.31:0/637934041 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc055070 con 0x565365c8f5c0 2024-06-02T22:38:54.374 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.374+0000 7f4be0c00640 1 -- 172.21.15.31:0/637934041 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc0054b0 con 0x565365c8f5c0 2024-06-02T22:38:54.374 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.374+0000 7f4be0c00640 1 -- 172.21.15.31:0/637934041 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc031be0 con 0x565365c8f5c0 2024-06-02T22:38:54.375 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/637934041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 msgr2=0x565365ca0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.375 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc004fa0 tx=0x7f4bdc004c50 comp rx=0 tx=0).stop 2024-06-02T22:38:54.375 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/637934041 shutdown_connections 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8ffb0 0x565365c99420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8f5c0 0x565365ca0dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/637934041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c98ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.376+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/637934041 >> 172.21.15.31:0/637934041 conn(0x565365c90bb0 msgr2=0x565365c8e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.377+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/637934041 shutdown_connections 2024-06-02T22:38:54.376 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.377+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/637934041 wait complete. 2024-06-02T22:38:54.377 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.378+0000 7f4bfa1b4740 1 -- start start 2024-06-02T22:38:54.377 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.378+0000 7f4bfa1b4740 1 Processor -- start 2024-06-02T22:38:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.378 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8f5c0 0x565365c9e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 0x565365c9f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813db70 con 0x565365c8ffb0 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813d4a0 con 0x565365c8f5c0 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4be813a720 con 0x565365c4ef80 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bfa1b4740 10 client.0 _ll_register_callbacks cb 0x7f4be4097830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4befe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.379 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4befe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40814/0 (socket says 172.21.15.31:40814) 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4befe00640 1 -- 172.21.15.31:0/22570115 learned_addr learned my addr 172.21.15.31:0/22570115 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bf5200640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 0x565365c9f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.379+0000 7f4bef400640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8f5c0 0x565365c9e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 -- 172.21.15.31:0/22570115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8f5c0 msgr2=0x565365c9e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8f5c0 0x565365c9e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 -- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 msgr2=0x565365c9f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 0x565365c9f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 -- 172.21.15.31:0/22570115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565365c9fbd0 con 0x565365c4ef80 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4bf5200640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 0x565365c9f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4befe00640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4be409c560 tx=0x7f4be409ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f94a4d6e151d7da4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:38:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4bd6000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be409b610 con 0x565365c4ef80 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4be409ab70 con 0x565365c4ef80 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.380+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bdc0054b0 con 0x565365c4ef80 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.381+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4be409b7f0 con 0x565365c4ef80 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.381+0000 7f4bfa1b4740 10 client.25354 fetch_fsmap learned FSMap version 30 2024-06-02T22:38:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.381+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x565365ca0f50 con 0x565365c4ef80 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bdc0054b0 con 0x565365c4ef80 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4be4081020 con 0x565365c4ef80 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bfa1b4740 10 client.25354 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bfa1b4740 10 client.25354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bfa1b4740 20 client.25354 populate_metadata read hostname 'smithi031' 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.382+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365c95120 0x565365d129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:38:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.383+0000 7f4bfa1b4740 4 client.25354 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:38:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.383+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565365bf7b50 con 0x565365c95120 2024-06-02T22:38:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.384+0000 7f4bef400640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365c95120 0x565365d129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:38:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.385+0000 7f4bef400640 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365c95120 0x565365d129e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=721a2eab6174fd5c server_cookie=be35abf47284a279 in_seq=0 out_seq=0 2024-06-02T22:38:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.385+0000 7f4bd6000640 10 client.25354 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:54.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.408+0000 7f4bd6000640 1 -- 172.21.15.31:0/22570115 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x565365bf7b50 con 0x565365c95120 2024-06-02T22:38:54.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.408+0000 7f4bd6000640 10 client.25354 handle_command_reply: tid=0 2024-06-02T22:38:54.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.408+0000 7f4bfa1b4740 1 client.25354 shutdown 2024-06-02T22:38:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 msgr2=0x565365c9e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4be409c560 tx=0x7f4be409ced0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 shutdown_connections 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x565365c95120 0x565365d129e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x565365c8ffb0 0x565365c9f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565365c8f5c0 0x565365c9e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 --2- 172.21.15.31:0/22570115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565365c4ef80 0x565365c9e090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 >> 172.21.15.31:0/22570115 conn(0x565365c90bb0 msgr2=0x565365c810e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.409+0000 7f4bd6000640 0 client.25354 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.410+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 shutdown_connections 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.410+0000 7f4bfa1b4740 1 -- 172.21.15.31:0/22570115 wait complete. 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.410+0000 7f4bfa1b4740 20 client.25354 trim_cache size 0 max 16384 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:38:54.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:38:54.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.411+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 msgr2=0x7f4bd80a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.411+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 0x7f4bd80a5050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x565365c90810 tx=0x7f4bf004fe60 comp rx=0 tx=0).stop 2024-06-02T22:38:54.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.411+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 msgr2=0x7f4be812e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.411+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 0x7f4be812e280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4be400e9c0 tx=0x7f4be400ee80 comp rx=0 tx=0).stop 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 shutdown_connections 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4bd80a2b90 0x7f4bd80a5050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be8099ab0 0x7f4be8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4be80990f0 0x7f4be812e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 --2- 172.21.15.31:0/3302538062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be8097f20 0x7f4be812e280 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 >> 172.21.15.31:0/3302538062 conn(0x7f4be80934e0 msgr2=0x7f4be809c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 shutdown_connections 2024-06-02T22:38:54.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:38:54.412+0000 7f4bf5c00640 1 -- 172.21.15.31:0/3302538062 wait complete. 2024-06-02T22:38:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 90.0 s, 1673.0 tps, lat 59.774 ms stddev 64.213 2024-06-02T22:38:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:55 smithi178 ceph-mon[36614]: pgmap v569: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 830 op/s 2024-06-02T22:38:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:55 smithi031 ceph-mon[31767]: pgmap v569: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 830 op/s 2024-06-02T22:38:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:55 smithi098 ceph-mon[36750]: pgmap v569: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 830 op/s 2024-06-02T22:38:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:57 smithi031 ceph-mon[31767]: pgmap v570: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-06-02T22:38:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:57 smithi098 ceph-mon[36750]: pgmap v570: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-06-02T22:38:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:57 smithi178 ceph-mon[36614]: pgmap v570: 129 pgs: 129 active+clean; 1016 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 865 op/s 2024-06-02T22:39:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:38:59 smithi031 ceph-mon[31767]: pgmap v571: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 651 op/s 2024-06-02T22:39:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:38:59 smithi098 ceph-mon[36750]: pgmap v571: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 651 op/s 2024-06-02T22:39:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 95.0 s, 1493.0 tps, lat 66.300 ms stddev 83.526 2024-06-02T22:39:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:38:59 smithi178 ceph-mon[36614]: pgmap v571: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 651 op/s 2024-06-02T22:39:02.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:01 smithi031 ceph-mon[31767]: pgmap v572: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-06-02T22:39:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:01 smithi098 ceph-mon[36750]: pgmap v572: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-06-02T22:39:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:01 smithi178 ceph-mon[36614]: pgmap v572: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-06-02T22:39:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:03 smithi031 ceph-mon[31767]: pgmap v573: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-06-02T22:39:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:03 smithi098 ceph-mon[36750]: pgmap v573: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-06-02T22:39:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:03 smithi178 ceph-mon[36614]: pgmap v573: 129 pgs: 129 active+clean; 1016 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-06-02T22:39:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 100.0 s, 2051.4 tps, lat 49.338 ms stddev 62.894 2024-06-02T22:39:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:05 smithi031 ceph-mon[31767]: pgmap v574: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-06-02T22:39:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:05 smithi098 ceph-mon[36750]: pgmap v574: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-06-02T22:39:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:05 smithi178 ceph-mon[36614]: pgmap v574: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.635+0000 7f8c07800640 1 -- 172.21.15.31:0/1464189202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 msgr2=0x7f8c00105290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.635+0000 7f8c07800640 1 --2- 172.21.15.31:0/1464189202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00105290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009860 tx=0x7f8be802a340 comp rx=0 tx=0).stop 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 -- 172.21.15.31:0/1464189202 shutdown_connections 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 --2- 172.21.15.31:0/1464189202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c001057d0 0x7f8c0010c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 --2- 172.21.15.31:0/1464189202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00105290 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 --2- 172.21.15.31:0/1464189202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c00103c20 0x7f8c00104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 -- 172.21.15.31:0/1464189202 >> 172.21.15.31:0/1464189202 conn(0x7f8c000ff190 msgr2=0x7f8c001015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 -- 172.21.15.31:0/1464189202 shutdown_connections 2024-06-02T22:39:07.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.636+0000 7f8c07800640 1 -- 172.21.15.31:0/1464189202 wait complete. 2024-06-02T22:39:07.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.637+0000 7f8c07800640 1 Processor -- start 2024-06-02T22:39:07.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 -- start start 2024-06-02T22:39:07.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c00103c20 0x7f8c00110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c001057d0 0x7f8c00114320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00077bc0 con 0x7f8c001057d0 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00077a40 con 0x7f8c00103c20 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.638+0000 7f8c07800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c00077d40 con 0x7f8c00104e10 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:32858/0 (socket says 172.21.15.31:32858) 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 -- 172.21.15.31:0/950178480 learned_addr learned my addr 172.21.15.31:0/950178480 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8c04e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c00103c20 0x7f8c00110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 -- 172.21.15.31:0/950178480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c00103c20 msgr2=0x7f8c00110e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c00103c20 0x7f8c00110e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 -- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c001057d0 msgr2=0x7f8c00114320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c001057d0 0x7f8c00114320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.639+0000 7f8bf7e00640 1 -- 172.21.15.31:0/950178480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c00114990 con 0x7f8c00104e10 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.640+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8be8031000 tx=0x7f8be8033d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.640+0000 7f8bfe000640 1 -- 172.21.15.31:0/950178480 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8037040 con 0x7f8c00104e10 2024-06-02T22:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.640+0000 7f8bfe000640 1 -- 172.21.15.31:0/950178480 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be8030850 con 0x7f8c00104e10 2024-06-02T22:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.640+0000 7f8bfe000640 1 -- 172.21.15.31:0/950178480 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be8004920 con 0x7f8c00104e10 2024-06-02T22:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.641+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c00114c20 con 0x7f8c00104e10 2024-06-02T22:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.641+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c001150c0 con 0x7f8c00104e10 2024-06-02T22:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.644+0000 7f8bfe000640 1 -- 172.21.15.31:0/950178480 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f8be8005030 con 0x7f8c00104e10 2024-06-02T22:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.650+0000 7f8bfe000640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 0x7f8be40a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.651+0000 7f8bfe000640 1 -- 172.21.15.31:0/950178480 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8be80ef310 con 0x7f8c00104e10 2024-06-02T22:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.651+0000 7f8c04e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 0x7f8be40a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.654+0000 7f8c0a618740 1 Processor -- start 2024-06-02T22:39:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 -- start start 2024-06-02T22:39:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ff2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff8730 0x560c57ffabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c57f56420 con 0x560c57ff8730 2024-06-02T22:39:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c57efdc50 con 0x560c57ff2bd0 2024-06-02T22:39:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.655+0000 7f8c0a618740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560c57f523e0 con 0x560c57ff35c0 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:32868/0 (socket says 172.21.15.31:32868) 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 -- 172.21.15.31:0/413822652 learned_addr learned my addr 172.21.15.31:0/413822652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 -- 172.21.15.31:0/413822652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 msgr2=0x560c57ff2ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ff2ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 -- 172.21.15.31:0/413822652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff8730 msgr2=0x560c57ffabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff8730 0x560c57ffabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.656+0000 7f8bf7e00640 1 -- 172.21.15.31:0/413822652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c57c6a210 con 0x560c57ff35c0 2024-06-02T22:39:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.657+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8be80c3ec0 tx=0x7f8be8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea47e2e681e959d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.657+0000 7f8bf6000640 1 -- 172.21.15.31:0/413822652 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80bb0e0 con 0x560c57ff35c0 2024-06-02T22:39:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.657+0000 7f8bf6000640 1 -- 172.21.15.31:0/413822652 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be80bbe80 con 0x560c57ff35c0 2024-06-02T22:39:07.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.657+0000 7f8bf6000640 1 -- 172.21.15.31:0/413822652 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80c3f60 con 0x560c57ff35c0 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.658+0000 7f8c04e00640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 0x7f8be40a5330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c00104c70 tx=0x7f8bf000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 -- 172.21.15.31:0/413822652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 msgr2=0x560c57ff80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8be80c3ec0 tx=0x7f8be8005f90 comp rx=0 tx=0).stop 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 -- 172.21.15.31:0/413822652 shutdown_connections 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff8730 0x560c57ffabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff35c0 0x560c57ff80c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 --2- 172.21.15.31:0/413822652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ff2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.659+0000 7f8c0a618740 1 -- 172.21.15.31:0/413822652 >> 172.21.15.31:0/413822652 conn(0x560c57fbaf80 msgr2=0x560c57fee650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.660+0000 7f8c0a618740 1 -- 172.21.15.31:0/413822652 shutdown_connections 2024-06-02T22:39:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.660+0000 7f8c0a618740 1 -- 172.21.15.31:0/413822652 wait complete. 2024-06-02T22:39:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.661+0000 7f8c0a618740 1 -- start start 2024-06-02T22:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.661+0000 7f8c0a618740 1 Processor -- start 2024-06-02T22:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.662+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ffcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.662+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.663+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c580042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.663+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.663+0000 7f8c04e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ffcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.663+0000 7f8c04e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ffcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57296/0 (socket says 172.21.15.31:57296) 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.663+0000 7f8bf7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50238/0 (socket says 172.21.15.31:50238) 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c04e00640 1 -- 172.21.15.31:0/1160624274 learned_addr learned my addr 172.21.15.31:0/1160624274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560c57ffb4a0 con 0x560c57ff35c0 2024-06-02T22:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560c57f110b0 con 0x560c57ff2bd0 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560c57ffb620 con 0x560c57ff8730 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c0a618740 10 client.0 _ll_register_callbacks cb 0x560c57efcf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.664+0000 7f8c05800640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c580042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.665+0000 7f8bf7e00640 1 -- 172.21.15.31:0/1160624274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 msgr2=0x560c580042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.665+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c580042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.665+0000 7f8bf7e00640 1 -- 172.21.15.31:0/1160624274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 msgr2=0x560c57ffcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.665+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ffcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.665+0000 7f8bf7e00640 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c57d36620 con 0x560c57ff35c0 2024-06-02T22:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.666+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8be80c3ec0 tx=0x7f8be80c4190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a091d1b70bb436 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.666+0000 7f8beea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.666+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80d8020 con 0x560c57ff35c0 2024-06-02T22:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.667+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8be80bade0 con 0x560c57ff35c0 2024-06-02T22:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.667+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8be80bbe80 con 0x560c57ff35c0 2024-06-02T22:39:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.667+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8be80ecc10 con 0x560c57ff35c0 2024-06-02T22:39:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.667+0000 7f8c0a618740 10 client.15216 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.667+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c57ffb4a0 con 0x560c57ff35c0 2024-06-02T22:39:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.668+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be80bbe80 con 0x560c57ff35c0 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.668+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8be80b7040 con 0x560c57ff35c0 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.668+0000 7f8c0a618740 10 client.15216 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c0a618740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c0a618740 20 client.15216 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58008ad0 0x560c5800aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c0a618740 4 client.15216 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:39:07.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c57f63b50 con 0x560c58008ad0 2024-06-02T22:39:07.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.669+0000 7f8c04e00640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58008ad0 0x560c5800aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.671+0000 7f8beea00640 10 client.15216 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.673+0000 7f8c04e00640 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58008ad0 0x560c5800aec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7466aec6b1201a2b server_cookie=b9666e310201b887 in_seq=0 out_seq=0 2024-06-02T22:39:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.681+0000 7f8beea00640 1 -- 172.21.15.31:0/1160624274 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560c57f63b50 con 0x560c58008ad0 2024-06-02T22:39:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.681+0000 7f8beea00640 10 client.15216 handle_command_reply: tid=0 2024-06-02T22:39:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.681+0000 7f8c0a618740 1 client.15216 shutdown 2024-06-02T22:39:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.681+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 msgr2=0x560c57ffd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.681+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8be80c3ec0 tx=0x7f8be80c4190 comp rx=0 tx=0).stop 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 shutdown_connections 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58008ad0 0x560c5800aec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c580042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c57ffd280 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 --2- 172.21.15.31:0/1160624274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c57ffcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.683+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 >> 172.21.15.31:0/1160624274 conn(0x560c57fbaf80 msgr2=0x560c57fed810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.684+0000 7f8beea00640 0 client.15216 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.685+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 shutdown_connections 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.685+0000 7f8c0a618740 1 -- 172.21.15.31:0/1160624274 wait complete. 2024-06-02T22:39:07.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.685+0000 7f8c0a618740 20 client.15216 trim_cache size 0 max 16384 2024-06-02T22:39:07.722 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 Processor -- start 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 -- start start 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 0x560c57fee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c58004280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 0x560c57fee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001b94c0 con 0x560c57ff35c0 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001bb000 con 0x560c57ff8730 2024-06-02T22:39:07.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.723+0000 7f8c0a618740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001b9b90 con 0x560c57ff2bd0 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.724+0000 7f8c05800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 0x560c57fee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.724+0000 7f8c04e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 0x560c57fee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.724+0000 7f8c04e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 0x560c57fee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:32900/0 (socket says 172.21.15.31:32900) 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.724+0000 7f8c04e00640 1 -- 172.21.15.31:0/2033867393 learned_addr learned my addr 172.21.15.31:0/2033867393 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c58004280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8c05800640 1 -- 172.21.15.31:0/2033867393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 msgr2=0x560c57fee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8c05800640 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 0x560c57fee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8c05800640 1 -- 172.21.15.31:0/2033867393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 msgr2=0x560c58004280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8c05800640 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c58004280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.725+0000 7f8c05800640 1 -- 172.21.15.31:0/2033867393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c57fef300 con 0x560c57ff8730 2024-06-02T22:39:07.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.726+0000 7f8c05800640 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 0x560c57fee670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005fd0 tx=0x7f8bf800f7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f789b94707aaa6b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.727+0000 7f8bf5600640 1 -- 172.21.15.31:0/2033867393 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8003b80 con 0x560c57ff8730 2024-06-02T22:39:07.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.727+0000 7f8bf5600640 1 -- 172.21.15.31:0/2033867393 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8003d20 con 0x560c57ff8730 2024-06-02T22:39:07.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.727+0000 7f8bf5600640 1 -- 172.21.15.31:0/2033867393 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800db20 con 0x560c57ff8730 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 -- 172.21.15.31:0/2033867393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 msgr2=0x560c57fee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 0x560c57fee670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005fd0 tx=0x7f8bf800f7d0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 -- 172.21.15.31:0/2033867393 shutdown_connections 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff8730 0x560c57fee670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c58004280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 --2- 172.21.15.31:0/2033867393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff2bd0 0x560c57fee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.728+0000 7f8c0a618740 1 -- 172.21.15.31:0/2033867393 >> 172.21.15.31:0/2033867393 conn(0x560c57fbaf80 msgr2=0x560c57ff4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.729+0000 7f8c0a618740 1 -- 172.21.15.31:0/2033867393 shutdown_connections 2024-06-02T22:39:07.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.729+0000 7f8c0a618740 1 -- 172.21.15.31:0/2033867393 wait complete. 2024-06-02T22:39:07.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.729+0000 7f8c0a618740 1 -- start start 2024-06-02T22:39:07.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.730+0000 7f8c0a618740 1 Processor -- start 2024-06-02T22:39:07.730 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.731+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c58000db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.731+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c580012f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.731+0000 7f8c0a618740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c0a618740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ba930 con 0x560c57ff35c0 2024-06-02T22:39:07.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c0a618740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001ba260 con 0x560c57ff2bd0 2024-06-02T22:39:07.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c0a618740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c001b74a0 con 0x560c57ff8730 2024-06-02T22:39:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c05800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c0a618740 10 client.0 _ll_register_callbacks cb 0x7f8be8009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c05800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:32902/0 (socket says 172.21.15.31:32902) 2024-06-02T22:39:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8c05800640 1 -- 172.21.15.31:0/3174149894 learned_addr learned my addr 172.21.15.31:0/3174149894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.732+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c580012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.733+0000 7f8c04e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c58000db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8bf7e00640 1 -- 172.21.15.31:0/3174149894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 msgr2=0x560c58071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8bf7e00640 1 -- 172.21.15.31:0/3174149894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 msgr2=0x560c58000db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c58000db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8bf7e00640 1 -- 172.21.15.31:0/3174149894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c58004350 con 0x560c57ff35c0 2024-06-02T22:39:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.734+0000 7f8c05800640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:39:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.737+0000 7f8beea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:39:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.737+0000 7f8bf7e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c580012f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b7be0 tx=0x7f8be80bb010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fabda441883f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.738+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80bb550 con 0x560c57ff35c0 2024-06-02T22:39:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.739+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8be80b74d0 con 0x560c57ff35c0 2024-06-02T22:39:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.739+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bf8003d20 con 0x560c57ff35c0 2024-06-02T22:39:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.739+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8be80bb0e0 con 0x560c57ff35c0 2024-06-02T22:39:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8c0a618740 10 client.15219 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560c58004350 con 0x560c57ff35c0 2024-06-02T22:39:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8003d20 con 0x560c57ff35c0 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8be80b7040 con 0x560c57ff35c0 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8c0a618740 10 client.15219 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8c0a618740 10 client.15219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.740+0000 7f8c0a618740 20 client.15219 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.741+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58072fe0 0x560c58075400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.741+0000 7f8c0a618740 4 client.15219 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:39:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.741+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c57ffcb30 con 0x560c58072fe0 2024-06-02T22:39:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.742+0000 7f8c04e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58072fe0 0x560c58075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.744+0000 7f8c04e00640 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58072fe0 0x560c58075400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744b47a4a36da295 server_cookie=2dd8e4623d90dca7 in_seq=0 out_seq=0 2024-06-02T22:39:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.744+0000 7f8beea00640 10 client.15219 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.814+0000 7f8beea00640 1 -- 172.21.15.31:0/3174149894 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560c57ffcb30 con 0x560c58072fe0 2024-06-02T22:39:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.814+0000 7f8beea00640 10 client.15219 handle_command_reply: tid=0 2024-06-02T22:39:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.814+0000 7f8c0a618740 1 client.15219 shutdown 2024-06-02T22:39:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.814+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 msgr2=0x560c580012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.814+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c580012f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8be80b7be0 tx=0x7f8be80bb010 comp rx=0 tx=0).stop 2024-06-02T22:39:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 shutdown_connections 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560c58072fe0 0x560c58075400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560c57ff8730 0x560c58071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8beea00640 0 client.15219 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560c57ff35c0 0x560c580012f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 --2- 172.21.15.31:0/3174149894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560c57ff2bd0 0x560c58000db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 >> 172.21.15.31:0/3174149894 conn(0x560c57fbaf80 msgr2=0x560c57ff4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.815+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 shutdown_connections 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.816+0000 7f8c0a618740 1 -- 172.21.15.31:0/3174149894 wait complete. 2024-06-02T22:39:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.816+0000 7f8c0a618740 20 client.15219 trim_cache size 0 max 16384 2024-06-02T22:39:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:39:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:39:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 msgr2=0x7f8be40a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 0x7f8be40a5330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c00104c70 tx=0x7f8bf000a2d0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 msgr2=0x7f8c00111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8be8031000 tx=0x7f8be8033d10 comp rx=0 tx=0).stop 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 shutdown_connections 2024-06-02T22:39:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8be40a2e70 0x7f8be40a5330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c001057d0 0x7f8c00114320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c00104e10 0x7f8c00111370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 --2- 172.21.15.31:0/950178480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8c00103c20 0x7f8c00110e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.818+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 >> 172.21.15.31:0/950178480 conn(0x7f8c000ff190 msgr2=0x7f8c000ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.819+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 shutdown_connections 2024-06-02T22:39:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:07.819+0000 7f8c07800640 1 -- 172.21.15.31:0/950178480 wait complete. 2024-06-02T22:39:08.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:07 smithi031 ceph-mon[31767]: pgmap v575: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 710 op/s 2024-06-02T22:39:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:07 smithi098 ceph-mon[36750]: pgmap v575: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 710 op/s 2024-06-02T22:39:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:07 smithi178 ceph-mon[36614]: pgmap v575: 129 pgs: 129 active+clean; 1017 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 MiB/s wr, 710 op/s 2024-06-02T22:39:10.113 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:09 smithi178 ceph-mon[36614]: pgmap v576: 129 pgs: 129 active+clean; 1023 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-06-02T22:39:10.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:09 smithi031 ceph-mon[31767]: pgmap v576: 129 pgs: 129 active+clean; 1023 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-06-02T22:39:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:09 smithi098 ceph-mon[36750]: pgmap v576: 129 pgs: 129 active+clean; 1023 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 6.8 MiB/s wr, 637 op/s 2024-06-02T22:39:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 105.0 s, 2549.4 tps, lat 39.295 ms stddev 44.238 2024-06-02T22:39:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:11 smithi031 ceph-mon[31767]: pgmap v577: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 712 op/s 2024-06-02T22:39:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:11 smithi098 ceph-mon[36750]: pgmap v577: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 712 op/s 2024-06-02T22:39:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:11 smithi178 ceph-mon[36614]: pgmap v577: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.1 MiB/s wr, 712 op/s 2024-06-02T22:39:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:13 smithi098 ceph-mon[36750]: pgmap v578: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 787 op/s 2024-06-02T22:39:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:13 smithi178 ceph-mon[36614]: pgmap v578: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 787 op/s 2024-06-02T22:39:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:13 smithi031 ceph-mon[31767]: pgmap v578: 129 pgs: 129 active+clean; 1.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 787 op/s 2024-06-02T22:39:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 110.0 s, 2637.6 tps, lat 37.766 ms stddev 45.343 2024-06-02T22:39:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:15 smithi098 ceph-mon[36750]: pgmap v579: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.2 MiB/s wr, 764 op/s 2024-06-02T22:39:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:15 smithi178 ceph-mon[36614]: pgmap v579: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.2 MiB/s wr, 764 op/s 2024-06-02T22:39:16.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:15 smithi031 ceph-mon[31767]: pgmap v579: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.2 MiB/s wr, 764 op/s 2024-06-02T22:39:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:17 smithi098 ceph-mon[36750]: pgmap v580: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.8 MiB/s wr, 821 op/s 2024-06-02T22:39:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:17 smithi178 ceph-mon[36614]: pgmap v580: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.8 MiB/s wr, 821 op/s 2024-06-02T22:39:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:17 smithi031 ceph-mon[31767]: pgmap v580: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.8 MiB/s wr, 821 op/s 2024-06-02T22:39:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:19 smithi098 ceph-mon[36750]: pgmap v581: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2024-06-02T22:39:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 115.0 s, 1470.8 tps, lat 67.742 ms stddev 86.691 2024-06-02T22:39:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:19 smithi178 ceph-mon[36614]: pgmap v581: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2024-06-02T22:39:20.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:19 smithi031 ceph-mon[31767]: pgmap v581: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.4 MiB/s wr, 711 op/s 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 -- 172.21.15.31:0/430794687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3580107750 msgr2=0x7f3580109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 --2- 172.21.15.31:0/430794687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3580107750 0x7f3580109b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3568009860 tx=0x7f356802a340 comp rx=0 tx=0).stop 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 -- 172.21.15.31:0/430794687 shutdown_connections 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 --2- 172.21.15.31:0/430794687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3580107750 0x7f3580109b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 --2- 172.21.15.31:0/430794687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 0x7f3580107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 --2- 172.21.15.31:0/430794687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35801024f0 0x7f35801048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.023+0000 7f3585200640 1 -- 172.21.15.31:0/430794687 >> 172.21.15.31:0/430794687 conn(0x7f35800fbe60 msgr2=0x7f35800fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.024+0000 7f3585200640 1 -- 172.21.15.31:0/430794687 shutdown_connections 2024-06-02T22:39:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.024+0000 7f3585200640 1 -- 172.21.15.31:0/430794687 wait complete. 2024-06-02T22:39:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 Processor -- start 2024-06-02T22:39:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 -- start start 2024-06-02T22:39:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 0x7f35801004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 0x7f35801009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.025+0000 7f3585200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f358010d670 con 0x7f3580104e20 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f3585200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f358010d4f0 con 0x7f3580107750 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f3585200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f358010d7f0 con 0x7f35801024f0 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59554/0 (socket says 172.21.15.31:59554) 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 -- 172.21.15.31:0/3681839833 learned_addr learned my addr 172.21.15.31:0/3681839833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357d400640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 0x7f35801004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357e800640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 0x7f35801009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 -- 172.21.15.31:0/3681839833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 msgr2=0x7f35801009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 0x7f35801009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 -- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 msgr2=0x7f35801004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 0x7f35801004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.026+0000 7f357de00640 1 -- 172.21.15.31:0/3681839833 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358019bb50 con 0x7f35801024f0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.027+0000 7f357e800640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 0x7f35801009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.027+0000 7f357de00640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f357800c420 tx=0x7f3578009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.027+0000 7f3576a00640 1 -- 172.21.15.31:0/3681839833 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578003970 con 0x7f35801024f0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.027+0000 7f3576a00640 1 -- 172.21.15.31:0/3681839833 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3578004020 con 0x7f35801024f0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.028+0000 7f3576a00640 1 -- 172.21.15.31:0/3681839833 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357800bad0 con 0x7f35801024f0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.028+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358019be40 con 0x7f35801024f0 2024-06-02T22:39:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.028+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358019c340 con 0x7f35801024f0 2024-06-02T22:39:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.033+0000 7f35881b5740 1 Processor -- start 2024-06-02T22:39:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 -- start start 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 0x55adb64340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb6436bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55adb6392420 con 0x55adb642f5c0 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adb6339c50 con 0x55adb6434730 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f35881b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55adb638e3e0 con 0x55adb642ebd0 2024-06-02T22:39:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.034+0000 7f3576a00640 1 -- 172.21.15.31:0/3681839833 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f357801d020 con 0x7f35801024f0 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.035+0000 7f357e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.035+0000 7f357e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59558/0 (socket says 172.21.15.31:59558) 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.035+0000 7f357e800640 1 -- 172.21.15.31:0/1258445176 learned_addr learned my addr 172.21.15.31:0/1258445176 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.035+0000 7f357d400640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb6436bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.035+0000 7f357de00640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 0x55adb64340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 -- 172.21.15.31:0/1258445176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 msgr2=0x55adb642eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 -- 172.21.15.31:0/1258445176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 msgr2=0x55adb64340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 0x55adb64340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 -- 172.21.15.31:0/1258445176 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adb60a6210 con 0x55adb6434730 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357de00640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 0x55adb64340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357e800640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:39:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f357d400640 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb6436bc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f358006acb0 tx=0x7f357000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fab08748cc5677e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.036+0000 7f356f400640 1 -- 172.21.15.31:0/1258445176 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570015070 con 0x55adb6434730 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.037+0000 7f356f400640 1 -- 172.21.15.31:0/1258445176 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35700035f0 con 0x55adb6434730 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.037+0000 7f356f400640 1 -- 172.21.15.31:0/1258445176 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570011680 con 0x55adb6434730 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.037+0000 7f3576a00640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 0x7f35640a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.037+0000 7f3576a00640 1 -- 172.21.15.31:0/3681839833 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f35780cf4b0 con 0x7f35801024f0 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- 172.21.15.31:0/1258445176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 msgr2=0x55adb6436bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb6436bc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f358006acb0 tx=0x7f357000f730 comp rx=0 tx=0).stop 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- 172.21.15.31:0/1258445176 shutdown_connections 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb6436bc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642f5c0 0x55adb64340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 --2- 172.21.15.31:0/1258445176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642ebd0 0x55adb642eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- 172.21.15.31:0/1258445176 >> 172.21.15.31:0/1258445176 conn(0x55adb63f6f80 msgr2=0x55adb642a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f357e800640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 0x7f35640a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- 172.21.15.31:0/1258445176 shutdown_connections 2024-06-02T22:39:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- 172.21.15.31:0/1258445176 wait complete. 2024-06-02T22:39:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.038+0000 7f35881b5740 1 -- start start 2024-06-02T22:39:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.039+0000 7f35881b5740 1 Processor -- start 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.039+0000 7f357e800640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 0x7f35640a5170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f356802a860 tx=0x7f35680303a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6439420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb6440460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55adb64376e0 con 0x55adb6434730 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55adb634d0b0 con 0x55adb642ebd0 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55adb6437860 con 0x55adb642f5c0 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f35881b5740 10 client.0 _ll_register_callbacks cb 0x55adb6338f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.040+0000 7f357de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:54690/0 (socket says 172.21.15.31:54690) 2024-06-02T22:39:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 -- 172.21.15.31:0/4098450864 learned_addr learned my addr 172.21.15.31:0/4098450864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 -- 172.21.15.31:0/4098450864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 msgr2=0x55adb6439420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6439420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 -- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 msgr2=0x55adb6440460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb6440460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 -- 172.21.15.31:0/4098450864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adb6172620 con 0x55adb642ebd0 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f357de00640 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35780a4060 tx=0x7f357809b520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f585cd9a74a768 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.041+0000 7f3563e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357809b920 con 0x55adb642ebd0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35700035f0 con 0x55adb642ebd0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f35780cf1a0 con 0x55adb642ebd0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f357809fcd0 con 0x55adb642ebd0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f35881b5740 10 client.25370 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.042+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55adb6443890 con 0x55adb642ebd0 2024-06-02T22:39:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35700035f0 con 0x55adb642ebd0 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f357800b040 con 0x55adb642ebd0 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 10 client.25370 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 10 client.25370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 20 client.25370 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb6445150 0x55adb6447540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 4 client.25370 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adb639fb50 con 0x55adb6445150 2024-06-02T22:39:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.043+0000 7f357d400640 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb6445150 0x55adb6447540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.046+0000 7f357d400640 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb6445150 0x55adb6447540 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a91e2e57547b5ce server_cookie=dbb5912e6bca34cc in_seq=0 out_seq=0 2024-06-02T22:39:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.046+0000 7f3563e00640 10 client.25370 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f3563e00640 1 -- 172.21.15.31:0/4098450864 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55adb639fb50 con 0x55adb6445150 2024-06-02T22:39:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f3563e00640 10 client.25370 handle_command_reply: tid=0 2024-06-02T22:39:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 client.25370 shutdown 2024-06-02T22:39:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 msgr2=0x55adb6438ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35780a4060 tx=0x7f357809b520 comp rx=0 tx=0).stop 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 shutdown_connections 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb6445150 0x55adb6447540 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb6440460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6439420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 --2- 172.21.15.31:0/4098450864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb6438ee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 >> 172.21.15.31:0/4098450864 conn(0x55adb63f6f80 msgr2=0x55adb6429810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.047+0000 7f3563e00640 0 client.25370 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.048+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 shutdown_connections 2024-06-02T22:39:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.049+0000 7f35881b5740 1 -- 172.21.15.31:0/4098450864 wait complete. 2024-06-02T22:39:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.050+0000 7f35881b5740 20 client.25370 trim_cache size 0 max 16384 2024-06-02T22:39:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.078+0000 7f35881b5740 1 Processor -- start 2024-06-02T22:39:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.078+0000 7f35881b5740 1 -- start start 2024-06-02T22:39:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6440420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb642da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f35801b9410 con 0x55adb6434730 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35801baf50 con 0x55adb642ebd0 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f35881b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35801b9ae0 con 0x55adb642f5c0 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:54694/0 (socket says 172.21.15.31:54694) 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357de00640 1 -- 172.21.15.31:0/1129508630 learned_addr learned my addr 172.21.15.31:0/1129508630 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357e800640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb642da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357d400640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6440420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357de00640 1 -- 172.21.15.31:0/1129508630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 msgr2=0x55adb6440420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.079+0000 7f357de00640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6440420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f357de00640 1 -- 172.21.15.31:0/1129508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 msgr2=0x55adb642da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f357de00640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb642da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f357de00640 1 -- 172.21.15.31:0/1129508630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adb642e160 con 0x55adb642ebd0 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f357e800640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb642da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f357de00640 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3578099bd0 tx=0x7f357800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813b4523af8576dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f356ea00640 1 -- 172.21.15.31:0/1129508630 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780a4590 con 0x55adb642ebd0 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f356ea00640 1 -- 172.21.15.31:0/1129508630 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3578086220 con 0x55adb642ebd0 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.080+0000 7f356ea00640 1 -- 172.21.15.31:0/1129508630 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357800e0b0 con 0x55adb642ebd0 2024-06-02T22:39:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.081+0000 7f35881b5740 1 -- 172.21.15.31:0/1129508630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 msgr2=0x55adb642d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.081+0000 7f35881b5740 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3578099bd0 tx=0x7f357800bf60 comp rx=0 tx=0).stop 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.082+0000 7f35881b5740 1 -- 172.21.15.31:0/1129508630 shutdown_connections 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.082+0000 7f35881b5740 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb6434730 0x55adb642da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.082+0000 7f35881b5740 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb6440420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.082+0000 7f35881b5740 1 --2- 172.21.15.31:0/1129508630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb642ebd0 0x55adb642d540 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.082+0000 7f35881b5740 1 -- 172.21.15.31:0/1129508630 >> 172.21.15.31:0/1129508630 conn(0x55adb63f6f80 msgr2=0x55adb642a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.083+0000 7f35881b5740 1 -- 172.21.15.31:0/1129508630 shutdown_connections 2024-06-02T22:39:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.083+0000 7f35881b5740 1 -- 172.21.15.31:0/1129508630 wait complete. 2024-06-02T22:39:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.084+0000 7f35881b5740 1 -- start start 2024-06-02T22:39:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.084+0000 7f35881b5740 1 Processor -- start 2024-06-02T22:39:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 0x55adb643da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb643df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ba880 con 0x55adb642ebd0 2024-06-02T22:39:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ba1b0 con 0x55adb6434730 2024-06-02T22:39:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35801b74e0 con 0x55adb642f5c0 2024-06-02T22:39:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.085+0000 7f35881b5740 10 client.0 _ll_register_callbacks cb 0x7f3578097c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.086+0000 7f357e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.086+0000 7f357de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 0x55adb643da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.086+0000 7f357e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:54698/0 (socket says 172.21.15.31:54698) 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.086+0000 7f357e800640 1 -- 172.21.15.31:0/3778687845 learned_addr learned my addr 172.21.15.31:0/3778687845 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.087+0000 7f357e800640 1 -- 172.21.15.31:0/3778687845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 msgr2=0x55adb643df50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.087+0000 7f357e800640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb643df50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.087+0000 7f357e800640 1 -- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 msgr2=0x55adb643da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.088+0000 7f357e800640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 0x55adb643da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.088+0000 7f357e800640 1 -- 172.21.15.31:0/3778687845 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adb643f550 con 0x55adb6434730 2024-06-02T22:39:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.088+0000 7f357de00640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 0x55adb643da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:39:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.088+0000 7f357e800640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3568030a80 tx=0x7f356802a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34531cb9a7b9f317 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.088+0000 7f3563e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.089+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568037040 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.089+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3578086220 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.089+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3568004460 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.089+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3568056050 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.090+0000 7f35881b5740 10 client.25376 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.090+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55adb64afc00 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.090+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3578086220 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.090+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3568003a20 con 0x55adb6434730 2024-06-02T22:39:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 10 client.25376 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 10 client.25376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 20 client.25376 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb64b05c0 0x55adb64b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 4 client.25376 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.091+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55adb6399ea0 con 0x55adb64b05c0 2024-06-02T22:39:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.092+0000 7f357de00640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb64b05c0 0x55adb64b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.095+0000 7f357de00640 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb64b05c0 0x55adb64b29e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e3ab72828b4c6ff server_cookie=fc4aa1cd9e630479 in_seq=0 out_seq=0 2024-06-02T22:39:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.095+0000 7f3563e00640 10 client.25376 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.211+0000 7f3563e00640 1 -- 172.21.15.31:0/3778687845 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55adb6399ea0 con 0x55adb64b05c0 2024-06-02T22:39:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.211+0000 7f3563e00640 10 client.25376 handle_command_reply: tid=0 2024-06-02T22:39:21.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.212+0000 7f35881b5740 1 client.25376 shutdown 2024-06-02T22:39:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.212+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 msgr2=0x55adb643ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3568030a80 tx=0x7f356802a340 comp rx=0 tx=0).stop 2024-06-02T22:39:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 shutdown_connections 2024-06-02T22:39:21.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55adb64b05c0 0x55adb64b29e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55adb6434730 0x55adb643ef60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55adb642f5c0 0x55adb643df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 --2- 172.21.15.31:0/3778687845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55adb642ebd0 0x55adb643da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 >> 172.21.15.31:0/3778687845 conn(0x55adb63f6f80 msgr2=0x55adb642d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.213+0000 7f3563e00640 0 client.25376 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.214+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 shutdown_connections 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.214+0000 7f35881b5740 1 -- 172.21.15.31:0/3778687845 wait complete. 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.214+0000 7f35881b5740 20 client.25376 trim_cache size 0 max 16384 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:39:21.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.215+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 msgr2=0x7f35640a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 0x7f35640a5170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f356802a860 tx=0x7f35680303a0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 msgr2=0x7f3580101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f357800c420 tx=0x7f3578009f90 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 shutdown_connections 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f35640a2cb0 0x7f35640a5170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3580107750 0x7f35801009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3580104e20 0x7f35801004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 --2- 172.21.15.31:0/3681839833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35801024f0 0x7f3580101da0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 >> 172.21.15.31:0/3681839833 conn(0x7f35800fbe60 msgr2=0x7f3580102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.216+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 shutdown_connections 2024-06-02T22:39:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:21.218+0000 7f3585200640 1 -- 172.21.15.31:0/3681839833 wait complete. 2024-06-02T22:39:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:21 smithi098 ceph-mon[36750]: pgmap v582: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 798 op/s 2024-06-02T22:39:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:21 smithi178 ceph-mon[36614]: pgmap v582: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 798 op/s 2024-06-02T22:39:22.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:21 smithi031 ceph-mon[31767]: pgmap v582: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 798 op/s 2024-06-02T22:39:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:23 smithi098 ceph-mon[36750]: pgmap v583: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-06-02T22:39:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:23 smithi178 ceph-mon[36614]: pgmap v583: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-06-02T22:39:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:23 smithi031 ceph-mon[31767]: pgmap v583: 129 pgs: 129 active+clean; 1.0 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 754 op/s 2024-06-02T22:39:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 120.0 s, 1126.0 tps, lat 88.773 ms stddev 106.130 2024-06-02T22:39:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:25 smithi098 ceph-mon[36750]: pgmap v584: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 663 op/s 2024-06-02T22:39:26.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:25 smithi178 ceph-mon[36614]: pgmap v584: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 663 op/s 2024-06-02T22:39:26.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:25 smithi031 ceph-mon[31767]: pgmap v584: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 663 op/s 2024-06-02T22:39:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:27 smithi098 ceph-mon[36750]: pgmap v585: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 717 op/s 2024-06-02T22:39:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:27 smithi178 ceph-mon[36614]: pgmap v585: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 717 op/s 2024-06-02T22:39:28.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:27 smithi031 ceph-mon[31767]: pgmap v585: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 717 op/s 2024-06-02T22:39:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:29 smithi098 ceph-mon[36750]: pgmap v586: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.0 MiB/s wr, 618 op/s 2024-06-02T22:39:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 125.0 s, 1167.0 tps, lat 83.744 ms stddev 118.225 2024-06-02T22:39:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:29 smithi178 ceph-mon[36614]: pgmap v586: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.0 MiB/s wr, 618 op/s 2024-06-02T22:39:30.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:29 smithi031 ceph-mon[31767]: pgmap v586: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.0 MiB/s wr, 618 op/s 2024-06-02T22:39:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:31 smithi098 ceph-mon[36750]: pgmap v587: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 635 op/s 2024-06-02T22:39:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:31 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:39:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:31 smithi178 ceph-mon[36614]: pgmap v587: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 635 op/s 2024-06-02T22:39:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:31 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:39:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:31 smithi031 ceph-mon[31767]: pgmap v587: 129 pgs: 129 active+clean; 1.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.0 MiB/s wr, 635 op/s 2024-06-02T22:39:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:31 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:39:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:39:33.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:39:33.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:32 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:39:33.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:39:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:39:33.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:32 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:39:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:39:33.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:39:33.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:39:33.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:32 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:39:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:33 smithi178 ceph-mon[36614]: pgmap v588: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-06-02T22:39:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:33 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:39:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:33 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:39:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:33 smithi031 ceph-mon[31767]: pgmap v588: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-06-02T22:39:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:33 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:39:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:33 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:39:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.412+0000 7f6e2b200640 1 -- 172.21.15.31:0/3923147301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410dfb0 msgr2=0x7f6e24114840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.412+0000 7f6e2b200640 1 --2- 172.21.15.31:0/3923147301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410dfb0 0x7f6e24114840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009ca0 tx=0x7f6e1c02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 -- 172.21.15.31:0/3923147301 shutdown_connections 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 --2- 172.21.15.31:0/3923147301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410dfb0 0x7f6e24114840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 --2- 172.21.15.31:0/3923147301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 0x7f6e2410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 --2- 172.21.15.31:0/3923147301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410c400 0x7f6e2410c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 -- 172.21.15.31:0/3923147301 >> 172.21.15.31:0/3923147301 conn(0x7f6e2406c5a0 msgr2=0x7f6e2406c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 -- 172.21.15.31:0/3923147301 shutdown_connections 2024-06-02T22:39:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.413+0000 7f6e2b200640 1 -- 172.21.15.31:0/3923147301 wait complete. 2024-06-02T22:39:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.414+0000 7f6e2b200640 1 Processor -- start 2024-06-02T22:39:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 -- start start 2024-06-02T22:39:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 0x7f6e24119a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 0x7f6e241b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2406f280 con 0x7f6e2410dfb0 2024-06-02T22:39:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2406f100 con 0x7f6e2410c400 2024-06-02T22:39:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e2b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2406f400 con 0x7f6e2410d5f0 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43334/0 (socket says 172.21.15.31:43334) 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e23e00640 1 -- 172.21.15.31:0/2793865162 learned_addr learned my addr 172.21.15.31:0/2793865162 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.415+0000 7f6e23400640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 0x7f6e24119a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e29200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 0x7f6e241b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 -- 172.21.15.31:0/2793865162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 msgr2=0x7f6e24119a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 0x7f6e24119a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 -- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 msgr2=0x7f6e241b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 0x7f6e241b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 -- 172.21.15.31:0/2793865162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e241b6e20 con 0x7f6e2410c400 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e29200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 0x7f6e241b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e23e00640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9c0 tx=0x7f6e1400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e20c00640 1 -- 172.21.15.31:0/2793865162 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400cd80 con 0x7f6e2410c400 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e20c00640 1 -- 172.21.15.31:0/2793865162 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e140035f0 con 0x7f6e2410c400 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.416+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e241b7110 con 0x7f6e2410c400 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.417+0000 7f6e20c00640 1 -- 172.21.15.31:0/2793865162 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14010690 con 0x7f6e2410c400 2024-06-02T22:39:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.417+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e241b76b0 con 0x7f6e2410c400 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.422+0000 7f6e20c00640 1 -- 172.21.15.31:0/2793865162 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6e140037a0 con 0x7f6e2410c400 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.424+0000 7f6e20c00640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.425+0000 7f6e23400640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.426+0000 7f6e2e004740 1 Processor -- start 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 -- start start 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e625eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 0x564e625f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 0x564e625f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564e6254e420 con 0x564e625eabd0 2024-06-02T22:39:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e624f5c50 con 0x564e625f0730 2024-06-02T22:39:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.427+0000 7f6e2e004740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564e6254a3e0 con 0x564e625eb5c0 2024-06-02T22:39:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.428+0000 7f6e20c00640 1 -- 172.21.15.31:0/2793865162 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6e140cf820 con 0x7f6e2410c400 2024-06-02T22:39:34.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.430+0000 7f6e23400640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 0x7f6e080a51c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e2411a9e0 tx=0x7f6e10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.430+0000 7f6e23400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 0x564e625f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.430+0000 7f6e29200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 0x564e625f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.430+0000 7f6e23400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 0x564e625f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37878/0 (socket says 172.21.15.31:37878) 2024-06-02T22:39:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.430+0000 7f6e23400640 1 -- 172.21.15.31:0/654948177 learned_addr learned my addr 172.21.15.31:0/654948177 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.431+0000 7f6e29200640 1 -- 172.21.15.31:0/654948177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 msgr2=0x564e625f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.431+0000 7f6e29200640 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 0x564e625f00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.431+0000 7f6e29200640 1 -- 172.21.15.31:0/654948177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 msgr2=0x564e625eaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.431+0000 7f6e29200640 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e625eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.431+0000 7f6e29200640 1 -- 172.21.15.31:0/654948177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e62262210 con 0x564e625f0730 2024-06-02T22:39:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.432+0000 7f6e29200640 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 0x564e625f2bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009bf0 tx=0x7f6e1c005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6644b1feb6f26036 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.434+0000 7f6e19600640 1 -- 172.21.15.31:0/654948177 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c031650 con 0x564e625f0730 2024-06-02T22:39:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.434+0000 7f6e19600640 1 -- 172.21.15.31:0/654948177 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c036040 con 0x564e625f0730 2024-06-02T22:39:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.434+0000 7f6e19600640 1 -- 172.21.15.31:0/654948177 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c004620 con 0x564e625f0730 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.436+0000 7f6e2e004740 1 -- 172.21.15.31:0/654948177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 msgr2=0x564e625f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.436+0000 7f6e2e004740 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 0x564e625f2bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009bf0 tx=0x7f6e1c005ef0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.438+0000 7f6e2e004740 1 -- 172.21.15.31:0/654948177 shutdown_connections 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.438+0000 7f6e2e004740 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625f0730 0x564e625f2bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.438+0000 7f6e2e004740 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eb5c0 0x564e625f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.438+0000 7f6e2e004740 1 --2- 172.21.15.31:0/654948177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e625eaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.438+0000 7f6e2e004740 1 -- 172.21.15.31:0/654948177 >> 172.21.15.31:0/654948177 conn(0x564e625b2f80 msgr2=0x564e625e6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.439+0000 7f6e2e004740 1 -- 172.21.15.31:0/654948177 shutdown_connections 2024-06-02T22:39:34.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.440+0000 7f6e2e004740 1 -- 172.21.15.31:0/654948177 wait complete. 2024-06-02T22:39:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.441+0000 7f6e2e004740 1 -- start start 2024-06-02T22:39:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.441+0000 7f6e2e004740 1 Processor -- start 2024-06-02T22:39:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e62617460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564e62615690 con 0x564e625eabd0 2024-06-02T22:39:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e625090b0 con 0x564e625eb5c0 2024-06-02T22:39:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564e62615810 con 0x564e625f0730 2024-06-02T22:39:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e2e004740 10 client.0 _ll_register_callbacks cb 0x564e624f4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e29200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e62617460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e62617460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43350/0 (socket says 172.21.15.31:43350) 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e29200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37880/0 (socket says 172.21.15.31:37880) 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.444+0000 7f6e23400640 1 -- 172.21.15.31:0/4257283998 learned_addr learned my addr 172.21.15.31:0/4257283998 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 -- 172.21.15.31:0/4257283998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 msgr2=0x564e62617460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e62617460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 -- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 msgr2=0x564e62616f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 -- 172.21.15.31:0/4257283998 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6232e620 con 0x564e625f0730 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e29200640 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c031ae0 tx=0x7f6e1c009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43aa6bbb4465210f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.445+0000 7f6e0e000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.446+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c053020 con 0x564e625f0730 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.446+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c036040 con 0x564e625f0730 2024-06-02T22:39:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.446+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6e1c04a050 con 0x564e625f0730 2024-06-02T22:39:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.447+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e1c053020 con 0x564e625f0730 2024-06-02T22:39:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.447+0000 7f6e2e004740 10 client.25396 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.447+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e62615690 con 0x564e625f0730 2024-06-02T22:39:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.447+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c036040 con 0x564e625f0730 2024-06-02T22:39:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.447+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6e1c003b10 con 0x564e625f0730 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 10 client.25396 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 10 client.25396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 20 client.25396 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e62622aa0 0x564e62624e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 4 client.25396 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:39:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.448+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e6255bb50 con 0x564e62622aa0 2024-06-02T22:39:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.450+0000 7f6e23e00640 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e62622aa0 0x564e62624e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.452+0000 7f6e23e00640 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e62622aa0 0x564e62624e90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4114cbd874b531 server_cookie=3ccfc70966ea26ec in_seq=0 out_seq=0 2024-06-02T22:39:34.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.452+0000 7f6e0e000640 10 client.25396 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.457+0000 7f6e0e000640 1 -- 172.21.15.31:0/4257283998 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564e6255bb50 con 0x564e62622aa0 2024-06-02T22:39:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.457+0000 7f6e0e000640 10 client.25396 handle_command_reply: tid=0 2024-06-02T22:39:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.457+0000 7f6e2e004740 1 client.25396 shutdown 2024-06-02T22:39:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 msgr2=0x564e6261e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c031ae0 tx=0x7f6e1c009990 comp rx=0 tx=0).stop 2024-06-02T22:39:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 shutdown_connections 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e62622aa0 0x564e62624e90 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625f0730 0x564e6261e4a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e62617460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 --2- 172.21.15.31:0/4257283998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e0e000640 0 client.25396 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.458+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 >> 172.21.15.31:0/4257283998 conn(0x564e625b2f80 msgr2=0x564e625e5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.459+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 shutdown_connections 2024-06-02T22:39:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.461+0000 7f6e2e004740 1 -- 172.21.15.31:0/4257283998 wait complete. 2024-06-02T22:39:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.462+0000 7f6e2e004740 20 client.25396 trim_cache size 0 max 16384 2024-06-02T22:39:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:33 smithi098 ceph-mon[36750]: pgmap v588: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-06-02T22:39:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:33 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:39:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:33 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:39:34.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.502+0000 7f6e2e004740 1 Processor -- start 2024-06-02T22:39:34.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.502+0000 7f6e2e004740 1 -- start start 2024-06-02T22:39:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.502+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e62617460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e2e004740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24128e90 con 0x564e625f0730 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e2e004740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2412a9d0 con 0x564e625eb5c0 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e2e004740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24129560 con 0x564e625eabd0 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43358/0 (socket says 172.21.15.31:43358) 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37896/0 (socket says 172.21.15.31:37896) 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e23400640 1 -- 172.21.15.31:0/1969855250 learned_addr learned my addr 172.21.15.31:0/1969855250 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.503+0000 7f6e29200640 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e62617460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e23400640 1 -- 172.21.15.31:0/1969855250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 msgr2=0x564e62616f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e23400640 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e23400640 1 -- 172.21.15.31:0/1969855250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 msgr2=0x564e62617460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e23400640 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e62617460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e23400640 1 -- 172.21.15.31:0/1969855250 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e62625200 con 0x564e625eb5c0 2024-06-02T22:39:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.504+0000 7f6e29200640 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e62617460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:39:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.505+0000 7f6e23400640 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004290 tx=0x7f6e10014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1d27ca75cbd834 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.505+0000 7f6e18c00640 1 -- 172.21.15.31:0/1969855250 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10004440 con 0x564e625eb5c0 2024-06-02T22:39:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.505+0000 7f6e18c00640 1 -- 172.21.15.31:0/1969855250 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e10005020 con 0x564e625eb5c0 2024-06-02T22:39:34.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.505+0000 7f6e18c00640 1 -- 172.21.15.31:0/1969855250 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10004d50 con 0x564e625eb5c0 2024-06-02T22:39:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.506+0000 7f6e2e004740 1 -- 172.21.15.31:0/1969855250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 msgr2=0x564e6261e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.507+0000 7f6e2e004740 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6e10004290 tx=0x7f6e10014000 comp rx=0 tx=0).stop 2024-06-02T22:39:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.507+0000 7f6e2e004740 1 -- 172.21.15.31:0/1969855250 shutdown_connections 2024-06-02T22:39:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.508+0000 7f6e2e004740 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e62617460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.508+0000 7f6e2e004740 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261e460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.508+0000 7f6e2e004740 1 --2- 172.21.15.31:0/1969855250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e62616f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.508+0000 7f6e2e004740 1 -- 172.21.15.31:0/1969855250 >> 172.21.15.31:0/1969855250 conn(0x564e625b2f80 msgr2=0x564e625ec980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.509+0000 7f6e2e004740 1 -- 172.21.15.31:0/1969855250 shutdown_connections 2024-06-02T22:39:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.509+0000 7f6e2e004740 1 -- 172.21.15.31:0/1969855250 wait complete. 2024-06-02T22:39:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.510+0000 7f6e2e004740 1 -- start start 2024-06-02T22:39:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.510+0000 7f6e2e004740 1 Processor -- start 2024-06-02T22:39:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.511+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e6261b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.511+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e2e004740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e6261cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e2e004740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2412a300 con 0x564e625f0730 2024-06-02T22:39:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e2e004740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24129c30 con 0x564e625eb5c0 2024-06-02T22:39:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e2e004740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6e24126e10 con 0x564e625eabd0 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e6261b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43364/0 (socket says 172.21.15.31:43364) 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23400640 1 -- 172.21.15.31:0/3311783112 learned_addr learned my addr 172.21.15.31:0/3311783112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e2e004740 10 client.0 _ll_register_callbacks cb 0x7f6e10005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e29200640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e6261cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 -- 172.21.15.31:0/3311783112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 msgr2=0x564e6261bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 -- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 msgr2=0x564e6261cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e6261cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e23e00640 1 -- 172.21.15.31:0/3311783112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6261d110 con 0x564e625eabd0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.512+0000 7f6e29200640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e6261cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e23e00640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e6261b620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x564e625ebe20 tx=0x7f6e1409b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dc3d928d2bf2e39 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e0e000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e140a00a0 con 0x564e625eabd0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6e14098360 con 0x564e625eabd0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e10005020 con 0x564e625eabd0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6e140a4960 con 0x564e625eabd0 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e2e004740 10 client.25402 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:34.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.513+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e6261e4d0 con 0x564e625eabd0 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e10005020 con 0x564e625eabd0 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6e140b3040 con 0x564e625eabd0 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 10 client.25402 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 10 client.25402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 20 client.25402 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e6268db30 0x564e6268ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 4 client.25402 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:39:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.514+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e62555ea0 con 0x564e6268db30 2024-06-02T22:39:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.515+0000 7f6e23400640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e6268db30 0x564e6268ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.517+0000 7f6e23400640 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e6268db30 0x564e6268ff50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc787cf822dc4cf server_cookie=8c4f5e572c3a259d in_seq=0 out_seq=0 2024-06-02T22:39:34.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.517+0000 7f6e0e000640 10 client.25402 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.548+0000 7f6e0e000640 1 -- 172.21.15.31:0/3311783112 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564e62555ea0 con 0x564e6268db30 2024-06-02T22:39:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.548+0000 7f6e0e000640 10 client.25402 handle_command_reply: tid=0 2024-06-02T22:39:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.548+0000 7f6e2e004740 1 client.25402 shutdown 2024-06-02T22:39:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.549+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 msgr2=0x564e6261b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.549+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e6261b620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x564e625ebe20 tx=0x7f6e1409b650 comp rx=0 tx=0).stop 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.549+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 shutdown_connections 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e6268db30 0x564e6268ff50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e0e000640 0 client.25402 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e625f0730 0x564e6261cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e625eb5c0 0x564e6261bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 --2- 172.21.15.31:0/3311783112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e625eabd0 0x564e6261b620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 >> 172.21.15.31:0/3311783112 conn(0x564e625b2f80 msgr2=0x564e625e9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 shutdown_connections 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.550+0000 7f6e2e004740 1 -- 172.21.15.31:0/3311783112 wait complete. 2024-06-02T22:39:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.551+0000 7f6e2e004740 20 client.25402 trim_cache size 0 max 16384 2024-06-02T22:39:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:39:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:39:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.551+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 msgr2=0x7f6e080a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.551+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 0x7f6e080a51c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e2411a9e0 tx=0x7f6e10005f90 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.551+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 msgr2=0x7f6e241194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.551+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400e9c0 tx=0x7f6e1400ee80 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 shutdown_connections 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e2410dfb0 0x7f6e241b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e2410d5f0 0x7f6e24119a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 --2- 172.21.15.31:0/2793865162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e2410c400 0x7f6e241194d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 >> 172.21.15.31:0/2793865162 conn(0x7f6e2406c5a0 msgr2=0x7f6e24108c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 shutdown_connections 2024-06-02T22:39:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:34.552+0000 7f6e2b200640 1 -- 172.21.15.31:0/2793865162 wait complete. 2024-06-02T22:39:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 130.0 s, 1078.0 tps, lat 94.822 ms stddev 156.104 2024-06-02T22:39:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:35 smithi098 ceph-mon[36750]: pgmap v589: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.7 MiB/s wr, 597 op/s 2024-06-02T22:39:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:35 smithi178 ceph-mon[36614]: pgmap v589: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.7 MiB/s wr, 597 op/s 2024-06-02T22:39:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:35 smithi031 ceph-mon[31767]: pgmap v589: 129 pgs: 129 active+clean; 1.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.7 MiB/s wr, 597 op/s 2024-06-02T22:39:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:37 smithi178 ceph-mon[36614]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 914 op/s 2024-06-02T22:39:38.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:37 smithi031 ceph-mon[31767]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 914 op/s 2024-06-02T22:39:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:37 smithi098 ceph-mon[36750]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 914 op/s 2024-06-02T22:39:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 135.0 s, 1230.6 tps, lat 78.446 ms stddev 105.608 2024-06-02T22:39:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:39 smithi178 ceph-mon[36614]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-06-02T22:39:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:39 smithi031 ceph-mon[31767]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-06-02T22:39:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:39 smithi098 ceph-mon[36750]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-06-02T22:39:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:41 smithi178 ceph-mon[36614]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-06-02T22:39:42.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:41 smithi031 ceph-mon[31767]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-06-02T22:39:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:41 smithi098 ceph-mon[36750]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-06-02T22:39:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:44 smithi178 ceph-mon[36614]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 929 op/s 2024-06-02T22:39:44.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:44 smithi031 ceph-mon[31767]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 929 op/s 2024-06-02T22:39:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:44 smithi098 ceph-mon[36750]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 929 op/s 2024-06-02T22:39:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 140.0 s, 1021.2 tps, lat 100.939 ms stddev 130.019 2024-06-02T22:39:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:46 smithi178 ceph-mon[36614]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 821 op/s 2024-06-02T22:39:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:46 smithi031 ceph-mon[31767]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 821 op/s 2024-06-02T22:39:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:46 smithi098 ceph-mon[36750]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 821 op/s 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 -- 172.21.15.31:0/837951083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc1057e0 msgr2=0x7f6bdc10c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 --2- 172.21.15.31:0/837951083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc10c070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009be0 tx=0x7f6bd402a6d0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 -- 172.21.15.31:0/837951083 shutdown_connections 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 --2- 172.21.15.31:0/837951083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc10c070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 --2- 172.21.15.31:0/837951083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc104e20 0x7f6bdc1052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 --2- 172.21.15.31:0/837951083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc103c30 0x7f6bdc104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.751+0000 7f6be2400640 1 -- 172.21.15.31:0/837951083 >> 172.21.15.31:0/837951083 conn(0x7f6bdc0ff1c0 msgr2=0x7f6bdc1015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.752+0000 7f6be2400640 1 -- 172.21.15.31:0/837951083 shutdown_connections 2024-06-02T22:39:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.752+0000 7f6be2400640 1 -- 172.21.15.31:0/837951083 wait complete. 2024-06-02T22:39:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 Processor -- start 2024-06-02T22:39:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 -- start start 2024-06-02T22:39:47.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 0x7f6bdc199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 0x7f6bdc19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc10f890 con 0x7f6bdc1057e0 2024-06-02T22:39:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc10f710 con 0x7f6bdc104e20 2024-06-02T22:39:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.753+0000 7f6be2400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc10fa10 con 0x7f6bdc103c30 2024-06-02T22:39:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 0x7f6bdc19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 0x7f6bdc199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 0x7f6bdc19a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44114/0 (socket says 172.21.15.31:44114) 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdaa00640 1 -- 172.21.15.31:0/1069100712 learned_addr learned my addr 172.21.15.31:0/1069100712 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 -- 172.21.15.31:0/1069100712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 msgr2=0x7f6bdc19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 0x7f6bdc19a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 -- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc1057e0 msgr2=0x7f6bdc1a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc1a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.754+0000 7f6bdb400640 1 -- 172.21.15.31:0/1069100712 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc1a1a00 con 0x7f6bdc103c30 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6bdb400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 0x7f6bdc199de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005fd0 tx=0x7f6bcc00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6bd3e00640 1 -- 172.21.15.31:0/1069100712 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00ccc0 con 0x7f6bdc103c30 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc1a1cf0 con 0x7f6bdc103c30 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bdc1a21d0 con 0x7f6bdc103c30 2024-06-02T22:39:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6bd3e00640 1 -- 172.21.15.31:0/1069100712 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bcc00ee70 con 0x7f6bdc103c30 2024-06-02T22:39:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.755+0000 7f6bd3e00640 1 -- 172.21.15.31:0/1069100712 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc003db0 con 0x7f6bdc103c30 2024-06-02T22:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.758+0000 7f6be53bc740 1 Processor -- start 2024-06-02T22:39:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 -- start start 2024-06-02T22:39:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d03023f420 con 0x55d0302e9f40 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0301e6c50 con 0x55d0302e4dd0 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.759+0000 7f6be53bc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d03023b3e0 con 0x55d0302e43e0 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.760+0000 7f6bd3e00640 1 -- 172.21.15.31:0/1069100712 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6bcc021430 con 0x7f6bdc103c30 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.760+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.760+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40078/0 (socket says 172.21.15.31:40078) 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.760+0000 7f6bdbe00640 1 -- 172.21.15.31:0/2073756352 learned_addr learned my addr 172.21.15.31:0/2073756352 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.760+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.761+0000 7f6bdaa00640 1 -- 172.21.15.31:0/2073756352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 msgr2=0x55d0302e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.761+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302e4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.761+0000 7f6bdaa00640 1 -- 172.21.15.31:0/2073756352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 msgr2=0x55d0302e98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.762+0000 7f6bdb400640 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.762+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.762+0000 7f6bdaa00640 1 -- 172.21.15.31:0/2073756352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d02ff53210 con 0x55d0302e9f40 2024-06-02T22:39:47.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.762+0000 7f6bd3e00640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 0x7f6bc00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.763+0000 7f6bd3e00640 1 -- 172.21.15.31:0/1069100712 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6bcc0cf5f0 con 0x7f6bdc103c30 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.763+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 0x7f6bc00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.763+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302ec3d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8005fd0 tx=0x7f6bc80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2173858dc8e9898 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.764+0000 7f6bd0c00640 1 -- 172.21.15.31:0/2073756352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8004230 con 0x55d0302e9f40 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.764+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 0x7f6bc00a5170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40099a0 tx=0x7f6bd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.764+0000 7f6bd0c00640 1 -- 172.21.15.31:0/2073756352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bc800be90 con 0x55d0302e9f40 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.764+0000 7f6bd0c00640 1 -- 172.21.15.31:0/2073756352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011770 con 0x55d0302e9f40 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.765+0000 7f6be53bc740 1 -- 172.21.15.31:0/2073756352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 msgr2=0x55d0302ec3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.765+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302ec3d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8005fd0 tx=0x7f6bc80107a0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 -- 172.21.15.31:0/2073756352 shutdown_connections 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302ec3d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302e98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2073756352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 -- 172.21.15.31:0/2073756352 >> 172.21.15.31:0/2073756352 conn(0x55d0302a3f80 msgr2=0x55d0302dfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 -- 172.21.15.31:0/2073756352 shutdown_connections 2024-06-02T22:39:47.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 -- 172.21.15.31:0/2073756352 wait complete. 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 -- start start 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.766+0000 7f6be53bc740 1 Processor -- start 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 0x55d0302ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302eed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0302ecf40 con 0x55d0302e4dd0 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0301fa0b0 con 0x55d0302e43e0 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d0302ed0c0 con 0x55d0302e9f40 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6be53bc740 10 client.0 _ll_register_callbacks cb 0x55d0301e5f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40086/0 (socket says 172.21.15.31:40086) 2024-06-02T22:39:47.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6bdbe00640 1 -- 172.21.15.31:0/2615032681 learned_addr learned my addr 172.21.15.31:0/2615032681 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.767+0000 7f6bdb400640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 0x55d0302ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 -- 172.21.15.31:0/2615032681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 msgr2=0x55d0302ee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 0x55d0302ee7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 -- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 msgr2=0x55d0302eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302eed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 -- 172.21.15.31:0/2615032681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d03001f620 con 0x55d0302e9f40 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdb400640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 0x55d0302ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:39:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4030f70 tx=0x7f6bd4009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da12b2f29b03ab0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bc5600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd404f070 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.768+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bc800be90 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6bd4004040 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6bd405b050 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 10 client.25414 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0302f9160 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bc800be90 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6bd404ba90 con 0x55d0302e9f40 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 10 client.25414 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 10 client.25414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 20 client.25414 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302fa8c0 0x55d0302fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 4 client.25414 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:39:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.769+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d03024cb50 con 0x55d0302fa8c0 2024-06-02T22:39:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.770+0000 7f6bdb400640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302fa8c0 0x55d0302fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.771+0000 7f6bdb400640 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302fa8c0 0x55d0302fcd10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf390f9979af650 server_cookie=cf6226662c08b0b2 in_seq=0 out_seq=0 2024-06-02T22:39:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.771+0000 7f6bc5600640 10 client.25414 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.772+0000 7f6bc5600640 1 -- 172.21.15.31:0/2615032681 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d03024cb50 con 0x55d0302fa8c0 2024-06-02T22:39:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.772+0000 7f6bc5600640 10 client.25414 handle_command_reply: tid=0 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 client.25414 shutdown 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 msgr2=0x55d0302f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4030f70 tx=0x7f6bd4009500 comp rx=0 tx=0).stop 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 shutdown_connections 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302fa8c0 0x55d0302fcd10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e9f40 0x55d0302f5d00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6bc5600640 0 client.25414 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 --2- 172.21.15.31:0/2615032681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e43e0 0x55d0302ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.773 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.773+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 >> 172.21.15.31:0/2615032681 conn(0x55d0302a3f80 msgr2=0x55d0302d6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.774+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 shutdown_connections 2024-06-02T22:39:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.774+0000 7f6be53bc740 1 -- 172.21.15.31:0/2615032681 wait complete. 2024-06-02T22:39:47.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.774+0000 7f6be53bc740 20 client.25414 trim_cache size 0 max 16384 2024-06-02T22:39:47.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.801+0000 7f6be53bc740 1 Processor -- start 2024-06-02T22:39:47.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 -- start start 2024-06-02T22:39:47.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302ec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc00fbc0 con 0x55d0302e4dd0 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc011700 con 0x55d0302e9f40 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6be53bc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc010290 con 0x55d0302e43e0 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44138/0 (socket says 172.21.15.31:44138) 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6bdb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.802+0000 7f6bdbe00640 1 -- 172.21.15.31:0/4174524843 learned_addr learned my addr 172.21.15.31:0/4174524843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 -- 172.21.15.31:0/4174524843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 msgr2=0x55d0302ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 -- 172.21.15.31:0/4174524843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 msgr2=0x55d0302f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 -- 172.21.15.31:0/4174524843 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0302e93c0 con 0x55d0302e9f40 2024-06-02T22:39:47.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:39:47.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bdbe00640 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bd402abf0 tx=0x7f6bd4030b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91577886c5f84ca7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bc7e00640 1 -- 172.21.15.31:0/4174524843 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd404f040 con 0x55d0302e9f40 2024-06-02T22:39:47.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bc7e00640 1 -- 172.21.15.31:0/4174524843 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd404b930 con 0x55d0302e9f40 2024-06-02T22:39:47.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.803+0000 7f6bc7e00640 1 -- 172.21.15.31:0/4174524843 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4036040 con 0x55d0302e9f40 2024-06-02T22:39:47.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 -- 172.21.15.31:0/4174524843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 msgr2=0x55d0302edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bd402abf0 tx=0x7f6bd4030b30 comp rx=0 tx=0).stop 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 -- 172.21.15.31:0/4174524843 shutdown_connections 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e9f40 0x55d0302edac0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e4dd0 0x55d0302f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 --2- 172.21.15.31:0/4174524843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.804+0000 7f6be53bc740 1 -- 172.21.15.31:0/4174524843 >> 172.21.15.31:0/4174524843 conn(0x55d0302a3f80 msgr2=0x55d0302e60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.805+0000 7f6be53bc740 1 -- 172.21.15.31:0/4174524843 shutdown_connections 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.805+0000 7f6be53bc740 1 -- 172.21.15.31:0/4174524843 wait complete. 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.805+0000 7f6be53bc740 1 -- start start 2024-06-02T22:39:47.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.805+0000 7f6be53bc740 1 Processor -- start 2024-06-02T22:39:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.806+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.806+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.806+0000 7f6be53bc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302d8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302f0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40108/0 (socket says 172.21.15.31:40108) 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302d8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdaa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44142/0 (socket says 172.21.15.31:44142) 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc011030 con 0x55d0302e9f40 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6bdb400640 1 -- 172.21.15.31:0/3735267640 learned_addr learned my addr 172.21.15.31:0/3735267640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc010960 con 0x55d0302e4dd0 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc00dba0 con 0x55d0302e43e0 2024-06-02T22:39:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.807+0000 7f6be53bc740 10 client.0 _ll_register_callbacks cb 0x7f6bd4009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.808+0000 7f6bdaa00640 1 -- 172.21.15.31:0/3735267640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 msgr2=0x55d0302f0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.808+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302f0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.808+0000 7f6bdaa00640 1 -- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 msgr2=0x55d0302d8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.808+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302d8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.808+0000 7f6bdaa00640 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0302d94f0 con 0x55d0302e4dd0 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.809+0000 7f6bdaa00640 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55d0302e96d0 tx=0x7f6bc80058f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4fd874b4da8bab server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:39:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.809+0000 7f6bc5600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.809+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8004410 con 0x55d0302e4dd0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.809+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6bc80035f0 con 0x55d0302e4dd0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.809+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd404b930 con 0x55d0302e4dd0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6bc8034050 con 0x55d0302e4dd0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6be53bc740 10 client.25409 fetch_fsmap learned FSMap version 30 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0302da770 con 0x55d0302e4dd0 2024-06-02T22:39:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd404b930 con 0x55d0302e4dd0 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6bc8011910 con 0x55d0302e4dd0 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6be53bc740 10 client.25409 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.810+0000 7f6be53bc740 10 client.25409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.811+0000 7f6be53bc740 20 client.25409 populate_metadata read hostname 'smithi031' 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.811+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302daee0 0x55d0302dd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.811+0000 7f6be53bc740 4 client.25409 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:39:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.811+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d030246ea0 con 0x55d0302daee0 2024-06-02T22:39:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.811+0000 7f6bdb400640 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302daee0 0x55d0302dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:39:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.812+0000 7f6bdb400640 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302daee0 0x55d0302dd300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=714b719adaf2e443 server_cookie=af32a7dd908d9f6d in_seq=0 out_seq=0 2024-06-02T22:39:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.812+0000 7f6bc5600640 10 client.25409 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.870+0000 7f6bc5600640 1 -- 172.21.15.31:0/3735267640 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d030246ea0 con 0x55d0302daee0 2024-06-02T22:39:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.870+0000 7f6bc5600640 10 client.25409 handle_command_reply: tid=0 2024-06-02T22:39:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.870+0000 7f6be53bc740 1 client.25409 shutdown 2024-06-02T22:39:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.872+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 msgr2=0x55d0302f1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.872+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55d0302e96d0 tx=0x7f6bc80058f0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 shutdown_connections 2024-06-02T22:39:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0302daee0 0x55d0302dd300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0302e9f40 0x55d0302d8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0302e4dd0 0x55d0302f1470 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 --2- 172.21.15.31:0/3735267640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0302e43e0 0x55d0302f0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 >> 172.21.15.31:0/3735267640 conn(0x55d0302a3f80 msgr2=0x55d0302edac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.873+0000 7f6bc5600640 0 client.25409 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.874+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 shutdown_connections 2024-06-02T22:39:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.874+0000 7f6be53bc740 1 -- 172.21.15.31:0/3735267640 wait complete. 2024-06-02T22:39:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.874+0000 7f6be53bc740 20 client.25409 trim_cache size 0 max 16384 2024-06-02T22:39:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:39:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:39:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 msgr2=0x7f6bc00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 0x7f6bc00a5170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40099a0 tx=0x7f6bd4005fd0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 msgr2=0x7f6bdc199de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 0x7f6bdc199de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc005fd0 tx=0x7f6bcc00ec20 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 shutdown_connections 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6bc00a2cb0 0x7f6bc00a5170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6bdc1057e0 0x7f6bdc1a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bdc104e20 0x7f6bdc19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 --2- 172.21.15.31:0/1069100712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bdc103c30 0x7f6bdc199de0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.877+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 >> 172.21.15.31:0/1069100712 conn(0x7f6bdc0ff1c0 msgr2=0x7f6bdc108050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:39:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.878+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 shutdown_connections 2024-06-02T22:39:47.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:39:47.878+0000 7f6be2400640 1 -- 172.21.15.31:0/1069100712 wait complete. 2024-06-02T22:39:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:48 smithi178 ceph-mon[36614]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T22:39:48.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:48 smithi031 ceph-mon[31767]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T22:39:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:48 smithi098 ceph-mon[36750]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 955 op/s 2024-06-02T22:39:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 145.0 s, 1473.4 tps, lat 68.435 ms stddev 88.923 2024-06-02T22:39:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:50 smithi178 ceph-mon[36614]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-06-02T22:39:50.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:50 smithi031 ceph-mon[31767]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-06-02T22:39:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:50 smithi098 ceph-mon[36750]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 5.7 MiB/s wr, 596 op/s 2024-06-02T22:39:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:52 smithi178 ceph-mon[36614]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-06-02T22:39:52.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:52 smithi031 ceph-mon[31767]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-06-02T22:39:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:52 smithi098 ceph-mon[36750]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.0 MiB/s wr, 646 op/s 2024-06-02T22:39:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:54 smithi178 ceph-mon[36614]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.0 MiB/s wr, 640 op/s 2024-06-02T22:39:54.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:54 smithi031 ceph-mon[31767]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.0 MiB/s wr, 640 op/s 2024-06-02T22:39:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:54 smithi098 ceph-mon[36750]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.0 MiB/s wr, 640 op/s 2024-06-02T22:39:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 150.0 s, 1879.4 tps, lat 52.485 ms stddev 64.031 2024-06-02T22:39:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:56 smithi178 ceph-mon[36614]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 581 op/s 2024-06-02T22:39:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:56 smithi031 ceph-mon[31767]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 581 op/s 2024-06-02T22:39:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:56 smithi098 ceph-mon[36750]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.9 MiB/s wr, 581 op/s 2024-06-02T22:39:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:39:58 smithi031 ceph-mon[31767]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-06-02T22:39:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:39:58 smithi098 ceph-mon[36750]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-06-02T22:39:58.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:39:58 smithi178 ceph-mon[36614]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 690 op/s 2024-06-02T22:40:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 155.0 s, 1899.6 tps, lat 53.310 ms stddev 64.777 2024-06-02T22:40:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:00 smithi031 ceph-mon[31767]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 586 op/s 2024-06-02T22:40:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:00 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:40:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:00 smithi098 ceph-mon[36750]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 586 op/s 2024-06-02T22:40:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:00 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:40:00.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:00 smithi178 ceph-mon[36614]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 586 op/s 2024-06-02T22:40:00.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:00 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:40:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.086+0000 7effbac00640 1 -- 172.21.15.31:0/1564937012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410a200 msgr2=0x7effb410a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.086+0000 7effbac00640 1 --2- 172.21.15.31:0/1564937012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410a200 0x7effb410a620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7effa4009900 tx=0x7effa402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.089+0000 7effbac00640 1 -- 172.21.15.31:0/1564937012 shutdown_connections 2024-06-02T22:40:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.089+0000 7effbac00640 1 --2- 172.21.15.31:0/1564937012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effb410bdb0 0x7effb4112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.089+0000 7effbac00640 1 --2- 172.21.15.31:0/1564937012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effb410b3f0 0x7effb410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.089+0000 7effbac00640 1 --2- 172.21.15.31:0/1564937012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410a200 0x7effb410a620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.089+0000 7effbac00640 1 -- 172.21.15.31:0/1564937012 >> 172.21.15.31:0/1564937012 conn(0x7effb40709a0 msgr2=0x7effb4072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.092+0000 7effbac00640 1 -- 172.21.15.31:0/1564937012 shutdown_connections 2024-06-02T22:40:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.092+0000 7effbac00640 1 -- 172.21.15.31:0/1564937012 wait complete. 2024-06-02T22:40:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.093+0000 7effbac00640 1 Processor -- start 2024-06-02T22:40:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.093+0000 7effbac00640 1 -- start start 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effb410a200 0x7effb4119510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effb410bdb0 0x7effb41b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7effb406cfe0 con 0x7effb410a200 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effb406ce60 con 0x7effb410bdb0 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effbac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7effb406d160 con 0x7effb410b3f0 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effb3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effb3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39542/0 (socket says 172.21.15.31:39542) 2024-06-02T22:40:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.094+0000 7effb3400640 1 -- 172.21.15.31:0/1312411783 learned_addr learned my addr 172.21.15.31:0/1312411783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 -- 172.21.15.31:0/1312411783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effb410bdb0 msgr2=0x7effb41b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effb410bdb0 0x7effb41b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 -- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effb410a200 msgr2=0x7effb4119510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effb410a200 0x7effb4119510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 -- 172.21.15.31:0/1312411783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4120bf0 con 0x7effb410b3f0 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.095+0000 7effb3400640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effa000eab0 tx=0x7effa000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.096+0000 7effb0c00640 1 -- 172.21.15.31:0/1312411783 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa000ce40 con 0x7effb410b3f0 2024-06-02T22:40:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.096+0000 7effb0c00640 1 -- 172.21.15.31:0/1312411783 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effa0011950 con 0x7effb410b3f0 2024-06-02T22:40:01.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.096+0000 7effb0c00640 1 -- 172.21.15.31:0/1312411783 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0010b40 con 0x7effb410b3f0 2024-06-02T22:40:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.096+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb41b7190 con 0x7effb410b3f0 2024-06-02T22:40:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.096+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41b7660 con 0x7effb410b3f0 2024-06-02T22:40:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.104+0000 7effbda51740 1 Processor -- start 2024-06-02T22:40:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.104+0000 7effbda51740 1 -- start start 2024-06-02T22:40:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.104+0000 7effb0c00640 1 -- 172.21.15.31:0/1312411783 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7effa0010ce0 con 0x7effb410b3f0 2024-06-02T22:40:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e5285c0 0x563b8e52d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e52d730 0x563b8e52fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b8e48b420 con 0x563b8e5285c0 2024-06-02T22:40:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563b8e432c50 con 0x563b8e527bd0 2024-06-02T22:40:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effbda51740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563b8e4873e0 con 0x563b8e52d730 2024-06-02T22:40:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effb8c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effb8c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:37448/0 (socket says 172.21.15.31:37448) 2024-06-02T22:40:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.105+0000 7effb8c00640 1 -- 172.21.15.31:0/4290311454 learned_addr learned my addr 172.21.15.31:0/4290311454 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.106+0000 7effb8c00640 1 -- 172.21.15.31:0/4290311454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e52d730 msgr2=0x563b8e52fbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:40:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.106+0000 7effb8c00640 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e52d730 0x563b8e52fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.106+0000 7effb8c00640 1 -- 172.21.15.31:0/4290311454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e5285c0 msgr2=0x563b8e52d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.106+0000 7effb8c00640 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e5285c0 0x563b8e52d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.106+0000 7effb8c00640 1 -- 172.21.15.31:0/4290311454 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8e19f210 con 0x563b8e527bd0 2024-06-02T22:40:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.107+0000 7effb8c00640 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7effac00a9f0 tx=0x7effac00aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ab00c92ed7cd40 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.108+0000 7effa9200640 1 -- 172.21.15.31:0/4290311454 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac00cde0 con 0x563b8e527bd0 2024-06-02T22:40:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.108+0000 7effb0c00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 0x7eff980a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.109+0000 7effa9200640 1 -- 172.21.15.31:0/4290311454 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effac00f930 con 0x563b8e527bd0 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.109+0000 7effbda51740 1 -- 172.21.15.31:0/4290311454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 msgr2=0x563b8e527ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.109+0000 7effbda51740 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7effac00a9f0 tx=0x7effac00aeb0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effb3e00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 0x7eff980a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effb0c00640 1 -- 172.21.15.31:0/1312411783 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7effa00cfab0 con 0x7effb410b3f0 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effbda51740 1 -- 172.21.15.31:0/4290311454 shutdown_connections 2024-06-02T22:40:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effbda51740 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e52d730 0x563b8e52fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effbda51740 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e5285c0 0x563b8e52d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effbda51740 1 --2- 172.21.15.31:0/4290311454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e527ff0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.110+0000 7effbda51740 1 -- 172.21.15.31:0/4290311454 >> 172.21.15.31:0/4290311454 conn(0x563b8e4eff80 msgr2=0x563b8e523650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.111+0000 7effbda51740 1 -- 172.21.15.31:0/4290311454 shutdown_connections 2024-06-02T22:40:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.111+0000 7effbda51740 1 -- 172.21.15.31:0/4290311454 wait complete. 2024-06-02T22:40:01.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.113+0000 7effb3e00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 0x7eff980a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7effa402a430 tx=0x7effa4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.114+0000 7effbda51740 1 -- start start 2024-06-02T22:40:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.114+0000 7effbda51740 1 Processor -- start 2024-06-02T22:40:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 0x563b8e531f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.114 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e52d730 0x563b8e5394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563b8e530780 con 0x563b8e527bd0 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563b8e4460b0 con 0x563b8e52d730 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563b8e530900 con 0x563b8e5285c0 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effbda51740 10 client.0 _ll_register_callbacks cb 0x563b8e431f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effb3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effb3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39570/0 (socket says 172.21.15.31:39570) 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effb3400640 1 -- 172.21.15.31:0/1013330746 learned_addr learned my addr 172.21.15.31:0/1013330746 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:01.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.115+0000 7effb8c00640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e52d730 0x563b8e5394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3e00640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 0x563b8e531f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3400640 1 -- 172.21.15.31:0/1013330746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e52d730 msgr2=0x563b8e5394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3400640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e52d730 0x563b8e5394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3400640 1 -- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 msgr2=0x563b8e531f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3400640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 0x563b8e531f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3400640 1 -- 172.21.15.31:0/1013330746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b8e26b620 con 0x563b8e5285c0 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.116+0000 7effb3e00640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 0x563b8e531f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:01.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.117+0000 7effb3400640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effa00988f0 tx=0x7effa009c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f806687cfba491 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.117+0000 7eff9d600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:40:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.121+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00b7060 con 0x563b8e5285c0 2024-06-02T22:40:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.121+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7effa009c180 con 0x563b8e5285c0 2024-06-02T22:40:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.122+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effac00f930 con 0x563b8e5285c0 2024-06-02T22:40:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.122+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7effa00a4b90 con 0x563b8e5285c0 2024-06-02T22:40:01.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.122+0000 7effbda51740 10 client.25429 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.122+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563b8e53c8c0 con 0x563b8e5285c0 2024-06-02T22:40:01.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.123+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effac00f930 con 0x563b8e5285c0 2024-06-02T22:40:01.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.124+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7effa009f030 con 0x563b8e5285c0 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.124+0000 7effbda51740 10 client.25429 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.124+0000 7effbda51740 10 client.25429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.124+0000 7effbda51740 20 client.25429 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.124+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e53e4c0 0x563b8e5408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.125+0000 7effbda51740 4 client.25429 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.125+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b8e498b50 con 0x563b8e53e4c0 2024-06-02T22:40:01.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.125+0000 7effb3e00640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e53e4c0 0x563b8e5408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.127+0000 7eff9d600640 10 client.25429 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:01.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.127+0000 7effb3e00640 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e53e4c0 0x563b8e5408e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d168c68128a598 server_cookie=e14fb509eab1ea7e in_seq=0 out_seq=0 2024-06-02T22:40:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.128+0000 7eff9d600640 1 -- 172.21.15.31:0/1013330746 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563b8e498b50 con 0x563b8e53e4c0 2024-06-02T22:40:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.128+0000 7eff9d600640 10 client.25429 handle_command_reply: tid=0 2024-06-02T22:40:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.128+0000 7effbda51740 1 client.25429 shutdown 2024-06-02T22:40:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 msgr2=0x563b8e5324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7effa00988f0 tx=0x7effa009c620 comp rx=0 tx=0).stop 2024-06-02T22:40:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 shutdown_connections 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e53e4c0 0x563b8e5408e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e52d730 0x563b8e5394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e5324a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 --2- 172.21.15.31:0/1013330746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e527bd0 0x563b8e531f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 >> 172.21.15.31:0/1013330746 conn(0x563b8e4eff80 msgr2=0x563b8e522810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7eff9d600640 0 client.25429 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 shutdown_connections 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.129+0000 7effbda51740 1 -- 172.21.15.31:0/1013330746 wait complete. 2024-06-02T22:40:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.130+0000 7effbda51740 20 client.25429 trim_cache size 0 max 16384 2024-06-02T22:40:01.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 Processor -- start 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 -- start start 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e51e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e539400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff9400fc80 con 0x563b8e52d730 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff940117c0 con 0x563b8e527bd0 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.165+0000 7effbda51740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7eff94010350 con 0x563b8e5285c0 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.166+0000 7effb8c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.166+0000 7effb8c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55562/0 (socket says 172.21.15.31:55562) 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.166+0000 7effb8c00640 1 -- 172.21.15.31:0/2813746332 learned_addr learned my addr 172.21.15.31:0/2813746332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:01.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.166+0000 7effb3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e539400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb3400640 1 -- 172.21.15.31:0/2813746332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 msgr2=0x563b8e51e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb3400640 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e51e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb3400640 1 -- 172.21.15.31:0/2813746332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 msgr2=0x563b8e526a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb3400640 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb3400640 1 -- 172.21.15.31:0/2813746332 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b8e529290 con 0x563b8e5285c0 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.167+0000 7effb8c00640 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.168+0000 7effb3400640 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e539400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa00cf670 tx=0x7effa00a4a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb275f535f2ca983 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.168+0000 7eff9fe00640 1 -- 172.21.15.31:0/2813746332 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00a4b90 con 0x563b8e5285c0 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.168+0000 7eff9fe00640 1 -- 172.21.15.31:0/2813746332 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effac00f930 con 0x563b8e5285c0 2024-06-02T22:40:01.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.168+0000 7eff9fe00640 1 -- 172.21.15.31:0/2813746332 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00cf110 con 0x563b8e5285c0 2024-06-02T22:40:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.169+0000 7effbda51740 1 -- 172.21.15.31:0/2813746332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 msgr2=0x563b8e539400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.169+0000 7effbda51740 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e539400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7effa00cf670 tx=0x7effa00a4a00 comp rx=0 tx=0).stop 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 -- 172.21.15.31:0/2813746332 shutdown_connections 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e526a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e539400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 --2- 172.21.15.31:0/2813746332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e51e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 -- 172.21.15.31:0/2813746332 >> 172.21.15.31:0/2813746332 conn(0x563b8e4eff80 msgr2=0x563b8e526310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 -- 172.21.15.31:0/2813746332 shutdown_connections 2024-06-02T22:40:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.171+0000 7effbda51740 1 -- 172.21.15.31:0/2813746332 wait complete. 2024-06-02T22:40:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.172+0000 7effbda51740 1 -- start start 2024-06-02T22:40:01.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.172+0000 7effbda51740 1 Processor -- start 2024-06-02T22:40:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.173+0000 7effbda51740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.173+0000 7effbda51740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e536de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effb3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effb3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:37480/0 (socket says 172.21.15.31:37480) 2024-06-02T22:40:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effb3e00640 1 -- 172.21.15.31:0/402606857 learned_addr learned my addr 172.21.15.31:0/402606857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e537df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effb3400640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e536de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff940110f0 con 0x563b8e52d730 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff94010a20 con 0x563b8e527bd0 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7eff9400dc20 con 0x563b8e5285c0 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.174+0000 7effbda51740 10 client.0 _ll_register_callbacks cb 0x7effa009ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 -- 172.21.15.31:0/402606857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 msgr2=0x563b8e536de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e536de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 -- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 msgr2=0x563b8e537df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e537df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b8e5383e0 con 0x563b8e527bd0 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7effb3e00640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effa40314e0 tx=0x7effa4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299ce86ad24a5c44 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.175+0000 7eff9d600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:40:01.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.176+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa4054060 con 0x563b8e527bd0 2024-06-02T22:40:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.177+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7effa40037f0 con 0x563b8e527bd0 2024-06-02T22:40:01.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.177+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effac00f930 con 0x563b8e527bd0 2024-06-02T22:40:01.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.177+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7effa4035040 con 0x563b8e527bd0 2024-06-02T22:40:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.181+0000 7effbda51740 10 client.25421 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.181+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563b8e539770 con 0x563b8e527bd0 2024-06-02T22:40:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.181+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effac00f930 con 0x563b8e527bd0 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.182+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7effa4048a00 con 0x563b8e527bd0 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.182+0000 7effbda51740 10 client.25421 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.182+0000 7effbda51740 10 client.25421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.182+0000 7effbda51740 20 client.25421 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.182+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e5a9900 0x563b8e5abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.183+0000 7effbda51740 4 client.25421 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.183+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b8e51ed80 con 0x563b8e5a9900 2024-06-02T22:40:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.183+0000 7effb3400640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e5a9900 0x563b8e5abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.184+0000 7effb3400640 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e5a9900 0x563b8e5abd20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a33d426988ba4ce server_cookie=422ea5b70049d662 in_seq=0 out_seq=0 2024-06-02T22:40:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.184+0000 7eff9d600640 10 client.25421 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.238+0000 7eff9d600640 1 -- 172.21.15.31:0/402606857 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563b8e51ed80 con 0x563b8e5a9900 2024-06-02T22:40:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.238+0000 7eff9d600640 10 client.25421 handle_command_reply: tid=0 2024-06-02T22:40:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.238+0000 7effbda51740 1 client.25421 shutdown 2024-06-02T22:40:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.238+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 msgr2=0x563b8e5368a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.238+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7effa40314e0 tx=0x7effa4000bc0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 shutdown_connections 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563b8e5a9900 0x563b8e5abd20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563b8e52d730 0x563b8e537df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563b8e5285c0 0x563b8e536de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 --2- 172.21.15.31:0/402606857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b8e527bd0 0x563b8e5368a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7eff9d600640 0 client.25421 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.239+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 >> 172.21.15.31:0/402606857 conn(0x563b8e4eff80 msgr2=0x563b8e526ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.240+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 shutdown_connections 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.240+0000 7effbda51740 1 -- 172.21.15.31:0/402606857 wait complete. 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.240+0000 7effbda51740 20 client.25421 trim_cache size 0 max 16384 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:40:01.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 msgr2=0x7eff980a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 0x7eff980a50f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7effa402a430 tx=0x7effa4031400 comp rx=0 tx=0).stop 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 msgr2=0x7effb4119a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effa000eab0 tx=0x7effa000ef70 comp rx=0 tx=0).stop 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 shutdown_connections 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7eff980a2c30 0x7eff980a50f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effb410bdb0 0x7effb41b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb410b3f0 0x7effb4119a50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 --2- 172.21.15.31:0/1312411783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effb410a200 0x7effb4119510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 >> 172.21.15.31:0/1312411783 conn(0x7effb40709a0 msgr2=0x7effb410e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.242+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 shutdown_connections 2024-06-02T22:40:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:01.243+0000 7effbac00640 1 -- 172.21.15.31:0/1312411783 wait complete. 2024-06-02T22:40:02.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:02 smithi031 ceph-mon[31767]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-06-02T22:40:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:02 smithi098 ceph-mon[36750]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-06-02T22:40:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:02 smithi178 ceph-mon[36614]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-06-02T22:40:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:04 smithi031 ceph-mon[31767]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-06-02T22:40:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:04 smithi098 ceph-mon[36750]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-06-02T22:40:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:04 smithi178 ceph-mon[36614]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 MiB/s wr, 640 op/s 2024-06-02T22:40:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 160.0 s, 2101.6 tps, lat 47.539 ms stddev 59.616 2024-06-02T22:40:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:06 smithi031 ceph-mon[31767]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 552 op/s 2024-06-02T22:40:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:06 smithi098 ceph-mon[36750]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 552 op/s 2024-06-02T22:40:06.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:06 smithi178 ceph-mon[36614]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 MiB/s wr, 552 op/s 2024-06-02T22:40:08.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:08 smithi031 ceph-mon[31767]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.5 MiB/s wr, 706 op/s 2024-06-02T22:40:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:08 smithi098 ceph-mon[36750]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.5 MiB/s wr, 706 op/s 2024-06-02T22:40:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:08 smithi178 ceph-mon[36614]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.5 MiB/s wr, 706 op/s 2024-06-02T22:40:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 165.0 s, 1361.8 tps, lat 72.396 ms stddev 89.550 2024-06-02T22:40:10.363 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:10 smithi178 ceph-mon[36614]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 662 op/s 2024-06-02T22:40:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:10 smithi031 ceph-mon[31767]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 662 op/s 2024-06-02T22:40:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:10 smithi098 ceph-mon[36750]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 662 op/s 2024-06-02T22:40:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:12 smithi178 ceph-mon[36614]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-06-02T22:40:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:12 smithi031 ceph-mon[31767]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-06-02T22:40:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:12 smithi098 ceph-mon[36750]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 682 op/s 2024-06-02T22:40:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.451+0000 7f23d5600640 1 -- 172.21.15.31:0/2956752217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 msgr2=0x7f23d0104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.451+0000 7f23d5600640 1 --2- 172.21.15.31:0/2956752217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0104020 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009900 tx=0x7f23bc02a410 comp rx=0 tx=0).stop 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 -- 172.21.15.31:0/2956752217 shutdown_connections 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 --2- 172.21.15.31:0/2956752217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d010c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 --2- 172.21.15.31:0/2956752217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 0x7f23d0105270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 --2- 172.21.15.31:0/2956752217 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0104020 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 -- 172.21.15.31:0/2956752217 >> 172.21.15.31:0/2956752217 conn(0x7f23d00ff190 msgr2=0x7f23d01015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 -- 172.21.15.31:0/2956752217 shutdown_connections 2024-06-02T22:40:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.452+0000 7f23d5600640 1 -- 172.21.15.31:0/2956752217 wait complete. 2024-06-02T22:40:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.454+0000 7f23d5600640 1 Processor -- start 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.454+0000 7f23d5600640 1 -- start start 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 0x7f23d0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23d006bcc0 con 0x7f23d0104df0 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23d006bb40 con 0x7f23d0103c00 2024-06-02T22:40:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23d5600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23d006be40 con 0x7f23d01057b0 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23cf400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40080/0 (socket says 172.21.15.31:40080) 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23cf400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:52814/0 (socket says 172.21.15.31:52814) 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23cea00640 1 -- 172.21.15.31:0/666466905 learned_addr learned my addr 172.21.15.31:0/666466905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.455+0000 7f23ce000640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 0x7f23d0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.456+0000 7f23cf400640 1 -- 172.21.15.31:0/666466905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 msgr2=0x7f23d0071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.456+0000 7f23cf400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.456+0000 7f23cf400640 1 -- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 msgr2=0x7f23d0071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.456+0000 7f23cf400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 0x7f23d0071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.456+0000 7f23cf400640 1 -- 172.21.15.31:0/666466905 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d0073160 con 0x7f23d01057b0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23cea00640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23cf400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23c800e940 tx=0x7f23c800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23c7400640 1 -- 172.21.15.31:0/666466905 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8004d20 con 0x7f23d01057b0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23c7400640 1 -- 172.21.15.31:0/666466905 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c8005020 con 0x7f23d01057b0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23c7400640 1 -- 172.21.15.31:0/666466905 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80116d0 con 0x7f23d01057b0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.457+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d0073450 con 0x7f23d01057b0 2024-06-02T22:40:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.458+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d0073950 con 0x7f23d01057b0 2024-06-02T22:40:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:14 smithi098 ceph-mon[36750]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 668 op/s 2024-06-02T22:40:14.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.465+0000 7f23d83cc740 1 Processor -- start 2024-06-02T22:40:14.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.466+0000 7f23c7400640 1 -- 172.21.15.31:0/666466905 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f23c80054d0 con 0x7f23d01057b0 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 -- start start 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb000f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb00173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563baff6a420 con 0x563bb000fdd0 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563baff11c50 con 0x563bb000f3e0 2024-06-02T22:40:14.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.469+0000 7f23d83cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563baff663e0 con 0x563bb0014f40 2024-06-02T22:40:14.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.470+0000 7f23ce000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb00173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.471+0000 7f23c7400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 0x7f23b40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.471+0000 7f23c7400640 1 -- 172.21.15.31:0/666466905 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f23c80cf340 con 0x7f23d01057b0 2024-06-02T22:40:14.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.471+0000 7f23cea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.471+0000 7f23cea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40606/0 (socket says 172.21.15.31:40606) 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.472+0000 7f23cea00640 1 -- 172.21.15.31:0/3735760595 learned_addr learned my addr 172.21.15.31:0/3735760595 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.472+0000 7f23ce000640 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb000f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cf400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 0x7f23b40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 -- 172.21.15.31:0/3735760595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 msgr2=0x563bb00173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb00173d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 -- 172.21.15.31:0/3735760595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 msgr2=0x563bb000f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb000f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 -- 172.21.15.31:0/3735760595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bafc7e210 con 0x563bb000fdd0 2024-06-02T22:40:14.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.473+0000 7f23cea00640 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f23bc031610 tx=0x7f23bc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f1af7de2ac9cd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.474+0000 7f23cf400640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 0x7f23b40a5260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23c80a3ff0 tx=0x7f23c80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.474+0000 7f23bb400640 1 -- 172.21.15.31:0/3735760595 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc035030 con 0x563bb000fdd0 2024-06-02T22:40:14.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.474+0000 7f23bb400640 1 -- 172.21.15.31:0/3735760595 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0046c0 con 0x563bb000fdd0 2024-06-02T22:40:14.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.474+0000 7f23bb400640 1 -- 172.21.15.31:0/3735760595 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc031910 con 0x563bb000fdd0 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.475+0000 7f23d83cc740 1 -- 172.21.15.31:0/3735760595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 msgr2=0x563bb00148d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.475+0000 7f23d83cc740 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f23bc031610 tx=0x7f23bc0043b0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 -- 172.21.15.31:0/3735760595 shutdown_connections 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb00173d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000fdd0 0x563bb00148d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 --2- 172.21.15.31:0/3735760595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb000f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 -- 172.21.15.31:0/3735760595 >> 172.21.15.31:0/3735760595 conn(0x563baffcef80 msgr2=0x563bb000ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 -- 172.21.15.31:0/3735760595 shutdown_connections 2024-06-02T22:40:14.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.476+0000 7f23d83cc740 1 -- 172.21.15.31:0/3735760595 wait complete. 2024-06-02T22:40:14.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.477+0000 7f23d83cc740 1 -- start start 2024-06-02T22:40:14.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.477+0000 7f23d83cc740 1 Processor -- start 2024-06-02T22:40:14.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb0014f40 0x563bb00091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x563bb00023a0 con 0x563bb0014f40 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563baff250b0 con 0x563bb000f3e0 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563bb0002520 con 0x563bb000fdd0 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.478+0000 7f23d83cc740 10 client.0 _ll_register_callbacks cb 0x563baff10f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:14.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.479+0000 7f23cea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.479+0000 7f23ce000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.479+0000 7f23cea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:52824/0 (socket says 172.21.15.31:52824) 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.479+0000 7f23cea00640 1 -- 172.21.15.31:0/1491221671 learned_addr learned my addr 172.21.15.31:0/1491221671 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.480+0000 7f23cea00640 1 -- 172.21.15.31:0/1491221671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 msgr2=0x563bb0003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.480+0000 7f23cea00640 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb0003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.480+0000 7f23cea00640 1 -- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb0014f40 msgr2=0x563bb00091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.480+0000 7f23cea00640 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb0014f40 0x563bb00091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.480+0000 7f23cea00640 1 -- 172.21.15.31:0/1491221671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bafd4a620 con 0x563bb000fdd0 2024-06-02T22:40:14.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.481+0000 7f23cea00640 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23bc006010 tx=0x7f23bc005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a33e3a34095c4a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.481+0000 7f23afe00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:40:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.481+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc051060 con 0x563bb000fdd0 2024-06-02T22:40:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.482+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f23bc0318b0 con 0x563bb000fdd0 2024-06-02T22:40:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.482+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23bc0046c0 con 0x563bb000fdd0 2024-06-02T22:40:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.482+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23bc058050 con 0x563bb000fdd0 2024-06-02T22:40:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.482+0000 7f23d83cc740 10 client.25444 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.482+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563bb00023a0 con 0x563bb000fdd0 2024-06-02T22:40:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.483+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc004c70 con 0x563bb000fdd0 2024-06-02T22:40:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.483+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f23bc04b030 con 0x563bb000fdd0 2024-06-02T22:40:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 10 client.25444 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 10 client.25444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 20 client.25444 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb002da20 0x563bb002fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 4 client.25444 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:40:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.485+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f23bc0046c0 con 0x563bb002da20 2024-06-02T22:40:14.487 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.486+0000 7f23ce000640 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb002da20 0x563bb002fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.488 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.488+0000 7f23ce000640 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb002da20 0x563bb002fe10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31fcae4b403bbae6 server_cookie=3a23ba2a96984eb8 in_seq=0 out_seq=0 2024-06-02T22:40:14.489 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.488+0000 7f23afe00640 10 client.25444 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:14.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.490+0000 7f23afe00640 1 -- 172.21.15.31:0/1491221671 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f23bc0046c0 con 0x563bb002da20 2024-06-02T22:40:14.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.490+0000 7f23afe00640 10 client.25444 handle_command_reply: tid=0 2024-06-02T22:40:14.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 client.25444 shutdown 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 msgr2=0x563bb00041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f23bc006010 tx=0x7f23bc005230 comp rx=0 tx=0).stop 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 shutdown_connections 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb002da20 0x563bb002fe10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb0014f40 0x563bb00091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00041f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1491221671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000f3e0 0x563bb0003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 >> 172.21.15.31:0/1491221671 conn(0x563baffcef80 msgr2=0x563bb0001810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.491+0000 7f23afe00640 0 client.25444 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.492+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 shutdown_connections 2024-06-02T22:40:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.492+0000 7f23d83cc740 1 -- 172.21.15.31:0/1491221671 wait complete. 2024-06-02T22:40:14.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.492+0000 7f23d83cc740 20 client.25444 trim_cache size 0 max 16384 2024-06-02T22:40:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.521+0000 7f23d83cc740 1 Processor -- start 2024-06-02T22:40:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.521+0000 7f23d83cc740 1 -- start start 2024-06-02T22:40:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb000aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb0014f40 0x563bb0000f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01b0ba0 con 0x563bb000f3e0 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01b26e0 con 0x563bb0014f40 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23d83cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01b1270 con 0x563bb000fdd0 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.522+0000 7f23ce000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb000aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.523+0000 7f23ce000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb000aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40614/0 (socket says 172.21.15.31:40614) 2024-06-02T22:40:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.523+0000 7f23ce000640 1 -- 172.21.15.31:0/1961414654 learned_addr learned my addr 172.21.15.31:0/1961414654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.523+0000 7f23cea00640 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.523+0000 7f23ce000640 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb0014f40 0x563bb0000f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 -- 172.21.15.31:0/1961414654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb0014f40 msgr2=0x563bb0000f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb0014f40 0x563bb0000f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 -- 172.21.15.31:0/1961414654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 msgr2=0x563bb000aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb000aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 -- 172.21.15.31:0/1961414654 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bb0030180 con 0x563bb000fdd0 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.524+0000 7f23cea00640 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00032d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23bc02a930 tx=0x7f23bc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f3b665a2ca4c4d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23baa00640 1 -- 172.21.15.31:0/1961414654 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc000e60 con 0x563bb000fdd0 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23baa00640 1 -- 172.21.15.31:0/1961414654 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0046c0 con 0x563bb000fdd0 2024-06-02T22:40:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23baa00640 1 -- 172.21.15.31:0/1961414654 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc051030 con 0x563bb000fdd0 2024-06-02T22:40:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 -- 172.21.15.31:0/1961414654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 msgr2=0x563bb00032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00032d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23bc02a930 tx=0x7f23bc009780 comp rx=0 tx=0).stop 2024-06-02T22:40:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 -- 172.21.15.31:0/1961414654 shutdown_connections 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb0014f40 0x563bb0000f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb000fdd0 0x563bb00032d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 --2- 172.21.15.31:0/1961414654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb000aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.525+0000 7f23d83cc740 1 -- 172.21.15.31:0/1961414654 >> 172.21.15.31:0/1961414654 conn(0x563baffcef80 msgr2=0x563bb000a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.526+0000 7f23d83cc740 1 -- 172.21.15.31:0/1961414654 shutdown_connections 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.526+0000 7f23d83cc740 1 -- 172.21.15.31:0/1961414654 wait complete. 2024-06-02T22:40:14.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.526+0000 7f23d83cc740 1 -- start start 2024-06-02T22:40:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.526+0000 7f23d83cc740 1 Processor -- start 2024-06-02T22:40:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb003f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb0040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01b2010 con 0x563bb000f3e0 2024-06-02T22:40:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01b1940 con 0x563bb000fdd0 2024-06-02T22:40:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23d01aeb80 con 0x563bb0014f40 2024-06-02T22:40:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.527+0000 7f23d83cc740 10 client.0 _ll_register_callbacks cb 0x7f23c000a970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.528+0000 7f23cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.528+0000 7f23cea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40110/0 (socket says 172.21.15.31:40110) 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.528+0000 7f23cea00640 1 -- 172.21.15.31:0/2276542457 learned_addr learned my addr 172.21.15.31:0/2276542457 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.528+0000 7f23ce000640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb0040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.528+0000 7f23ce000640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb003f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.529+0000 7f23cea00640 1 -- 172.21.15.31:0/2276542457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 msgr2=0x563bb0040eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.529+0000 7f23cea00640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb0040eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.529+0000 7f23cea00640 1 -- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 msgr2=0x563bb003f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:14.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.529+0000 7f23cea00640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb003f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.529+0000 7f23cea00640 1 -- 172.21.15.31:0/2276542457 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bb00414a0 con 0x563bb000fdd0 2024-06-02T22:40:14.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.530+0000 7f23ce000640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb0040eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.531+0000 7f23afe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:40:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.531+0000 7f23cea00640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f23bc031440 tx=0x7f23bc0052a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96d16e26c41505d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.532+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc060070 con 0x563bb000fdd0 2024-06-02T22:40:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.532+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f23bc03b630 con 0x563bb000fdd0 2024-06-02T22:40:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.532+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23bc0046c0 con 0x563bb000fdd0 2024-06-02T22:40:14.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23bc06b050 con 0x563bb000fdd0 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 10 client.25439 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563bb0098a70 con 0x563bb000fdd0 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0046c0 con 0x563bb000fdd0 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f23bc04b070 con 0x563bb000fdd0 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 10 client.25439 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 10 client.25439 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 20 client.25439 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb00992e0 0x563bb009b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 4 client.25439 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:40:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.533+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bb0003aa0 con 0x563bb00992e0 2024-06-02T22:40:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.534+0000 7f23ce000640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb00992e0 0x563bb009b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.536+0000 7f23ce000640 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb00992e0 0x563bb009b700 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62db98caf2ad01a server_cookie=5f86b2828a4a0b74 in_seq=0 out_seq=0 2024-06-02T22:40:14.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.536+0000 7f23afe00640 10 client.25439 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:14 smithi178 ceph-mon[36614]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 668 op/s 2024-06-02T22:40:14.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:14 smithi031 ceph-mon[31767]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 668 op/s 2024-06-02T22:40:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.652+0000 7f23afe00640 1 -- 172.21.15.31:0/2276542457 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563bb0003aa0 con 0x563bb00992e0 2024-06-02T22:40:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.652+0000 7f23afe00640 10 client.25439 handle_command_reply: tid=0 2024-06-02T22:40:14.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.652+0000 7f23d83cc740 1 client.25439 shutdown 2024-06-02T22:40:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.652+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 msgr2=0x563bb003fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.652+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f23bc031440 tx=0x7f23bc0052a0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 shutdown_connections 2024-06-02T22:40:14.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x563bb00992e0 0x563bb009b700 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563bb0014f40 0x563bb0040eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563bb000fdd0 0x563bb003fef0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 --2- 172.21.15.31:0/2276542457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563bb000f3e0 0x563bb003f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23afe00640 0 client.25439 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 >> 172.21.15.31:0/2276542457 conn(0x563baffcef80 msgr2=0x563bb000a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.653+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 shutdown_connections 2024-06-02T22:40:14.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.654+0000 7f23d83cc740 1 -- 172.21.15.31:0/2276542457 wait complete. 2024-06-02T22:40:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.654+0000 7f23d83cc740 20 client.25439 trim_cache size 0 max 16384 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 msgr2=0x7f23b40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 0x7f23b40a5260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23c80a3ff0 tx=0x7f23c80058d0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 msgr2=0x7f23d0072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23c800e940 tx=0x7f23c800ee00 comp rx=0 tx=0).stop 2024-06-02T22:40:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 shutdown_connections 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f23b40a2da0 0x7f23b40a5260 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23d01057b0 0x7f23d0072af0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23d0104df0 0x7f23d0071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 --2- 172.21.15.31:0/666466905 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23d0103c00 0x7f23d0071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.656+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 >> 172.21.15.31:0/666466905 conn(0x7f23d00ff190 msgr2=0x7f23d0108090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.657+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 shutdown_connections 2024-06-02T22:40:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:14.657+0000 7f23d5600640 1 -- 172.21.15.31:0/666466905 wait complete. 2024-06-02T22:40:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 170.0 s, 1193.6 tps, lat 84.248 ms stddev 107.741 2024-06-02T22:40:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:16 smithi098 ceph-mon[36750]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 557 op/s 2024-06-02T22:40:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:16 smithi178 ceph-mon[36614]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 557 op/s 2024-06-02T22:40:16.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:16 smithi031 ceph-mon[31767]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 557 op/s 2024-06-02T22:40:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:18 smithi098 ceph-mon[36750]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-06-02T22:40:18.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:18 smithi178 ceph-mon[36614]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-06-02T22:40:18.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:18 smithi031 ceph-mon[31767]: pgmap v610: 129 pgs: 129 active+clean; 1.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.4 MiB/s wr, 740 op/s 2024-06-02T22:40:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 175.0 s, 1309.3 tps, lat 70.898 ms stddev 86.144 2024-06-02T22:40:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:20 smithi098 ceph-mon[36750]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 621 op/s 2024-06-02T22:40:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:20 smithi178 ceph-mon[36614]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 621 op/s 2024-06-02T22:40:20.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:20 smithi031 ceph-mon[31767]: pgmap v611: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.2 MiB/s wr, 621 op/s 2024-06-02T22:40:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:22 smithi178 ceph-mon[36614]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 652 op/s 2024-06-02T22:40:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:22 smithi098 ceph-mon[36750]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 652 op/s 2024-06-02T22:40:22.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:22 smithi031 ceph-mon[31767]: pgmap v612: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.5 MiB/s wr, 652 op/s 2024-06-02T22:40:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:24 smithi098 ceph-mon[36750]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-06-02T22:40:24.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:24 smithi178 ceph-mon[36614]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-06-02T22:40:24.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:24 smithi031 ceph-mon[31767]: pgmap v613: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-06-02T22:40:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 180.0 s, 1127.7 tps, lat 94.531 ms stddev 157.036 2024-06-02T22:40:25.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:25 smithi098 ceph-mon[36750]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-06-02T22:40:25.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:25 smithi178 ceph-mon[36614]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-06-02T22:40:25.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:25 smithi031 ceph-mon[31767]: pgmap v614: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 571 op/s 2024-06-02T22:40:27.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:27 smithi178 ceph-mon[36614]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 902 op/s 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 -- 172.21.15.31:0/3746489382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c1167d0 msgr2=0x7fcc3c118bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 --2- 172.21.15.31:0/3746489382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c118bc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009c10 tx=0x7fcc3402a6f0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 -- 172.21.15.31:0/3746489382 shutdown_connections 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 --2- 172.21.15.31:0/3746489382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c118bc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 --2- 172.21.15.31:0/3746489382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 --2- 172.21.15.31:0/3746489382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06d130 0x7fcc3c06b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 -- 172.21.15.31:0/3746489382 >> 172.21.15.31:0/3746489382 conn(0x7fcc3c0709a0 msgr2=0x7fcc3c072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 -- 172.21.15.31:0/3746489382 shutdown_connections 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.854+0000 7fcc42600640 1 -- 172.21.15.31:0/3746489382 wait complete. 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.855+0000 7fcc42600640 1 Processor -- start 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.855+0000 7fcc42600640 1 -- start start 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 0x7fcc3c1a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c1adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c11c450 con 0x7fcc3c06d130 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c11c2d0 con 0x7fcc3c1167d0 2024-06-02T22:40:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc42600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c11c5d0 con 0x7fcc3c06bb50 2024-06-02T22:40:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:33618/0 (socket says 172.21.15.31:33618) 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc3b400640 1 -- 172.21.15.31:0/2308910590 learned_addr learned my addr 172.21.15.31:0/2308910590 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc3aa00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 0x7fcc3c1a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.856+0000 7fcc3be00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c1adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 -- 172.21.15.31:0/2308910590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c1167d0 msgr2=0x7fcc3c1adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c1adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 -- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 msgr2=0x7fcc3c1a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 0x7fcc3c1a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 -- 172.21.15.31:0/2308910590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3c1ae640 con 0x7fcc3c06bb50 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3aa00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 0x7fcc3c1a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00e9c0 tx=0x7fcc2c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc33e00640 1 -- 172.21.15.31:0/2308910590 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00cde0 con 0x7fcc3c06bb50 2024-06-02T22:40:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc33e00640 1 -- 172.21.15.31:0/2308910590 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc2c0035f0 con 0x7fcc3c06bb50 2024-06-02T22:40:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c1ae930 con 0x7fcc3c06bb50 2024-06-02T22:40:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.857+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c1aee80 con 0x7fcc3c06bb50 2024-06-02T22:40:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.858+0000 7fcc33e00640 1 -- 172.21.15.31:0/2308910590 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c010690 con 0x7fcc3c06bb50 2024-06-02T22:40:27.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.864+0000 7fcc33e00640 1 -- 172.21.15.31:0/2308910590 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fcc2c0037a0 con 0x7fcc3c06bb50 2024-06-02T22:40:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.866+0000 7fcc453b3740 1 Processor -- start 2024-06-02T22:40:27.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.866+0000 7fcc453b3740 1 -- start start 2024-06-02T22:40:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc33e00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 0x7fcc200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bb80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bbabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a666b16420 con 0x55a666bb35c0 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a666abdc50 con 0x55a666bb8730 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc453b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a666b123e0 con 0x55a666bb2bd0 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc33e00640 1 -- 172.21.15.31:0/2308910590 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fcc2c0cf7b0 con 0x7fcc3c06bb50 2024-06-02T22:40:27.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:33624/0 (socket says 172.21.15.31:33624) 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc3be00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 0x7fcc200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc3b400640 1 -- 172.21.15.31:0/2913136577 learned_addr learned my addr 172.21.15.31:0/2913136577 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.867+0000 7fcc3be00640 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bbabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 -- 172.21.15.31:0/2913136577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 msgr2=0x55a666bbabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bbabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 -- 172.21.15.31:0/2913136577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 msgr2=0x55a666bb80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bb80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 -- 172.21.15.31:0/2913136577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66682a210 con 0x55a666bb2bd0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3be00640 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bbabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc3b400640 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c098650 tx=0x7fcc2c09b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73066525059ce9ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc30c00640 1 -- 172.21.15.31:0/2913136577 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c09a240 con 0x55a666bb2bd0 2024-06-02T22:40:27.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc30c00640 1 -- 172.21.15.31:0/2913136577 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc2c09c380 con 0x55a666bb2bd0 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.868+0000 7fcc30c00640 1 -- 172.21.15.31:0/2913136577 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0a4060 con 0x55a666bb2bd0 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 -- 172.21.15.31:0/2913136577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 msgr2=0x55a666bb2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc3be00640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 0x7fcc200a50f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcc34030960 tx=0x7fcc34009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c098650 tx=0x7fcc2c09b7c0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 -- 172.21.15.31:0/2913136577 shutdown_connections 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bbabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bb80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 --2- 172.21.15.31:0/2913136577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb2bd0 0x55a666bb2ff0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 -- 172.21.15.31:0/2913136577 >> 172.21.15.31:0/2913136577 conn(0x55a666b7af80 msgr2=0x55a666bae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 -- 172.21.15.31:0/2913136577 shutdown_connections 2024-06-02T22:40:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.869+0000 7fcc453b3740 1 -- 172.21.15.31:0/2913136577 wait complete. 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 -- start start 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 Processor -- start 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb35c0 0x55a666bbd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.870+0000 7fcc453b3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a666bbb6e0 con 0x55a666bb2bd0 2024-06-02T22:40:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc453b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a666ad10b0 con 0x55a666bb35c0 2024-06-02T22:40:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc453b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a666bbb860 con 0x55a666bb8730 2024-06-02T22:40:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc453b3740 10 client.0 _ll_register_callbacks cb 0x55a666abcf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:27.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:27 smithi031 ceph-mon[31767]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 902 op/s 2024-06-02T22:40:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47046/0 (socket says 172.21.15.31:47046) 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 -- 172.21.15.31:0/1278623059 learned_addr learned my addr 172.21.15.31:0/1278623059 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3aa00640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb35c0 0x55a666bbd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3be00640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 -- 172.21.15.31:0/1278623059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 msgr2=0x55a666bc4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 -- 172.21.15.31:0/1278623059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb35c0 msgr2=0x55a666bbd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb35c0 0x55a666bbd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.871+0000 7fcc3b400640 1 -- 172.21.15.31:0/1278623059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6668f6620 con 0x55a666bb2bd0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.872+0000 7fcc3b400640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c09bc10 tx=0x7fcc2c099c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593f38e1266337d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.872+0000 7fcc25600640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.874+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0b8020 con 0x55a666bb2bd0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.874+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fcc2c003b10 con 0x55a666bb2bd0 2024-06-02T22:40:27.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.874+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc2c09c380 con 0x55a666bb2bd0 2024-06-02T22:40:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.875+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcc2c0a4250 con 0x55a666bb2bd0 2024-06-02T22:40:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.876+0000 7fcc453b3740 10 client.15282 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.876+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a666bc7830 con 0x55a666bb2bd0 2024-06-02T22:40:27.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.877+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc2c09c380 con 0x55a666bb2bd0 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.877+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fcc2c09a760 con 0x55a666bb2bd0 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 10 client.15282 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 10 client.15282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 20 client.15282 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666bc89b0 0x55a666bcae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 4 client.15282 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:40:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a666b23b50 con 0x55a666bc89b0 2024-06-02T22:40:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.878+0000 7fcc3aa00640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666bc89b0 0x55a666bcae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.879+0000 7fcc3aa00640 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666bc89b0 0x55a666bcae10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ec468d1e66a23ea server_cookie=3e5fc8318b2237bc in_seq=0 out_seq=0 2024-06-02T22:40:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.879+0000 7fcc25600640 10 client.15282 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc25600640 1 -- 172.21.15.31:0/1278623059 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a666b23b50 con 0x55a666bc89b0 2024-06-02T22:40:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc25600640 10 client.15282 handle_command_reply: tid=0 2024-06-02T22:40:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 client.15282 shutdown 2024-06-02T22:40:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 msgr2=0x55a666bbcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c09bc10 tx=0x7fcc2c099c90 comp rx=0 tx=0).stop 2024-06-02T22:40:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 shutdown_connections 2024-06-02T22:40:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666bc89b0 0x55a666bcae10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb35c0 0x55a666bbd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 --2- 172.21.15.31:0/1278623059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb2bd0 0x55a666bbcfd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.880+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 >> 172.21.15.31:0/1278623059 conn(0x55a666b7af80 msgr2=0x55a666bad810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.881+0000 7fcc25600640 0 client.15282 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.881+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 shutdown_connections 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.881+0000 7fcc453b3740 1 -- 172.21.15.31:0/1278623059 wait complete. 2024-06-02T22:40:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.881+0000 7fcc453b3740 20 client.15282 trim_cache size 0 max 16384 2024-06-02T22:40:27.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.915+0000 7fcc453b3740 1 Processor -- start 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.915+0000 7fcc453b3740 1 -- start start 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.915+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.915+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.915+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc453b3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b94d0 con 0x55a666bb35c0 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc453b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1bb010 con 0x55a666bb5050 2024-06-02T22:40:27.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc453b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b9ba0 con 0x55a666bb8730 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55854/0 (socket says 172.21.15.31:55854) 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.916+0000 7fcc3be00640 1 -- 172.21.15.31:0/4092332371 learned_addr learned my addr 172.21.15.31:0/4092332371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 -- 172.21.15.31:0/4092332371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 msgr2=0x55a666bc44e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc44e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 -- 172.21.15.31:0/4092332371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 msgr2=0x55a666bae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 -- 172.21.15.31:0/4092332371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a666baf300 con 0x55a666bb5050 2024-06-02T22:40:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.917+0000 7fcc3be00640 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009be0 tx=0x7fcc3403e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e692ad25b50dbaa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.918+0000 7fcc27e00640 1 -- 172.21.15.31:0/4092332371 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34042040 con 0x55a666bb5050 2024-06-02T22:40:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.918+0000 7fcc27e00640 1 -- 172.21.15.31:0/4092332371 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc3404bb60 con 0x55a666bb5050 2024-06-02T22:40:27.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.918+0000 7fcc27e00640 1 -- 172.21.15.31:0/4092332371 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34036040 con 0x55a666bb5050 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- 172.21.15.31:0/4092332371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 msgr2=0x55a666bbcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009be0 tx=0x7fcc3403e000 comp rx=0 tx=0).stop 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- 172.21.15.31:0/4092332371 shutdown_connections 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb5050 0x55a666bbcd80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb8730 0x55a666bc44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 --2- 172.21.15.31:0/4092332371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666bb35c0 0x55a666bae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- 172.21.15.31:0/4092332371 >> 172.21.15.31:0/4092332371 conn(0x55a666b7af80 msgr2=0x55a666bb4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:27.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- 172.21.15.31:0/4092332371 shutdown_connections 2024-06-02T22:40:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- 172.21.15.31:0/4092332371 wait complete. 2024-06-02T22:40:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.919+0000 7fcc453b3740 1 -- start start 2024-06-02T22:40:27.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 Processor -- start 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb35c0 0x55a666bc1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1ba940 con 0x55a666c2f690 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1ba270 con 0x55a666bb8730 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c1b74b0 con 0x55a666bb35c0 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.920+0000 7fcc453b3740 10 client.0 _ll_register_callbacks cb 0x7fcc2c09ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:27.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.921+0000 7fcc3b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb35c0 0x55a666bc1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.921+0000 7fcc3aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.921+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.921+0000 7fcc3be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47072/0 (socket says 172.21.15.31:47072) 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.921+0000 7fcc3be00640 1 -- 172.21.15.31:0/922090820 learned_addr learned my addr 172.21.15.31:0/922090820 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 -- 172.21.15.31:0/922090820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb35c0 msgr2=0x55a666bc1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb35c0 0x55a666bc1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 -- 172.21.15.31:0/922090820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 msgr2=0x55a666bc1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:27.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bc1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 -- 172.21.15.31:0/922090820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a666c31fc0 con 0x55a666c2f690 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc3be00640 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcc34006010 tx=0x7fcc34030e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8140e930941989a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.922+0000 7fcc25600640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.923+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34042070 con 0x55a666c2f690 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.923+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fcc34031c10 con 0x55a666c2f690 2024-06-02T22:40:27.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.923+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc3404bb60 con 0x55a666c2f690 2024-06-02T22:40:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.924+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcc34036040 con 0x55a666c2f690 2024-06-02T22:40:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.924+0000 7fcc453b3740 10 client.15285 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:27.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.924+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a666c331e0 con 0x55a666c2f690 2024-06-02T22:40:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.925+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc34031e10 con 0x55a666c2f690 2024-06-02T22:40:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.927+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fcc34048050 con 0x55a666c2f690 2024-06-02T22:40:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.927+0000 7fcc453b3740 10 client.15285 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:27.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.927+0000 7fcc453b3740 10 client.15285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.927+0000 7fcc453b3740 20 client.15285 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.927+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666c33b40 0x55a666c35f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.928+0000 7fcc453b3740 4 client.15285 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:40:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.928+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcc3404bb60 con 0x55a666c33b40 2024-06-02T22:40:27.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.928+0000 7fcc3b400640 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666c33b40 0x55a666c35f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.932+0000 7fcc3b400640 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666c33b40 0x55a666c35f60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee00e631424885e server_cookie=e3be3b512d5b5428 in_seq=0 out_seq=0 2024-06-02T22:40:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:27.932+0000 7fcc25600640 10 client.15285 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:27 smithi098 ceph-mon[36750]: pgmap v615: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 902 op/s 2024-06-02T22:40:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.055+0000 7fcc25600640 1 -- 172.21.15.31:0/922090820 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fcc3404bb60 con 0x55a666c33b40 2024-06-02T22:40:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.055+0000 7fcc25600640 10 client.15285 handle_command_reply: tid=0 2024-06-02T22:40:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.055+0000 7fcc453b3740 1 client.15285 shutdown 2024-06-02T22:40:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 msgr2=0x55a666c31a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcc34006010 tx=0x7fcc34030e90 comp rx=0 tx=0).stop 2024-06-02T22:40:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 shutdown_connections 2024-06-02T22:40:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a666c33b40 0x55a666c35f60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc25600640 0 client.15285 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a666c2f690 0x55a666c31a80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a666bb8730 0x55a666bc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 --2- 172.21.15.31:0/922090820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a666bb35c0 0x55a666bc1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 >> 172.21.15.31:0/922090820 conn(0x55a666b7af80 msgr2=0x55a666bb7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 shutdown_connections 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.056+0000 7fcc453b3740 1 -- 172.21.15.31:0/922090820 wait complete. 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.057+0000 7fcc453b3740 20 client.15285 trim_cache size 0 max 16384 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:40:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:40:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.057+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 msgr2=0x7fcc200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.057+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 0x7fcc200a50f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcc34030960 tx=0x7fcc34009280 comp rx=0 tx=0).stop 2024-06-02T22:40:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.057+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 msgr2=0x7fcc3c1a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.057+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00e9c0 tx=0x7fcc2c00ee80 comp rx=0 tx=0).stop 2024-06-02T22:40:28.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 shutdown_connections 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fcc200a2c30 0x7fcc200a50f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcc3c1167d0 0x7fcc3c1adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc3c06d130 0x7fcc3c1a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 --2- 172.21.15.31:0/2308910590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc3c06bb50 0x7fcc3c1a6a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 >> 172.21.15.31:0/2308910590 conn(0x7fcc3c0709a0 msgr2=0x7fcc3c109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 shutdown_connections 2024-06-02T22:40:28.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:28.058+0000 7fcc42600640 1 -- 172.21.15.31:0/2308910590 wait complete. 2024-06-02T22:40:29.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:29 smithi031 ceph-mon[31767]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 MiB/s wr, 772 op/s 2024-06-02T22:40:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:29 smithi098 ceph-mon[36750]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 MiB/s wr, 772 op/s 2024-06-02T22:40:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:29 smithi178 ceph-mon[36614]: pgmap v616: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.2 MiB/s wr, 772 op/s 2024-06-02T22:40:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 185.0 s, 1321.6 tps, lat 75.754 ms stddev 95.353 2024-06-02T22:40:31.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:31 smithi031 ceph-mon[31767]: pgmap v617: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 768 op/s 2024-06-02T22:40:31.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:31 smithi098 ceph-mon[36750]: pgmap v617: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 768 op/s 2024-06-02T22:40:32.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:31 smithi178 ceph-mon[36614]: pgmap v617: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 768 op/s 2024-06-02T22:40:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:33 smithi031 ceph-mon[31767]: pgmap v618: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 814 op/s 2024-06-02T22:40:33.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:33 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:40:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:33 smithi098 ceph-mon[36750]: pgmap v618: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 814 op/s 2024-06-02T22:40:33.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:33 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:40:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:33 smithi178 ceph-mon[36614]: pgmap v618: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.5 MiB/s wr, 814 op/s 2024-06-02T22:40:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:33 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:34 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:34.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:34 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:34 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:40:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 190.0 s, 1360.8 tps, lat 73.079 ms stddev 90.127 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: pgmap v619: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 753 op/s 2024-06-02T22:40:35.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:40:35.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:40:35.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:40:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:40:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:40:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:40:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:40:35.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: pgmap v619: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 753 op/s 2024-06-02T22:40:35.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:40:35.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:40:35.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:40:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: pgmap v619: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 753 op/s 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:40:36.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:40:37.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:37 smithi031 ceph-mon[31767]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 916 op/s 2024-06-02T22:40:37.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:37 smithi098 ceph-mon[36750]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 916 op/s 2024-06-02T22:40:38.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:37 smithi178 ceph-mon[36614]: pgmap v620: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 916 op/s 2024-06-02T22:40:39.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:39 smithi098 ceph-mon[36750]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-06-02T22:40:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:39 smithi178 ceph-mon[36614]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-06-02T22:40:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:39 smithi031 ceph-mon[31767]: pgmap v621: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 605 op/s 2024-06-02T22:40:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 195.0 s, 1139.2 tps, lat 88.415 ms stddev 105.799 2024-06-02T22:40:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 -- 172.21.15.31:0/2581206026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b04102c20 msgr2=0x7f2b041030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/2581206026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b04102c20 0x7f2b041030a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009900 tx=0x7f2af002a410 comp rx=0 tx=0).stop 2024-06-02T22:40:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 -- 172.21.15.31:0/2581206026 shutdown_connections 2024-06-02T22:40:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/2581206026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b041035e0 0x7f2b04109e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/2581206026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b04102c20 0x7f2b041030a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/2581206026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04101a30 0x7f2b04101e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.250+0000 7f2b0ac00640 1 -- 172.21.15.31:0/2581206026 >> 172.21.15.31:0/2581206026 conn(0x7f2b040fcfc0 msgr2=0x7f2b040ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.253+0000 7f2b0ac00640 1 -- 172.21.15.31:0/2581206026 shutdown_connections 2024-06-02T22:40:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.253+0000 7f2b0ac00640 1 -- 172.21.15.31:0/2581206026 wait complete. 2024-06-02T22:40:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.255+0000 7f2b0ac00640 1 Processor -- start 2024-06-02T22:40:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.255+0000 7f2b0ac00640 1 -- start start 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.255+0000 7f2b0ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.255+0000 7f2b0ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04102c20 0x7f2b0419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.255+0000 7f2b0ac00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 0x7f2b041a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b0ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0410d6e0 con 0x7f2b04102c20 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b0ac00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0410d560 con 0x7f2b041035e0 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b0ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0410d860 con 0x7f2b04101a30 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59906/0 (socket says 172.21.15.31:59906) 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b03e00640 1 -- 172.21.15.31:0/3421825112 learned_addr learned my addr 172.21.15.31:0/3421825112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b03400640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04102c20 0x7f2b0419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b08c00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 0x7f2b041a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.256+0000 7f2b03e00640 1 -- 172.21.15.31:0/3421825112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 msgr2=0x7f2b041a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.257+0000 7f2b03e00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 0x7f2b041a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.257+0000 7f2b03e00640 1 -- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04102c20 msgr2=0x7f2b0419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.257+0000 7f2b03e00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04102c20 0x7f2b0419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.257+0000 7f2b03e00640 1 -- 172.21.15.31:0/3421825112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b041a1ad0 con 0x7f2b04101a30 2024-06-02T22:40:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.257+0000 7f2b08c00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 0x7f2b041a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:40:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b03e00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af400e9c0 tx=0x7f2af400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b00c00640 1 -- 172.21.15.31:0/3421825112 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af400cd80 con 0x7f2b04101a30 2024-06-02T22:40:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b041a1dc0 con 0x7f2b04101a30 2024-06-02T22:40:41.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b00c00640 1 -- 172.21.15.31:0/3421825112 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af40035f0 con 0x7f2b04101a30 2024-06-02T22:40:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b00c00640 1 -- 172.21.15.31:0/3421825112 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af4010690 con 0x7f2b04101a30 2024-06-02T22:40:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.258+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b041a2230 con 0x7f2b04101a30 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 Processor -- start 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 -- start start 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e7818d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7843d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56334e6d7420 con 0x56334e77c3e0 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56334e67ec50 con 0x56334e77cdd0 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.263+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56334e6d33e0 con 0x56334e781f40 2024-06-02T22:40:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55760/0 (socket says 172.21.15.31:55760) 2024-06-02T22:40:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b08c00640 1 -- 172.21.15.31:0/1647829847 learned_addr learned my addr 172.21.15.31:0/1647829847 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b03400640 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b03400640 1 -- 172.21.15.31:0/1647829847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 msgr2=0x56334e7818d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b03400640 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e7818d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.264+0000 7f2b03400640 1 -- 172.21.15.31:0/1647829847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 msgr2=0x56334e77c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2b03400640 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2b03400640 1 -- 172.21.15.31:0/1647829847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56334e3eb210 con 0x56334e781f40 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2b08c00640 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2b00c00640 1 -- 172.21.15.31:0/3421825112 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f2af40037a0 con 0x7f2b04101a30 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2b03400640 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7843d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2af002a930 tx=0x7f2af0004190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bddfcac66b61f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2af9200640 1 -- 172.21.15.31:0/1647829847 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0035040 con 0x56334e781f40 2024-06-02T22:40:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2af9200640 1 -- 172.21.15.31:0/1647829847 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0005520 con 0x56334e781f40 2024-06-02T22:40:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.265+0000 7f2af9200640 1 -- 172.21.15.31:0/1647829847 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0031910 con 0x56334e781f40 2024-06-02T22:40:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.267+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1647829847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 msgr2=0x56334e7843d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.267+0000 7f2b00c00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 0x7f2ae80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.267+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7843d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2af002a930 tx=0x7f2af0004190 comp rx=0 tx=0).stop 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.267+0000 7f2b00c00640 1 -- 172.21.15.31:0/3421825112 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2af40cf850 con 0x7f2b04101a30 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.268+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1647829847 shutdown_connections 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.268+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7843d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.268+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e7818d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.268+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1647829847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e77c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.268+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1647829847 >> 172.21.15.31:0/1647829847 conn(0x56334e73bf80 msgr2=0x56334e76f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.269+0000 7f2b08c00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 0x7f2ae80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.270+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1647829847 shutdown_connections 2024-06-02T22:40:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.272+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1647829847 wait complete. 2024-06-02T22:40:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.272+0000 7f2b08c00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 0x7f2ae80a50f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x56334e77d630 tx=0x7f2afc009820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.273+0000 7f2b0da4e740 1 -- start start 2024-06-02T22:40:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.273+0000 7f2b0da4e740 1 Processor -- start 2024-06-02T22:40:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e786710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77cdd0 0x56334e786c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56334e784e90 con 0x56334e77c3e0 2024-06-02T22:40:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56334e6920b0 con 0x56334e781f40 2024-06-02T22:40:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56334e785010 con 0x56334e77cdd0 2024-06-02T22:40:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b0da4e740 10 client.0 _ll_register_callbacks cb 0x56334e67df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e786710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b08c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44442/0 (socket says 172.21.15.31:44442) 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.274+0000 7f2b08c00640 1 -- 172.21.15.31:0/1831301396 learned_addr learned my addr 172.21.15.31:0/1831301396 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b03400640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77cdd0 0x56334e786c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b08c00640 1 -- 172.21.15.31:0/1831301396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77cdd0 msgr2=0x56334e786c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b08c00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77cdd0 0x56334e786c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b08c00640 1 -- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 msgr2=0x56334e786710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b08c00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e786710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b08c00640 1 -- 172.21.15.31:0/1831301396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56334e4b7620 con 0x56334e781f40 2024-06-02T22:40:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.275+0000 7f2b03e00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e786710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:40:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.276+0000 7f2b08c00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0129c0 tx=0x7f2afc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56c335cc78f69235 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.277+0000 7f2aed600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:40:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.279+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00ece0 con 0x56334e781f40 2024-06-02T22:40:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.279+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2afc003970 con 0x56334e781f40 2024-06-02T22:40:41.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.280+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af0005520 con 0x56334e781f40 2024-06-02T22:40:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.283+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2afc003b70 con 0x56334e781f40 2024-06-02T22:40:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.284+0000 7f2b0da4e740 10 client.25460 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.284+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56334e791070 con 0x56334e781f40 2024-06-02T22:40:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.286+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0005520 con 0x56334e781f40 2024-06-02T22:40:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2afc00f040 con 0x56334e781f40 2024-06-02T22:40:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 10 client.25460 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 10 client.25460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 20 client.25460 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7927b0 0x56334e794c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 4 client.25460 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:40:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.288+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56334e6e4b50 con 0x56334e7927b0 2024-06-02T22:40:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.289+0000 7f2b03e00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7927b0 0x56334e794c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.292+0000 7f2b03e00640 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7927b0 0x56334e794c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51e5d858ca276f55 server_cookie=a30964526f0faa20 in_seq=0 out_seq=0 2024-06-02T22:40:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.292+0000 7f2aed600640 10 client.25460 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.294+0000 7f2aed600640 1 -- 172.21.15.31:0/1831301396 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56334e6e4b50 con 0x56334e7927b0 2024-06-02T22:40:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.294+0000 7f2aed600640 10 client.25460 handle_command_reply: tid=0 2024-06-02T22:40:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.294+0000 7f2b0da4e740 1 client.25460 shutdown 2024-06-02T22:40:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.295+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 msgr2=0x56334e78dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.295+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2afc0129c0 tx=0x7f2afc004a40 comp rx=0 tx=0).stop 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.295+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 shutdown_connections 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.295+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7927b0 0x56334e794c20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.296+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e781f40 0x56334e78dc90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.296+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77cdd0 0x56334e786c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.296+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1831301396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77c3e0 0x56334e786710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.296+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 >> 172.21.15.31:0/1831301396 conn(0x56334e73bf80 msgr2=0x56334e76e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.296+0000 7f2aed600640 0 client.25460 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.297+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 shutdown_connections 2024-06-02T22:40:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.298+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1831301396 wait complete. 2024-06-02T22:40:41.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.301+0000 7f2b0da4e740 20 client.25460 trim_cache size 0 max 16384 2024-06-02T22:40:41.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.340+0000 7f2b0da4e740 1 Processor -- start 2024-06-02T22:40:41.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.340+0000 7f2b0da4e740 1 -- start start 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77c3e0 0x56334e772d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e781f40 0x56334e7853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b03400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b03400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44454/0 (socket says 172.21.15.31:44454) 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b03400640 1 -- 172.21.15.31:0/1341018413 learned_addr learned my addr 172.21.15.31:0/1341018413 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a8400 con 0x56334e781f40 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a9f40 con 0x56334e77cdd0 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.341+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a8ad0 con 0x56334e77c3e0 2024-06-02T22:40:41.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.342+0000 7f2b03e00640 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77c3e0 0x56334e772d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.342+0000 7f2b08c00640 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e781f40 0x56334e7853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.343+0000 7f2b03400640 1 -- 172.21.15.31:0/1341018413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77c3e0 msgr2=0x56334e772d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.343+0000 7f2b03400640 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77c3e0 0x56334e772d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.343+0000 7f2b03400640 1 -- 172.21.15.31:0/1341018413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e781f40 msgr2=0x56334e7853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.343+0000 7f2b03400640 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e781f40 0x56334e7853b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.343+0000 7f2b03400640 1 -- 172.21.15.31:0/1341018413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56334e770300 con 0x56334e77cdd0 2024-06-02T22:40:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.344+0000 7f2b03400640 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x56334e770500 tx=0x7f2af0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72ef034187f67d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.344+0000 7f2aefe00640 1 -- 172.21.15.31:0/1341018413 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0053070 con 0x56334e77cdd0 2024-06-02T22:40:41.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.344+0000 7f2aefe00640 1 -- 172.21.15.31:0/1341018413 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0005520 con 0x56334e77cdd0 2024-06-02T22:40:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.345+0000 7f2aefe00640 1 -- 172.21.15.31:0/1341018413 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0053070 con 0x56334e77cdd0 2024-06-02T22:40:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.345+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 msgr2=0x56334e78dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.345+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x56334e770500 tx=0x7f2af0005fd0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 shutdown_connections 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e781f40 0x56334e7853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77cdd0 0x56334e78dc50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/1341018413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e77c3e0 0x56334e772d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 >> 172.21.15.31:0/1341018413 conn(0x56334e73bf80 msgr2=0x56334e772620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 shutdown_connections 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.346+0000 7f2b0da4e740 1 -- 172.21.15.31:0/1341018413 wait complete. 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.347+0000 7f2b0da4e740 1 -- start start 2024-06-02T22:40:41.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.347+0000 7f2b0da4e740 1 Processor -- start 2024-06-02T22:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.348+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.348+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77cdd0 0x56334e78af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.348+0000 7f2b0da4e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7fb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a9870 con 0x56334e77cdd0 2024-06-02T22:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a91a0 con 0x56334e77c3e0 2024-06-02T22:40:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b0da4e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2b041a6400 con 0x56334e781f40 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b0da4e740 10 client.0 _ll_register_callbacks cb 0x7f2afc0094f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b03e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44458/0 (socket says 172.21.15.31:44458) 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b03400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77cdd0 0x56334e78af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.349+0000 7f2b03e00640 1 -- 172.21.15.31:0/316382153 learned_addr learned my addr 172.21.15.31:0/316382153 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b08c00640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7fb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 -- 172.21.15.31:0/316382153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 msgr2=0x56334e7fb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7fb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 -- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77cdd0 msgr2=0x56334e78af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77cdd0 0x56334e78af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 -- 172.21.15.31:0/316382153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56334e7fba30 con 0x56334e77c3e0 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2b03e00640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2af4098180 tx=0x7f2af400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e35abe332ad47f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.350+0000 7f2aed600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2b08c00640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a4990 con 0x56334e77c3e0 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2af409a020 con 0x56334e77c3e0 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af0005520 con 0x56334e77c3e0 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2af4003b30 con 0x56334e77c3e0 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2b0da4e740 10 client.25466 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.351+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56334e7fcc50 con 0x56334e77c3e0 2024-06-02T22:40:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.352+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0005520 con 0x56334e77c3e0 2024-06-02T22:40:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.353+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2af409b170 con 0x56334e77c3e0 2024-06-02T22:40:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 10 client.25466 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 10 client.25466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 20 client.25466 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7fd5d0 0x56334e7ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 4 client.25466 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:40:41.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56334e6deea0 con 0x56334e7fd5d0 2024-06-02T22:40:41.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.354+0000 7f2b03400640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7fd5d0 0x56334e7ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.357+0000 7f2b03400640 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7fd5d0 0x56334e7ff9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7394c7508b36613 server_cookie=f70ad3b6737b65cb in_seq=0 out_seq=0 2024-06-02T22:40:41.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.357+0000 7f2aed600640 10 client.25466 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.476+0000 7f2aed600640 1 -- 172.21.15.31:0/316382153 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56334e6deea0 con 0x56334e7fd5d0 2024-06-02T22:40:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.476+0000 7f2aed600640 10 client.25466 handle_command_reply: tid=0 2024-06-02T22:40:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.476+0000 7f2b0da4e740 1 client.25466 shutdown 2024-06-02T22:40:41.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 msgr2=0x56334e78aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2af4098180 tx=0x7f2af400c7d0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 shutdown_connections 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56334e7fd5d0 0x56334e7ff9f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56334e781f40 0x56334e7fb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56334e77cdd0 0x56334e78af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 --2- 172.21.15.31:0/316382153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56334e77c3e0 0x56334e78aa20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2aed600640 0 client.25466 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:41.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.477+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 >> 172.21.15.31:0/316382153 conn(0x56334e73bf80 msgr2=0x56334e7853b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.478+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 shutdown_connections 2024-06-02T22:40:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.478+0000 7f2b0da4e740 1 -- 172.21.15.31:0/316382153 wait complete. 2024-06-02T22:40:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.478+0000 7f2b0da4e740 20 client.25466 trim_cache size 0 max 16384 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 msgr2=0x7f2ae80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 0x7f2ae80a50f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x56334e77d630 tx=0x7f2afc009820 comp rx=0 tx=0).stop 2024-06-02T22:40:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 msgr2=0x7f2b04199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af400e9c0 tx=0x7f2af400ee80 comp rx=0 tx=0).stop 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 shutdown_connections 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f2ae80a2c30 0x7f2ae80a50f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b041035e0 0x7f2b041a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b04102c20 0x7f2b0419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 --2- 172.21.15.31:0/3421825112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b04101a30 0x7f2b04199eb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 >> 172.21.15.31:0/3421825112 conn(0x7f2b040fcfc0 msgr2=0x7f2b04073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 shutdown_connections 2024-06-02T22:40:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:41.479+0000 7f2b0ac00640 1 -- 172.21.15.31:0/3421825112 wait complete. 2024-06-02T22:40:41.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:41 smithi098 ceph-mon[36750]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-06-02T22:40:42.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:41 smithi178 ceph-mon[36614]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-06-02T22:40:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:41 smithi031 ceph-mon[31767]: pgmap v622: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 562 op/s 2024-06-02T22:40:43.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:43 smithi098 ceph-mon[36750]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-06-02T22:40:44.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:43 smithi178 ceph-mon[36614]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-06-02T22:40:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:43 smithi031 ceph-mon[31767]: pgmap v623: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 MiB/s wr, 663 op/s 2024-06-02T22:40:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 200.0 s, 834.8 tps, lat 119.449 ms stddev 173.083 2024-06-02T22:40:45.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:45 smithi098 ceph-mon[36750]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:40:46.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:45 smithi178 ceph-mon[36614]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:40:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:45 smithi031 ceph-mon[31767]: pgmap v624: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:40:47.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:47 smithi098 ceph-mon[36750]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-06-02T22:40:48.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:47 smithi178 ceph-mon[36614]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-06-02T22:40:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:47 smithi031 ceph-mon[31767]: pgmap v625: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-06-02T22:40:49.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:49 smithi098 ceph-mon[36750]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 MiB/s wr, 521 op/s 2024-06-02T22:40:50.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:49 smithi178 ceph-mon[36614]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 MiB/s wr, 521 op/s 2024-06-02T22:40:50.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:49 smithi031 ceph-mon[31767]: pgmap v626: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.7 MiB/s wr, 521 op/s 2024-06-02T22:40:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 205.0 s, 839.6 tps, lat 119.711 ms stddev 127.805 2024-06-02T22:40:51.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:51 smithi098 ceph-mon[36750]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 531 op/s 2024-06-02T22:40:52.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:51 smithi178 ceph-mon[36614]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 531 op/s 2024-06-02T22:40:52.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:51 smithi031 ceph-mon[31767]: pgmap v627: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 531 op/s 2024-06-02T22:40:53.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:53 smithi098 ceph-mon[36750]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 628 op/s 2024-06-02T22:40:54.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:53 smithi178 ceph-mon[36614]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 628 op/s 2024-06-02T22:40:54.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:53 smithi031 ceph-mon[31767]: pgmap v628: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 628 op/s 2024-06-02T22:40:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 -- 172.21.15.31:0/2286016811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 msgr2=0x7efee4103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 --2- 172.21.15.31:0/2286016811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4103070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efed0009900 tx=0x7efed002a3f0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 -- 172.21.15.31:0/2286016811 shutdown_connections 2024-06-02T22:40:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 --2- 172.21.15.31:0/2286016811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee41035b0 0x7efee4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 --2- 172.21.15.31:0/2286016811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4103070 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 --2- 172.21.15.31:0/2286016811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efee4101a00 0x7efee4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.640+0000 7efeeb000640 1 -- 172.21.15.31:0/2286016811 >> 172.21.15.31:0/2286016811 conn(0x7efee40fcf90 msgr2=0x7efee40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.642+0000 7efeeb000640 1 -- 172.21.15.31:0/2286016811 shutdown_connections 2024-06-02T22:40:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.643+0000 7efeeb000640 1 -- 172.21.15.31:0/2286016811 wait complete. 2024-06-02T22:40:54.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.645+0000 7efeeb000640 1 Processor -- start 2024-06-02T22:40:54.645 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.645+0000 7efeeb000640 1 -- start start 2024-06-02T22:40:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.646+0000 7efeeb000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 0x7efee40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efeeb000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efeeb000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efee41035b0 0x7efee4070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efeeb000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efee410d680 con 0x7efee41035b0 2024-06-02T22:40:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efeeb000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efee410d500 con 0x7efee4101a00 2024-06-02T22:40:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efeeb000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efee410d800 con 0x7efee4102bf0 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efee3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efee3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41874/0 (socket says 172.21.15.31:41874) 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.647+0000 7efee3400640 1 -- 172.21.15.31:0/1566976137 learned_addr learned my addr 172.21.15.31:0/1566976137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3e00640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 0x7efee40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3400640 1 -- 172.21.15.31:0/1566976137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 msgr2=0x7efee40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3400640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 0x7efee40702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3400640 1 -- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efee41035b0 msgr2=0x7efee4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3400640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efee41035b0 0x7efee4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3400640 1 -- 172.21.15.31:0/1566976137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee41b6ec0 con 0x7efee4102bf0 2024-06-02T22:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.648+0000 7efee3e00640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 0x7efee40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:40:54.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.649+0000 7efee3400640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efed0009230 tx=0x7efed00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.653+0000 7efee0c00640 1 -- 172.21.15.31:0/1566976137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed003f030 con 0x7efee4102bf0 2024-06-02T22:40:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.653+0000 7efee0c00640 1 -- 172.21.15.31:0/1566976137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed0003ce0 con 0x7efee4102bf0 2024-06-02T22:40:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.653+0000 7efee0c00640 1 -- 172.21.15.31:0/1566976137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0035070 con 0x7efee4102bf0 2024-06-02T22:40:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.655+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee41b7150 con 0x7efee4102bf0 2024-06-02T22:40:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.655+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee41b75c0 con 0x7efee4102bf0 2024-06-02T22:40:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.663+0000 7efeedd73740 1 Processor -- start 2024-06-02T22:40:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.664+0000 7efeedd73740 1 -- start start 2024-06-02T22:40:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340de6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a340d42420 con 0x55a340de4730 2024-06-02T22:40:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a340ce9c50 con 0x55a340ddf5c0 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efeedd73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a340d3e3e0 con 0x55a340ddebd0 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efee9000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efee9000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41890/0 (socket says 172.21.15.31:41890) 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.665+0000 7efee9000640 1 -- 172.21.15.31:0/2081240643 learned_addr learned my addr 172.21.15.31:0/2081240643 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee3e00640 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 -- 172.21.15.31:0/2081240643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 msgr2=0x55a340de40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 -- 172.21.15.31:0/2081240643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 msgr2=0x55a340de6bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340de6bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 -- 172.21.15.31:0/2081240643 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a340a56210 con 0x55a340ddebd0 2024-06-02T22:40:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.666+0000 7efee9000640 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efedc009ea0 tx=0x7efedc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60b260593b13a22 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.667+0000 7efee0c00640 1 -- 172.21.15.31:0/1566976137 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7efed0042030 con 0x7efee4102bf0 2024-06-02T22:40:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.670+0000 7efee0c00640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.670+0000 7efee0c00640 1 -- 172.21.15.31:0/1566976137 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efed00ef710 con 0x7efee4102bf0 2024-06-02T22:40:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.670+0000 7efee3e00640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.672+0000 7efed9600640 1 -- 172.21.15.31:0/2081240643 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc004d20 con 0x55a340ddebd0 2024-06-02T22:40:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.672+0000 7efed9600640 1 -- 172.21.15.31:0/2081240643 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efedc00ee60 con 0x55a340ddebd0 2024-06-02T22:40:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.672+0000 7efed9600640 1 -- 172.21.15.31:0/2081240643 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0108b0 con 0x55a340ddebd0 2024-06-02T22:40:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 -- 172.21.15.31:0/2081240643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 msgr2=0x55a340ddeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efedc009ea0 tx=0x7efedc009f90 comp rx=0 tx=0).stop 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 -- 172.21.15.31:0/2081240643 shutdown_connections 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340de6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 --2- 172.21.15.31:0/2081240643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340ddeff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.673+0000 7efeedd73740 1 -- 172.21.15.31:0/2081240643 >> 172.21.15.31:0/2081240643 conn(0x55a340da6f80 msgr2=0x55a340dda650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.674+0000 7efee3e00640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 0x7efec80a51f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a340ddf9c0 tx=0x7efed4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.674 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.674+0000 7efeedd73740 1 -- 172.21.15.31:0/2081240643 shutdown_connections 2024-06-02T22:40:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.676+0000 7efeedd73740 1 -- 172.21.15.31:0/2081240643 wait complete. 2024-06-02T22:40:54.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.676+0000 7efeedd73740 1 -- start start 2024-06-02T22:40:54.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.677+0000 7efeedd73740 1 Processor -- start 2024-06-02T22:40:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340de4730 0x55a340df0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a340de76e0 con 0x55a340ddebd0 2024-06-02T22:40:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a340cfd0b0 con 0x55a340ddf5c0 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a340de7860 con 0x55a340de4730 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efeedd73740 10 client.0 _ll_register_callbacks cb 0x55a340ce8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efee3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efee3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35204/0 (socket says 172.21.15.31:35204) 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.678+0000 7efee3e00640 1 -- 172.21.15.31:0/757196634 learned_addr learned my addr 172.21.15.31:0/757196634 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee9000640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340de4730 0x55a340df0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee3e00640 1 -- 172.21.15.31:0/757196634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340de4730 msgr2=0x55a340df0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee3e00640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340de4730 0x55a340df0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee3e00640 1 -- 172.21.15.31:0/757196634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 msgr2=0x55a340de95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee3e00640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.679+0000 7efee3e00640 1 -- 172.21.15.31:0/757196634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a340b22620 con 0x55a340ddebd0 2024-06-02T22:40:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.680+0000 7efee3e00640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efed401dc00 tx=0x7efed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfff467460e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.680+0000 7efece000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:40:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.680+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4010dd0 con 0x55a340ddebd0 2024-06-02T22:40:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.681+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efedc00ee60 con 0x55a340ddebd0 2024-06-02T22:40:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.681+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efed401d020 con 0x55a340ddebd0 2024-06-02T22:40:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.685+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efed4030050 con 0x55a340ddebd0 2024-06-02T22:40:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.685+0000 7efeedd73740 10 client.15309 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.685+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a340df39a0 con 0x55a340ddebd0 2024-06-02T22:40:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.693+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efedc00ee60 con 0x55a340ddebd0 2024-06-02T22:40:54.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.693+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7efed4019040 con 0x55a340ddebd0 2024-06-02T22:40:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 10 client.15309 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 10 client.15309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 20 client.15309 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340df50e0 0x55a340df7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 4 client.15309 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:40:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.694+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a340d4fb50 con 0x55a340df50e0 2024-06-02T22:40:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.695+0000 7efee3400640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340df50e0 0x55a340df7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.696+0000 7efee3400640 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340df50e0 0x55a340df7580 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ddf0e64e6d99124 server_cookie=847e6839fbe22237 in_seq=0 out_seq=0 2024-06-02T22:40:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.696+0000 7efece000640 10 client.15309 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.697+0000 7efece000640 1 -- 172.21.15.31:0/757196634 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a340d4fb50 con 0x55a340df50e0 2024-06-02T22:40:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.697+0000 7efece000640 10 client.15309 handle_command_reply: tid=0 2024-06-02T22:40:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.697+0000 7efeedd73740 1 client.15309 shutdown 2024-06-02T22:40:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.698+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 msgr2=0x55a340de9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.698+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efed401dc00 tx=0x7efed40046c0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 shutdown_connections 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340df50e0 0x55a340df7580 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340de4730 0x55a340df0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340de95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 --2- 172.21.15.31:0/757196634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddebd0 0x55a340de9060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efece000640 0 client.15309 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:54.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.699+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 >> 172.21.15.31:0/757196634 conn(0x55a340da6f80 msgr2=0x55a340dd9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.700+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 shutdown_connections 2024-06-02T22:40:54.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.700+0000 7efeedd73740 1 -- 172.21.15.31:0/757196634 wait complete. 2024-06-02T22:40:54.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.700+0000 7efeedd73740 20 client.15309 trim_cache size 0 max 16384 2024-06-02T22:40:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.739+0000 7efeedd73740 1 Processor -- start 2024-06-02T22:40:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.739+0000 7efeedd73740 1 -- start start 2024-06-02T22:40:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 0x55a340df0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 0x55a340ddd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efee41c1c60 con 0x55a340ddf5c0 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efee41c37a0 con 0x55a340de4730 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efeedd73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efee41c2330 con 0x55a340ddebd0 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efee3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efee3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41908/0 (socket says 172.21.15.31:41908) 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efee3e00640 1 -- 172.21.15.31:0/2335074950 learned_addr learned my addr 172.21.15.31:0/2335074950 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.740+0000 7efee3400640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 0x55a340df0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.741+0000 7efee9000640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 0x55a340ddd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.741+0000 7efee3e00640 1 -- 172.21.15.31:0/2335074950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 msgr2=0x55a340ddd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee3e00640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 0x55a340ddd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee3e00640 1 -- 172.21.15.31:0/2335074950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 msgr2=0x55a340df0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee3e00640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 0x55a340df0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee3e00640 1 -- 172.21.15.31:0/2335074950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a340ddb300 con 0x55a340ddebd0 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee3400640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 0x55a340df0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:40:54.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.742+0000 7efee9000640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 0x55a340ddd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:40:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.743+0000 7efee3e00640 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efed4025560 tx=0x7efed4009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a99f4ddd90bf8b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.743+0000 7efed8c00640 1 -- 172.21.15.31:0/2335074950 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed401d7e0 con 0x55a340ddebd0 2024-06-02T22:40:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.744+0000 7efed8c00640 1 -- 172.21.15.31:0/2335074950 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed4005bf0 con 0x55a340ddebd0 2024-06-02T22:40:54.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.744+0000 7efed8c00640 1 -- 172.21.15.31:0/2335074950 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4025c40 con 0x55a340ddebd0 2024-06-02T22:40:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.745+0000 7efeedd73740 1 -- 172.21.15.31:0/2335074950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 msgr2=0x55a340de9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.745+0000 7efeedd73740 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efed4025560 tx=0x7efed4009530 comp rx=0 tx=0).stop 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 -- 172.21.15.31:0/2335074950 shutdown_connections 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340de4730 0x55a340ddd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340ddf5c0 0x55a340df0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 --2- 172.21.15.31:0/2335074950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340ddebd0 0x55a340de9380 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efed4025560 tx=0x7efed4009530 comp rx=0 tx=0).stop 2024-06-02T22:40:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 -- 172.21.15.31:0/2335074950 >> 172.21.15.31:0/2335074950 conn(0x55a340da6f80 msgr2=0x55a340de8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 -- 172.21.15.31:0/2335074950 shutdown_connections 2024-06-02T22:40:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.747+0000 7efeedd73740 1 -- 172.21.15.31:0/2335074950 wait complete. 2024-06-02T22:40:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.748+0000 7efeedd73740 1 -- start start 2024-06-02T22:40:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.748+0000 7efeedd73740 1 Processor -- start 2024-06-02T22:40:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.749+0000 7efeedd73740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.749+0000 7efeedd73740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340dee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.749+0000 7efeedd73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efee3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efee3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34856/0 (socket says 172.21.15.31:34856) 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efeedd73740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efee41c30d0 con 0x55a340de4730 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efeedd73740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efee41c2a00 con 0x55a340ddf5c0 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efeedd73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efee41bfc40 con 0x55a340def640 2024-06-02T22:40:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efee9000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efee9000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41918/0 (socket says 172.21.15.31:41918) 2024-06-02T22:40:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.751+0000 7efee9000640 1 -- 172.21.15.31:0/930054691 learned_addr learned my addr 172.21.15.31:0/930054691 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.752+0000 7efee9000640 1 -- 172.21.15.31:0/930054691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 msgr2=0x55a340dee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.752+0000 7efee9000640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.752+0000 7efee9000640 1 -- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 msgr2=0x55a340dee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.752+0000 7efee9000640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340dee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.752+0000 7efee9000640 1 -- 172.21.15.31:0/930054691 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a340df0000 con 0x55a340def640 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.754+0000 7efeedd73740 10 client.0 _ll_register_callbacks cb 0x7efed4009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:40:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.754+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efed4005bf0 con 0x55a340def640 2024-06-02T22:40:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.754+0000 7efee3e00640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-02T22:40:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.755+0000 7efee9000640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55a340ddfe20 tx=0x7efedc0189e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=854487fd97685c05 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:40:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.755+0000 7efece000640 10 client.25501 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:40:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.755+0000 7efece000640 1 -- 172.21.15.31:0/930054691 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc028070 con 0x55a340def640 2024-06-02T22:40:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.755+0000 7efece000640 1 -- 172.21.15.31:0/930054691 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efedc003970 con 0x55a340def640 2024-06-02T22:40:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.756+0000 7efece000640 1 -- 172.21.15.31:0/930054691 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efedc01d040 con 0x55a340def640 2024-06-02T22:40:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.756+0000 7efeedd73740 10 client.25501 fetch_fsmap learned FSMap version 30 2024-06-02T22:40:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.757+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55a340e60630 con 0x55a340def640 2024-06-02T22:40:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.757+0000 7efece000640 1 -- 172.21.15.31:0/930054691 <== mon.1 v2:172.21.15.178:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7efedc003bb0 con 0x55a340def640 2024-06-02T22:40:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.757+0000 7efeedd73740 10 client.25501 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:40:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.758+0000 7efeedd73740 10 client.25501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:40:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.758+0000 7efeedd73740 20 client.25501 populate_metadata read hostname 'smithi031' 2024-06-02T22:40:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.758+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340e60cc0 0x55a340e63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:40:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.758+0000 7efeedd73740 4 client.25501 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:40:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.758+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a340d49ea0 con 0x55a340e60cc0 2024-06-02T22:40:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.759+0000 7efee3e00640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340e60cc0 0x55a340e63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:40:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.761+0000 7efee3e00640 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340e60cc0 0x55a340e63120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215d36c457f8c62d server_cookie=f5431bec3cb3e594 in_seq=0 out_seq=0 2024-06-02T22:40:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.761+0000 7efece000640 10 client.25501 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.917+0000 7efece000640 1 -- 172.21.15.31:0/930054691 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a340d49ea0 con 0x55a340e60cc0 2024-06-02T22:40:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.918+0000 7efece000640 10 client.25501 handle_command_reply: tid=0 2024-06-02T22:40:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.918+0000 7efeedd73740 1 client.25501 shutdown 2024-06-02T22:40:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.918+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 msgr2=0x55a340defac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.918+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x55a340ddfe20 tx=0x7efedc0189e0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.918+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 shutdown_connections 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55a340e60cc0 0x55a340e63120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a340def640 0x55a340defac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a340de4730 0x55a340dee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 --2- 172.21.15.31:0/930054691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a340ddf5c0 0x55a340dee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 >> 172.21.15.31:0/930054691 conn(0x55a340da6f80 msgr2=0x55a340ddd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efece000640 0 client.25501 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 shutdown_connections 2024-06-02T22:40:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 1 -- 172.21.15.31:0/930054691 wait complete. 2024-06-02T22:40:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.919+0000 7efeedd73740 20 client.25501 trim_cache size 0 max 16384 2024-06-02T22:40:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:40:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:40:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:40:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.920+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 msgr2=0x7efec80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.920+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 0x7efec80a51f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a340ddf9c0 tx=0x7efed4005f90 comp rx=0 tx=0).stop 2024-06-02T22:40:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.920+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 msgr2=0x7efee4075880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:40:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.920+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efed0009230 tx=0x7efed00042f0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 shutdown_connections 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efec80a2d30 0x7efec80a51f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efee41035b0 0x7efee4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efee4102bf0 0x7efee4075880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 --2- 172.21.15.31:0/1566976137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efee4101a00 0x7efee40702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 >> 172.21.15.31:0/1566976137 conn(0x7efee40fcf90 msgr2=0x7efee4105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 shutdown_connections 2024-06-02T22:40:54.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:40:54.921+0000 7efeeb000640 1 -- 172.21.15.31:0/1566976137 wait complete. 2024-06-02T22:40:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 210.0 s, 973.2 tps, lat 103.138 ms stddev 115.215 2024-06-02T22:40:55.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:55 smithi098 ceph-mon[36750]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-06-02T22:40:56.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:55 smithi178 ceph-mon[36614]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-06-02T22:40:56.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:55 smithi031 ceph-mon[31767]: pgmap v629: 129 pgs: 129 active+clean; 1.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.5 MiB/s wr, 496 op/s 2024-06-02T22:40:57.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:57 smithi098 ceph-mon[36750]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-06-02T22:40:58.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:57 smithi178 ceph-mon[36614]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-06-02T22:40:58.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:57 smithi031 ceph-mon[31767]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 MiB/s wr, 680 op/s 2024-06-02T22:40:59.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:40:59 smithi098 ceph-mon[36750]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 MiB/s wr, 572 op/s 2024-06-02T22:41:00.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:40:59 smithi178 ceph-mon[36614]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 MiB/s wr, 572 op/s 2024-06-02T22:41:00.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:40:59 smithi031 ceph-mon[31767]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.9 MiB/s wr, 572 op/s 2024-06-02T22:41:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 215.0 s, 1475.4 tps, lat 67.043 ms stddev 74.680 2024-06-02T22:41:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:01 smithi098 ceph-mon[36750]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 619 op/s 2024-06-02T22:41:02.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:01 smithi178 ceph-mon[36614]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 619 op/s 2024-06-02T22:41:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:01 smithi031 ceph-mon[31767]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.7 MiB/s wr, 619 op/s 2024-06-02T22:41:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:03 smithi178 ceph-mon[36614]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-06-02T22:41:04.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:03 smithi031 ceph-mon[31767]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-06-02T22:41:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:03 smithi098 ceph-mon[36750]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 700 op/s 2024-06-02T22:41:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 220.0 s, 824.4 tps, lat 120.256 ms stddev 136.527 2024-06-02T22:41:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:05 smithi178 ceph-mon[36614]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 576 op/s 2024-06-02T22:41:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:05 smithi031 ceph-mon[31767]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 576 op/s 2024-06-02T22:41:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:05 smithi098 ceph-mon[36750]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.3 MiB/s wr, 576 op/s 2024-06-02T22:41:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:07 smithi178 ceph-mon[36614]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 727 op/s 2024-06-02T22:41:08.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:07 smithi031 ceph-mon[31767]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 727 op/s 2024-06-02T22:41:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.124+0000 7fc7a5600640 1 -- 172.21.15.31:0/4022077656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a01057e0 msgr2=0x7fc7a010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.124+0000 7fc7a5600640 1 --2- 172.21.15.31:0/4022077656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a01057e0 0x7fc7a010c070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009900 tx=0x7fc78c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 -- 172.21.15.31:0/4022077656 shutdown_connections 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 --2- 172.21.15.31:0/4022077656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a01057e0 0x7fc7a010c070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 --2- 172.21.15.31:0/4022077656 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a01052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 --2- 172.21.15.31:0/4022077656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a0103c30 0x7fc7a0104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 -- 172.21.15.31:0/4022077656 >> 172.21.15.31:0/4022077656 conn(0x7fc7a00ff1c0 msgr2=0x7fc7a01015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 -- 172.21.15.31:0/4022077656 shutdown_connections 2024-06-02T22:41:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.127+0000 7fc7a5600640 1 -- 172.21.15.31:0/4022077656 wait complete. 2024-06-02T22:41:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.128+0000 7fc7a5600640 1 Processor -- start 2024-06-02T22:41:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.128+0000 7fc7a5600640 1 -- start start 2024-06-02T22:41:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 0x7fc7a019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 0x7fc7a01a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0076be0 con 0x7fc7a0104e20 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0076a60 con 0x7fc7a01057e0 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc7a5600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0076d60 con 0x7fc7a0103c30 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc79f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 0x7fc7a01a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 0x7fc7a019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc79f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 0x7fc7a01a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33696/0 (socket says 172.21.15.31:33696) 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.129+0000 7fc79f400640 1 -- 172.21.15.31:0/1811757809 learned_addr learned my addr 172.21.15.31:0/1811757809 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79e000640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 -- 172.21.15.31:0/1811757809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 msgr2=0x7fc7a01a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 0x7fc7a01a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 -- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 msgr2=0x7fc7a019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 -- 172.21.15.31:0/1811757809 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a01a5ec0 con 0x7fc7a0103c30 2024-06-02T22:41:08.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79e000640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.130+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 0x7fc7a019e2a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc798005fd0 tx=0x7fc79800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.131+0000 7fc797400640 1 -- 172.21.15.31:0/1811757809 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798003970 con 0x7fc7a0103c30 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.131+0000 7fc797400640 1 -- 172.21.15.31:0/1811757809 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc798004030 con 0x7fc7a0103c30 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.131+0000 7fc797400640 1 -- 172.21.15.31:0/1811757809 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980107f0 con 0x7fc7a0103c30 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.131+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a01a61b0 con 0x7fc7a0103c30 2024-06-02T22:41:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.131+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a01a6730 con 0x7fc7a0103c30 2024-06-02T22:41:08.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.137+0000 7fc797400640 1 -- 172.21.15.31:0/1811757809 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fc7980041e0 con 0x7fc7a0103c30 2024-06-02T22:41:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.139+0000 7fc797400640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 0x7fc7840a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.140+0000 7fc797400640 1 -- 172.21.15.31:0/1811757809 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc7980cfca0 con 0x7fc7a0103c30 2024-06-02T22:41:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.141+0000 7fc79e000640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 0x7fc7840a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.144+0000 7fc79e000640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 0x7fc7840a51f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.151+0000 7fc7a856e740 1 Processor -- start 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.151+0000 7fc7a856e740 1 -- start start 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.151+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5cbd0 0x557887e5cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e64bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc7a856e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557887dc0420 con 0x557887e62730 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc7a856e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557887d67c50 con 0x557887e5d5c0 2024-06-02T22:41:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc7a856e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557887dbc3e0 con 0x557887e5cbd0 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc79e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc79e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33702/0 (socket says 172.21.15.31:33702) 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.152+0000 7fc79e000640 1 -- 172.21.15.31:0/1461443496 learned_addr learned my addr 172.21.15.31:0/1461443496 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79f400640 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e64bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79e000640 1 -- 172.21.15.31:0/1461443496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5cbd0 msgr2=0x557887e5cff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79e000640 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5cbd0 0x557887e5cff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79e000640 1 -- 172.21.15.31:0/1461443496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 msgr2=0x557887e64bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79e000640 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e64bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.153+0000 7fc79e000640 1 -- 172.21.15.31:0/1461443496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557887ad4210 con 0x557887e5d5c0 2024-06-02T22:41:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.154+0000 7fc79e000640 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc79000ca50 tx=0x7fc79000f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b7af6bdbe011d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.154+0000 7fc78b400640 1 -- 172.21.15.31:0/1461443496 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790023070 con 0x557887e5d5c0 2024-06-02T22:41:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.154+0000 7fc78b400640 1 -- 172.21.15.31:0/1461443496 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc790013db0 con 0x557887e5d5c0 2024-06-02T22:41:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.154+0000 7fc78b400640 1 -- 172.21.15.31:0/1461443496 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790011830 con 0x557887e5d5c0 2024-06-02T22:41:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.155+0000 7fc7a856e740 1 -- 172.21.15.31:0/1461443496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 msgr2=0x557887e620c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.155+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc79000ca50 tx=0x7fc79000f000 comp rx=0 tx=0).stop 2024-06-02T22:41:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 -- 172.21.15.31:0/1461443496 shutdown_connections 2024-06-02T22:41:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e64bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5d5c0 0x557887e620c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1461443496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5cbd0 0x557887e5cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 -- 172.21.15.31:0/1461443496 >> 172.21.15.31:0/1461443496 conn(0x557887e24f80 msgr2=0x557887e58650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.156+0000 7fc7a856e740 1 -- 172.21.15.31:0/1461443496 shutdown_connections 2024-06-02T22:41:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.157+0000 7fc7a856e740 1 -- 172.21.15.31:0/1461443496 wait complete. 2024-06-02T22:41:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.157+0000 7fc7a856e740 1 -- start start 2024-06-02T22:41:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.158+0000 7fc7a856e740 1 Processor -- start 2024-06-02T22:41:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5d5c0 0x557887e78540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e62730 0x557887e7f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557887e766f0 con 0x557887e5d5c0 2024-06-02T22:41:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557887d7b0b0 con 0x557887e5cbd0 2024-06-02T22:41:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557887e76870 con 0x557887e62730 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.159+0000 7fc7a856e740 10 client.0 _ll_register_callbacks cb 0x557887d66f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.160+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.160+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33708/0 (socket says 172.21.15.31:33708) 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.160+0000 7fc79ea00640 1 -- 172.21.15.31:0/4149728906 learned_addr learned my addr 172.21.15.31:0/4149728906 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.161+0000 7fc79ea00640 1 -- 172.21.15.31:0/4149728906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e62730 msgr2=0x557887e7f580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.161+0000 7fc79ea00640 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e62730 0x557887e7f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.161+0000 7fc79ea00640 1 -- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5d5c0 msgr2=0x557887e78540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.161+0000 7fc79ea00640 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5d5c0 0x557887e78540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.161+0000 7fc79ea00640 1 -- 172.21.15.31:0/4149728906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557887ba0620 con 0x557887e5cbd0 2024-06-02T22:41:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.162+0000 7fc79ea00640 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc798098ae0 tx=0x7fc79809bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14051f65e88c9bac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.163+0000 7fc77fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.163+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980a04c0 con 0x557887e5cbd0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.163+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc7980bc0c0 con 0x557887e5cbd0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.163+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc790013db0 con 0x557887e5cbd0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.163+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7980a4d80 con 0x557887e5cbd0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.164+0000 7fc7a856e740 10 client.25487 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.164+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557887e82960 con 0x557887e5cbd0 2024-06-02T22:41:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.165+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc790013db0 con 0x557887e5cbd0 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.166+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc798004b60 con 0x557887e5cbd0 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 10 client.25487 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 10 client.25487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 20 client.25487 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887e83f80 0x557887e86410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 4 client.25487 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:41:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.167+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557887dcdb50 con 0x557887e83f80 2024-06-02T22:41:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.168+0000 7fc79e000640 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887e83f80 0x557887e86410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.171+0000 7fc79e000640 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887e83f80 0x557887e86410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57a2d83029b4b003 server_cookie=e90b19060b070eea in_seq=0 out_seq=0 2024-06-02T22:41:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.173+0000 7fc77fe00640 10 client.25487 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.173+0000 7fc77fe00640 1 -- 172.21.15.31:0/4149728906 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557887dcdb50 con 0x557887e83f80 2024-06-02T22:41:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.173+0000 7fc77fe00640 10 client.25487 handle_command_reply: tid=0 2024-06-02T22:41:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 client.25487 shutdown 2024-06-02T22:41:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 msgr2=0x557887e78000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc798098ae0 tx=0x7fc79809bd80 comp rx=0 tx=0).stop 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 shutdown_connections 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887e83f80 0x557887e86410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e62730 0x557887e7f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5d5c0 0x557887e78540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 --2- 172.21.15.31:0/4149728906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 >> 172.21.15.31:0/4149728906 conn(0x557887e24f80 msgr2=0x557887e57810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.174+0000 7fc77fe00640 0 client.25487 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.175+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 shutdown_connections 2024-06-02T22:41:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.175+0000 7fc7a856e740 1 -- 172.21.15.31:0/4149728906 wait complete. 2024-06-02T22:41:08.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.175+0000 7fc7a856e740 20 client.25487 trim_cache size 0 max 16384 2024-06-02T22:41:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 Processor -- start 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 -- start start 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e5b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01a8470 con 0x557887e62730 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.207+0000 7fc7a856e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01a9fb0 con 0x557887e5cbd0 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc7a856e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01a8b40 con 0x557887e5d5c0 2024-06-02T22:41:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35734/0 (socket says 172.21.15.31:35734) 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79e000640 1 -- 172.21.15.31:0/1660771066 learned_addr learned my addr 172.21.15.31:0/1660771066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79f400640 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e5b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 -- 172.21.15.31:0/1660771066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 msgr2=0x557887e7f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 -- 172.21.15.31:0/1660771066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 msgr2=0x557887e5b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e5b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79ea00640 1 -- 172.21.15.31:0/1660771066 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557887e59300 con 0x557887e5cbd0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.208+0000 7fc79e000640 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc79ea00640 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc798000f80 tx=0x7fc79809c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78702622341e16b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc78aa00640 1 -- 172.21.15.31:0/1660771066 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980bc0a0 con 0x557887e5cbd0 2024-06-02T22:41:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc78aa00640 1 -- 172.21.15.31:0/1660771066 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc798004b60 con 0x557887e5cbd0 2024-06-02T22:41:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc78aa00640 1 -- 172.21.15.31:0/1660771066 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79809b7c0 con 0x557887e5cbd0 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc7a856e740 1 -- 172.21.15.31:0/1660771066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 msgr2=0x557887e78320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.209+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc798000f80 tx=0x7fc79809c810 comp rx=0 tx=0).stop 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 -- 172.21.15.31:0/1660771066 shutdown_connections 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e62730 0x557887e5b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 --2- 172.21.15.31:0/1660771066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e5cbd0 0x557887e78320 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 -- 172.21.15.31:0/1660771066 >> 172.21.15.31:0/1660771066 conn(0x557887e24f80 msgr2=0x557887e77c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 -- 172.21.15.31:0/1660771066 shutdown_connections 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 -- 172.21.15.31:0/1660771066 wait complete. 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 -- start start 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.210+0000 7fc7a856e740 1 Processor -- start 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5cbd0 0x557887e7a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e62730 0x557887e7dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01a98e0 con 0x557887e5cbd0 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01a9210 con 0x557887e62730 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0116dd0 con 0x557887e5d5c0 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc7a856e740 10 client.0 _ll_register_callbacks cb 0x7fc79809bfb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc79e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc79e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35740/0 (socket says 172.21.15.31:35740) 2024-06-02T22:41:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc79e000640 1 -- 172.21.15.31:0/3681697011 learned_addr learned my addr 172.21.15.31:0/3681697011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc79f400640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e62730 0x557887e7dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.211+0000 7fc79ea00640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5cbd0 0x557887e7a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:07 smithi098 ceph-mon[36750]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 727 op/s 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.212+0000 7fc79e000640 1 -- 172.21.15.31:0/3681697011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e62730 msgr2=0x557887e7dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.212+0000 7fc79e000640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e62730 0x557887e7dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.212+0000 7fc79e000640 1 -- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5cbd0 msgr2=0x557887e7a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.212+0000 7fc79e000640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5cbd0 0x557887e7a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.212+0000 7fc79e000640 1 -- 172.21.15.31:0/3681697011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557887e7e1d0 con 0x557887e5d5c0 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.214+0000 7fc79e000640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc79000aee0 tx=0x7fc79000cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc7437a6721f5a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.214+0000 7fc77fe00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:41:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.214+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79003a060 con 0x557887e5d5c0 2024-06-02T22:41:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.215+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc790011770 con 0x557887e5d5c0 2024-06-02T22:41:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.215+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc798004b60 con 0x557887e5d5c0 2024-06-02T22:41:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.216+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc790023040 con 0x557887e5d5c0 2024-06-02T22:41:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.216+0000 7fc7a856e740 10 client.25513 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.217+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557887e7f510 con 0x557887e5d5c0 2024-06-02T22:41:08.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.217+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc798004b60 con 0x557887e5d5c0 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc790035a20 con 0x557887e5d5c0 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 10 client.25513 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 20 client.25513 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887effda0 0x557887f021c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 4 client.25513 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:41:08.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557887dc7ea0 con 0x557887effda0 2024-06-02T22:41:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.218+0000 7fc79ea00640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887effda0 0x557887f021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.219+0000 7fc79ea00640 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887effda0 0x557887f021c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b859f595544e0 server_cookie=e68b30125dd8d9d1 in_seq=0 out_seq=0 2024-06-02T22:41:08.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.219+0000 7fc77fe00640 10 client.25513 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc77fe00640 1 -- 172.21.15.31:0/3681697011 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557887dc7ea0 con 0x557887effda0 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc77fe00640 10 client.25513 handle_command_reply: tid=0 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 client.25513 shutdown 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 msgr2=0x557887e7ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc79000aee0 tx=0x7fc79000cfd0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 shutdown_connections 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557887effda0 0x557887f021c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557887e62730 0x557887e7dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc77fe00640 0 client.25513 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557887e5d5c0 0x557887e7ac10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 --2- 172.21.15.31:0/3681697011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557887e5cbd0 0x557887e7a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.244+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 >> 172.21.15.31:0/3681697011 conn(0x557887e24f80 msgr2=0x557887e5b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.245+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 shutdown_connections 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.245+0000 7fc7a856e740 1 -- 172.21.15.31:0/3681697011 wait complete. 2024-06-02T22:41:08.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.245+0000 7fc7a856e740 20 client.25513 trim_cache size 0 max 16384 2024-06-02T22:41:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:41:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:41:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:41:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 msgr2=0x7fc7840a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.246 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 0x7fc7840a51f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc790006fd0 tx=0x7fc790008040 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 msgr2=0x7fc7a019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 0x7fc7a019e2a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc798005fd0 tx=0x7fc79800ef90 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 shutdown_connections 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc7840a2d30 0x7fc7840a51f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7a01057e0 0x7fc7a01a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a0104e20 0x7fc7a019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 --2- 172.21.15.31:0/1811757809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7a0103c30 0x7fc7a019e2a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 >> 172.21.15.31:0/1811757809 conn(0x7fc7a00ff1c0 msgr2=0x7fc7a00795c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 shutdown_connections 2024-06-02T22:41:08.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:08.246+0000 7fc7a5600640 1 -- 172.21.15.31:0/1811757809 wait complete. 2024-06-02T22:41:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:09 smithi178 ceph-mon[36614]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-06-02T22:41:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:09 smithi031 ceph-mon[31767]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-06-02T22:41:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:09 smithi098 ceph-mon[36750]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 MiB/s wr, 567 op/s 2024-06-02T22:41:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 225.0 s, 583.2 tps, lat 143.609 ms stddev 167.784 2024-06-02T22:41:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:11 smithi178 ceph-mon[36614]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-06-02T22:41:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:11 smithi031 ceph-mon[31767]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-06-02T22:41:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:11 smithi098 ceph-mon[36750]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-06-02T22:41:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:13 smithi178 ceph-mon[36614]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-06-02T22:41:14.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:13 smithi031 ceph-mon[31767]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-06-02T22:41:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:13 smithi098 ceph-mon[36750]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-06-02T22:41:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 230.0 s, 993.4 tps, lat 117.488 ms stddev 211.474 2024-06-02T22:41:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:15 smithi178 ceph-mon[36614]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 824 op/s 2024-06-02T22:41:16.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:15 smithi031 ceph-mon[31767]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 824 op/s 2024-06-02T22:41:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:15 smithi098 ceph-mon[36750]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 824 op/s 2024-06-02T22:41:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:17 smithi178 ceph-mon[36614]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 969 op/s 2024-06-02T22:41:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:17 smithi031 ceph-mon[31767]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 969 op/s 2024-06-02T22:41:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:17 smithi098 ceph-mon[36750]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 969 op/s 2024-06-02T22:41:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:19 smithi178 ceph-mon[36614]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-06-02T22:41:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:19 smithi031 ceph-mon[31767]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-06-02T22:41:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:19 smithi098 ceph-mon[36750]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 846 op/s 2024-06-02T22:41:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 235.0 s, 1115.8 tps, lat 90.194 ms stddev 104.250 2024-06-02T22:41:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 -- 172.21.15.31:0/3478142508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910100720 msgr2=0x7f3910100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 --2- 172.21.15.31:0/3478142508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910100720 0x7f3910100b40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f390002a3f0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 -- 172.21.15.31:0/3478142508 shutdown_connections 2024-06-02T22:41:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 --2- 172.21.15.31:0/3478142508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39101022d0 0x7f3910108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 --2- 172.21.15.31:0/3478142508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3910101910 0x7f3910101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 --2- 172.21.15.31:0/3478142508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910100720 0x7f3910100b40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.448+0000 7f3915200640 1 -- 172.21.15.31:0/3478142508 >> 172.21.15.31:0/3478142508 conn(0x7f39100fbc90 msgr2=0x7f39100fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.449+0000 7f3915200640 1 -- 172.21.15.31:0/3478142508 shutdown_connections 2024-06-02T22:41:21.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.449+0000 7f3915200640 1 -- 172.21.15.31:0/3478142508 wait complete. 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.450+0000 7f3915200640 1 Processor -- start 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.450+0000 7f3915200640 1 -- start start 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.450+0000 7f3915200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 0x7f3910199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.450+0000 7f3915200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.450+0000 7f3915200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39101022d0 0x7f39101a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f3915200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f391010d520 con 0x7f3910100720 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f3915200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f391010d3a0 con 0x7f3910101910 2024-06-02T22:41:21.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f3915200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f391010d6a0 con 0x7f39101022d0 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:50918/0 (socket says 172.21.15.31:50918) 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390ea00640 1 -- 172.21.15.31:0/184516940 learned_addr learned my addr 172.21.15.31:0/184516940 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390fe00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39101022d0 0x7f39101a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390f400640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 0x7f3910199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390ea00640 1 -- 172.21.15.31:0/184516940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39101022d0 msgr2=0x7f39101a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.451+0000 7f390ea00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39101022d0 0x7f39101a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.452+0000 7f390ea00640 1 -- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 msgr2=0x7f3910199e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.452+0000 7f390ea00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 0x7f3910199e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.452+0000 7f390ea00640 1 -- 172.21.15.31:0/184516940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39101a19e0 con 0x7f3910101910 2024-06-02T22:41:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.452+0000 7f390f400640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 0x7f3910199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:41:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.453+0000 7f390ea00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00e9f0 tx=0x7f38fc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.454+0000 7f3907e00640 1 -- 172.21.15.31:0/184516940 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00cd80 con 0x7f3910101910 2024-06-02T22:41:21.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.454+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39101a1cd0 con 0x7f3910101910 2024-06-02T22:41:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.454+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a21c0 con 0x7f3910101910 2024-06-02T22:41:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.454+0000 7f3907e00640 1 -- 172.21.15.31:0/184516940 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38fc005500 con 0x7f3910101910 2024-06-02T22:41:21.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.454+0000 7f3907e00640 1 -- 172.21.15.31:0/184516940 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00cd80 con 0x7f3910101910 2024-06-02T22:41:21.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.458+0000 7f39195f6740 1 Processor -- start 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.458+0000 7f39195f6740 1 -- start start 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5702d90 0x556fb57031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb570ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556fb5666420 con 0x556fb5702d90 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fb560dc50 con 0x556fb5703780 2024-06-02T22:41:21.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f39195f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556fb56623e0 con 0x556fb57088f0 2024-06-02T22:41:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f390f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f390fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5702d90 0x556fb57031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f390f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:50926/0 (socket says 172.21.15.31:50926) 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.459+0000 7f390f400640 1 -- 172.21.15.31:0/1453119361 learned_addr learned my addr 172.21.15.31:0/1453119361 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 -- 172.21.15.31:0/1453119361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 msgr2=0x556fb570ad80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb570ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 -- 172.21.15.31:0/1453119361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5702d90 msgr2=0x556fb57031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5702d90 0x556fb57031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 -- 172.21.15.31:0/1453119361 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb537a210 con 0x556fb5703780 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.460+0000 7f390f400640 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3900031610 tx=0x7f3900004100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e0152eb19d24412 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.461 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.461+0000 7f3904c00640 1 -- 172.21.15.31:0/1453119361 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900035030 con 0x556fb5703780 2024-06-02T22:41:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.461+0000 7f3907e00640 1 -- 172.21.15.31:0/184516940 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f38fc005020 con 0x7f3910101910 2024-06-02T22:41:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.461+0000 7f3904c00640 1 -- 172.21.15.31:0/1453119361 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3900005520 con 0x556fb5703780 2024-06-02T22:41:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.461+0000 7f3904c00640 1 -- 172.21.15.31:0/1453119361 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900031910 con 0x556fb5703780 2024-06-02T22:41:21.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.462+0000 7f39195f6740 1 -- 172.21.15.31:0/1453119361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 msgr2=0x556fb5708280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.462+0000 7f39195f6740 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3900031610 tx=0x7f3900004100 comp rx=0 tx=0).stop 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 -- 172.21.15.31:0/1453119361 shutdown_connections 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb570ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5703780 0x556fb5708280 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 --2- 172.21.15.31:0/1453119361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5702d90 0x556fb57031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 -- 172.21.15.31:0/1453119361 >> 172.21.15.31:0/1453119361 conn(0x556fb56caf80 msgr2=0x556fb56fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 -- 172.21.15.31:0/1453119361 shutdown_connections 2024-06-02T22:41:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 -- 172.21.15.31:0/1453119361 wait complete. 2024-06-02T22:41:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.463+0000 7f39195f6740 1 -- start start 2024-06-02T22:41:21.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.464+0000 7f3907e00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 0x7f38f40a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.464+0000 7f39195f6740 1 Processor -- start 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.464+0000 7f3907e00640 1 -- 172.21.15.31:0/184516940 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f38fc0cf360 con 0x7f3910101910 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.464+0000 7f390fe00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 0x7f38f40a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb570d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb57088f0 0x556fb57146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556fb570b840 con 0x556fb5703780 2024-06-02T22:41:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556fb56210b0 con 0x556fb57088f0 2024-06-02T22:41:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556fb570b9c0 con 0x556fb5702d90 2024-06-02T22:41:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f39195f6740 10 client.0 _ll_register_callbacks cb 0x556fb560cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.465+0000 7f390fe00640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 0x7f38f40a51d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556fb5703fe0 tx=0x7f3908009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:46362/0 (socket says 172.21.15.31:46362) 2024-06-02T22:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 -- 172.21.15.31:0/955705730 learned_addr learned my addr 172.21.15.31:0/955705730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb57088f0 0x556fb57146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390ea00640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb570d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 -- 172.21.15.31:0/955705730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb57088f0 msgr2=0x556fb57146d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb57088f0 0x556fb57146d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.466+0000 7f390f400640 1 -- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 msgr2=0x556fb570d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.467+0000 7f390f400640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb570d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.467+0000 7f390f400640 1 -- 172.21.15.31:0/955705730 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb5446620 con 0x556fb5702d90 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.467+0000 7f390ea00640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb570d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.467+0000 7f390f400640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f39000045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d27f81f0190cb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.467+0000 7f38f9600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:41:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.470+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900051060 con 0x556fb5702d90 2024-06-02T22:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.470+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3900005280 con 0x556fb5702d90 2024-06-02T22:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.470+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3900005520 con 0x556fb5702d90 2024-06-02T22:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.472+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3900035040 con 0x556fb5702d90 2024-06-02T22:41:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.473+0000 7f39195f6740 10 client.25522 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:21.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.473+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fb570b8b0 con 0x556fb5702d90 2024-06-02T22:41:21.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.480+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3900005520 con 0x556fb5702d90 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f390004b030 con 0x556fb5702d90 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 10 client.25522 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 20 client.25522 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5718a10 0x556fb571ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 4 client.25522 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:41:21.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.481+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fb5673b50 con 0x556fb5718a10 2024-06-02T22:41:21.484 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.484+0000 7f390ea00640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5718a10 0x556fb571ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.485+0000 7f390ea00640 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5718a10 0x556fb571ae20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=670959f511be11c1 server_cookie=8f4b444a6fb63b90 in_seq=0 out_seq=0 2024-06-02T22:41:21.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.485+0000 7f38f9600640 10 client.25522 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.490+0000 7f38f9600640 1 -- 172.21.15.31:0/955705730 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556fb5673b50 con 0x556fb5718a10 2024-06-02T22:41:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.490+0000 7f38f9600640 10 client.25522 handle_command_reply: tid=0 2024-06-02T22:41:21.490 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.490+0000 7f39195f6740 1 client.25522 shutdown 2024-06-02T22:41:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.490+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 msgr2=0x556fb570d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.490+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f39000045e0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 shutdown_connections 2024-06-02T22:41:21.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5718a10 0x556fb571ae20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f38f9600640 0 client.25522 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb57088f0 0x556fb57146d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb570d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 --2- 172.21.15.31:0/955705730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5702d90 0x556fb570d150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.491+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 >> 172.21.15.31:0/955705730 conn(0x556fb56caf80 msgr2=0x556fb56fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.492+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 shutdown_connections 2024-06-02T22:41:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.493+0000 7f39195f6740 1 -- 172.21.15.31:0/955705730 wait complete. 2024-06-02T22:41:21.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.493+0000 7f39195f6740 20 client.25522 trim_cache size 0 max 16384 2024-06-02T22:41:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.530+0000 7f39195f6740 1 Processor -- start 2024-06-02T22:41:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.530+0000 7f39195f6740 1 -- start start 2024-06-02T22:41:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.530+0000 7f39195f6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb570c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.530+0000 7f39195f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5703780 0x556fb5714690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.530+0000 7f39195f6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f390fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f39195f6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f38f000fba0 con 0x556fb57088f0 2024-06-02T22:41:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f390fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58920/0 (socket says 172.21.15.31:58920) 2024-06-02T22:41:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f390fe00640 1 -- 172.21.15.31:0/1039889346 learned_addr learned my addr 172.21.15.31:0/1039889346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38f00116e0 con 0x556fb5702d90 2024-06-02T22:41:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.531+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f38f0010270 con 0x556fb5703780 2024-06-02T22:41:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390f400640 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb570c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 -- 172.21.15.31:0/1039889346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5703780 msgr2=0x556fb5714690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5703780 0x556fb5714690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 -- 172.21.15.31:0/1039889346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 msgr2=0x556fb570c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb570c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 -- 172.21.15.31:0/1039889346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb56f8d80 con 0x556fb57088f0 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.532+0000 7f390fe00640 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3908003e40 tx=0x7f3908011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f124e17e9410b38e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.533+0000 7f38fbe00640 1 -- 172.21.15.31:0/1039889346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390800f480 con 0x556fb57088f0 2024-06-02T22:41:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.533+0000 7f38fbe00640 1 -- 172.21.15.31:0/1039889346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390800fb00 con 0x556fb57088f0 2024-06-02T22:41:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.533+0000 7f38fbe00640 1 -- 172.21.15.31:0/1039889346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390801da60 con 0x556fb57088f0 2024-06-02T22:41:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.534+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 msgr2=0x556fb570c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.534+0000 7f39195f6740 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3908003e40 tx=0x7f3908011f90 comp rx=0 tx=0).stop 2024-06-02T22:41:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.535+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 shutdown_connections 2024-06-02T22:41:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.535+0000 7f39195f6740 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb57088f0 0x556fb570c960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.535+0000 7f39195f6740 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb5703780 0x556fb5714690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.535+0000 7f39195f6740 1 --2- 172.21.15.31:0/1039889346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb570c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.535+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 >> 172.21.15.31:0/1039889346 conn(0x556fb56caf80 msgr2=0x556fb56fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.536+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 shutdown_connections 2024-06-02T22:41:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.536+0000 7f39195f6740 1 -- 172.21.15.31:0/1039889346 wait complete. 2024-06-02T22:41:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.537+0000 7f39195f6740 1 -- start start 2024-06-02T22:41:21.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.537+0000 7f39195f6740 1 Processor -- start 2024-06-02T22:41:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.538+0000 7f39195f6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb5711a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.538+0000 7f39195f6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb5711fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.538+0000 7f39195f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f39195f6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f38f0011010 con 0x556fb5703780 2024-06-02T22:41:21.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f39195f6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38f0010940 con 0x556fb5702d90 2024-06-02T22:41:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f390fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f390fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:46376/0 (socket says 172.21.15.31:46376) 2024-06-02T22:41:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f390fe00640 1 -- 172.21.15.31:0/3909068236 learned_addr learned my addr 172.21.15.31:0/3909068236 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f390ea00640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb5711fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.539+0000 7f390f400640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb5711a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.540+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f38f000db80 con 0x556fb57088f0 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.540+0000 7f39195f6740 10 client.0 _ll_register_callbacks cb 0x7f3908009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 -- 172.21.15.31:0/3909068236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 msgr2=0x556fb5711a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb5711a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 -- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 msgr2=0x556fb5711fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:21.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb5711fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 -- 172.21.15.31:0/3909068236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb5713550 con 0x556fb57088f0 2024-06-02T22:41:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f390fe00640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3908005ff0 tx=0x7f3908003a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3abf925a03451b93 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:21.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.541+0000 7f38f9600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:41:21.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.546+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908036060 con 0x556fb57088f0 2024-06-02T22:41:21.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.546+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3908017040 con 0x556fb57088f0 2024-06-02T22:41:21.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.546+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f390800fb00 con 0x556fb57088f0 2024-06-02T22:41:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.547+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f390800f710 con 0x556fb57088f0 2024-06-02T22:41:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.547+0000 7f39195f6740 10 client.25525 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:21.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.547+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556fb5714840 con 0x556fb57088f0 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.547+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f390800fb00 con 0x556fb57088f0 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f39080319b0 con 0x556fb57088f0 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 10 client.25525 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 10 client.25525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 20 client.25525 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5783c50 0x556fb5786070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:21.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 4 client.25525 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:41:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556fb56fedd0 con 0x556fb5783c50 2024-06-02T22:41:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.549+0000 7f390f400640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5783c50 0x556fb5786070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.550+0000 7f390f400640 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5783c50 0x556fb5786070 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a14af0adf8df90e server_cookie=29521623f30f8017 in_seq=0 out_seq=0 2024-06-02T22:41:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.550+0000 7f38f9600640 10 client.25525 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f38f9600640 1 -- 172.21.15.31:0/3909068236 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556fb56fedd0 con 0x556fb5783c50 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f38f9600640 10 client.25525 handle_command_reply: tid=0 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 client.25525 shutdown 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 msgr2=0x556fb5712f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3908005ff0 tx=0x7f3908003a70 comp rx=0 tx=0).stop 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 shutdown_connections 2024-06-02T22:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556fb5783c50 0x556fb5786070 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fb57088f0 0x556fb5712f60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556fb5703780 0x556fb5711fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 --2- 172.21.15.31:0/3909068236 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556fb5702d90 0x556fb5711a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 >> 172.21.15.31:0/3909068236 conn(0x556fb56caf80 msgr2=0x556fb57014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.659+0000 7f38f9600640 0 client.25525 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.660+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 shutdown_connections 2024-06-02T22:41:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.660+0000 7f39195f6740 1 -- 172.21.15.31:0/3909068236 wait complete. 2024-06-02T22:41:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.660+0000 7f39195f6740 20 client.25525 trim_cache size 0 max 16384 2024-06-02T22:41:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:41:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:41:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:41:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.661+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 msgr2=0x7f38f40a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.661+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 0x7f38f40a51d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556fb5703fe0 tx=0x7f3908009500 comp rx=0 tx=0).stop 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.661+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 msgr2=0x7f391019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.661+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00e9f0 tx=0x7f38fc00edf0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 shutdown_connections 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f38f40a2d10 0x7f38f40a51d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39101022d0 0x7f39101a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3910101910 0x7f391019a3a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 --2- 172.21.15.31:0/184516940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3910100720 0x7f3910199e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 >> 172.21.15.31:0/184516940 conn(0x7f39100fbc90 msgr2=0x7f3910109520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 shutdown_connections 2024-06-02T22:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:21.662+0000 7f3915200640 1 -- 172.21.15.31:0/184516940 wait complete. 2024-06-02T22:41:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:21 smithi178 ceph-mon[36614]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T22:41:22.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:21 smithi031 ceph-mon[31767]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T22:41:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:21 smithi098 ceph-mon[36750]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-06-02T22:41:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:23 smithi178 ceph-mon[36614]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T22:41:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:23 smithi031 ceph-mon[31767]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T22:41:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:23 smithi098 ceph-mon[36750]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 856 op/s 2024-06-02T22:41:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 240.0 s, 863.4 tps, lat 116.412 ms stddev 140.576 2024-06-02T22:41:26.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:25 smithi178 ceph-mon[36614]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 551 op/s 2024-06-02T22:41:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:25 smithi031 ceph-mon[31767]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 551 op/s 2024-06-02T22:41:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:25 smithi098 ceph-mon[36750]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 551 op/s 2024-06-02T22:41:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:27 smithi178 ceph-mon[36614]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 661 op/s 2024-06-02T22:41:28.120 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:27 smithi031 ceph-mon[31767]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 661 op/s 2024-06-02T22:41:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:27 smithi098 ceph-mon[36750]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.4 MiB/s wr, 661 op/s 2024-06-02T22:41:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:29 smithi031 ceph-mon[31767]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-06-02T22:41:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:29 smithi098 ceph-mon[36750]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-06-02T22:41:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 245.0 s, 742.6 tps, lat 132.727 ms stddev 184.243 2024-06-02T22:41:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:29 smithi178 ceph-mon[36614]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-06-02T22:41:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:31 smithi031 ceph-mon[31767]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 619 op/s 2024-06-02T22:41:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:31 smithi098 ceph-mon[36750]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 619 op/s 2024-06-02T22:41:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:31 smithi178 ceph-mon[36614]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 619 op/s 2024-06-02T22:41:34.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:33 smithi031 ceph-mon[31767]: pgmap v648: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 681 op/s 2024-06-02T22:41:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:33 smithi098 ceph-mon[36750]: pgmap v648: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 681 op/s 2024-06-02T22:41:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:33 smithi178 ceph-mon[36614]: pgmap v648: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 681 op/s 2024-06-02T22:41:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 -- 172.21.15.31:0/4242729733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b081057d0 msgr2=0x7f3b0810c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/4242729733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b081057d0 0x7f3b0810c060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009be0 tx=0x7f3b0002a6d0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 -- 172.21.15.31:0/4242729733 shutdown_connections 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/4242729733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b081057d0 0x7f3b0810c060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/4242729733 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08104e10 0x7f3b08105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/4242729733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b08103c20 0x7f3b08104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 -- 172.21.15.31:0/4242729733 >> 172.21.15.31:0/4242729733 conn(0x7f3b080ff190 msgr2=0x7f3b081015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 -- 172.21.15.31:0/4242729733 shutdown_connections 2024-06-02T22:41:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.843+0000 7f3b0fc00640 1 -- 172.21.15.31:0/4242729733 wait complete. 2024-06-02T22:41:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 Processor -- start 2024-06-02T22:41:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 -- start start 2024-06-02T22:41:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 0x7f3b08199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b08104e10 0x7f3b0819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 0x7f3b081a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0810f880 con 0x7f3b081057d0 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0810f700 con 0x7f3b08103c20 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0fc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0810fa00 con 0x7f3b08104e10 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 0x7f3b081a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.845+0000 7f3b0d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 0x7f3b08199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 0x7f3b081a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50220/0 (socket says 172.21.15.31:50220) 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0dc00640 1 -- 172.21.15.31:0/727092047 learned_addr learned my addr 172.21.15.31:0/727092047 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b07e00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b08104e10 0x7f3b0819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 -- 172.21.15.31:0/727092047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b08104e10 msgr2=0x7f3b0819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b08104e10 0x7f3b0819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 -- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 msgr2=0x7f3b081a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 0x7f3b081a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 -- 172.21.15.31:0/727092047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b081a1a30 con 0x7f3b08103c20 2024-06-02T22:41:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.846+0000 7f3b0d200640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 0x7f3b08199e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e9c0 tx=0x7f3afc00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.849+0000 7f3b05600640 1 -- 172.21.15.31:0/727092047 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00ccc0 con 0x7f3b08103c20 2024-06-02T22:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.849+0000 7f3b05600640 1 -- 172.21.15.31:0/727092047 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3afc0035f0 con 0x7f3b08103c20 2024-06-02T22:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.849+0000 7f3b05600640 1 -- 172.21.15.31:0/727092047 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00ce60 con 0x7f3b08103c20 2024-06-02T22:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.849+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b081a1d20 con 0x7f3b08103c20 2024-06-02T22:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.849+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b081a21c0 con 0x7f3b08103c20 2024-06-02T22:41:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.853+0000 7f3b129d4740 1 Processor -- start 2024-06-02T22:41:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 -- start start 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f89fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a05c0 0x55f96f8a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f96f803420 con 0x55f96f8a05c0 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f96f7aac50 con 0x55f96f89fbd0 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.854+0000 7f3b129d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f96f7ff3e0 con 0x55f96f8a5730 2024-06-02T22:41:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f89fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f89fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46610/0 (socket says 172.21.15.31:46610) 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b0dc00640 1 -- 172.21.15.31:0/2674656647 learned_addr learned my addr 172.21.15.31:0/2674656647 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 -- 172.21.15.31:0/2674656647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 msgr2=0x55f96f89fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f89fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 -- 172.21.15.31:0/2674656647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a05c0 msgr2=0x55f96f8a50c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a05c0 0x55f96f8a50c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b07e00640 1 -- 172.21.15.31:0/2674656647 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96f517210 con 0x55f96f8a5730 2024-06-02T22:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.855+0000 7f3b05600640 1 -- 172.21.15.31:0/727092047 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f3afc0037a0 con 0x7f3b08103c20 2024-06-02T22:41:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.856+0000 7f3b07e00640 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8a7bc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3af4005fd0 tx=0x7f3af4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3fd6ac354e5fee4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.857+0000 7f3afa000640 1 -- 172.21.15.31:0/2674656647 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4004050 con 0x55f96f8a5730 2024-06-02T22:41:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.857+0000 7f3afa000640 1 -- 172.21.15.31:0/2674656647 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af40041f0 con 0x55f96f8a5730 2024-06-02T22:41:34.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.857+0000 7f3afa000640 1 -- 172.21.15.31:0/2674656647 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4019720 con 0x55f96f8a5730 2024-06-02T22:41:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 -- 172.21.15.31:0/2674656647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 msgr2=0x55f96f8a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8a7bc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3af4005fd0 tx=0x7f3af4011810 comp rx=0 tx=0).stop 2024-06-02T22:41:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 -- 172.21.15.31:0/2674656647 shutdown_connections 2024-06-02T22:41:34.858 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8a7bc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a05c0 0x55f96f8a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2674656647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f89fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 -- 172.21.15.31:0/2674656647 >> 172.21.15.31:0/2674656647 conn(0x55f96f867f80 msgr2=0x55f96f89b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b05600640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 0x7f3af00a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.858+0000 7f3b129d4740 1 -- 172.21.15.31:0/2674656647 shutdown_connections 2024-06-02T22:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.859+0000 7f3b05600640 1 -- 172.21.15.31:0/727092047 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3afc0cf6a0 con 0x7f3b08103c20 2024-06-02T22:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.859+0000 7f3b129d4740 1 -- 172.21.15.31:0/2674656647 wait complete. 2024-06-02T22:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.860+0000 7f3b07e00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 0x7f3af00a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.860+0000 7f3b129d4740 1 -- start start 2024-06-02T22:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.860+0000 7f3b129d4740 1 Processor -- start 2024-06-02T22:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f96f8a86e0 con 0x55f96f89fbd0 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f96f7be0b0 con 0x55f96f8a05c0 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f96f8a8860 con 0x55f96f8a5730 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b07e00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 0x7f3af00a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3af40099f0 tx=0x7f3af4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b0dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42702/0 (socket says 172.21.15.31:42702) 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b0dc00640 1 -- 172.21.15.31:0/2016589678 learned_addr learned my addr 172.21.15.31:0/2016589678 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b129d4740 10 client.0 _ll_register_callbacks cb 0x55f96f7a9f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b0d200640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.861+0000 7f3b07e00640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 -- 172.21.15.31:0/2016589678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 msgr2=0x55f96f8b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 -- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 msgr2=0x55f96f8b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 -- 172.21.15.31:0/2016589678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96f5e3620 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0d200640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b0dc00640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b00034040 tx=0x7f3b00030ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3194030312541e05 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3aeea00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00036040 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af40041f0 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.862+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3b000305a0 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.863+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3b00003970 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.863+0000 7f3b129d4740 10 client.25537 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.863+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f96f8bd0f0 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.863+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af40041f0 con 0x55f96f8a5730 2024-06-02T22:41:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3b00047470 con 0x55f96f8a5730 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 10 client.25537 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 10 client.25537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 20 client.25537 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8be770 0x55f96f8c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 4 client.25537 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f96f810b50 con 0x55f96f8be770 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.864+0000 7f3b0d200640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8be770 0x55f96f8c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.865+0000 7f3b0d200640 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8be770 0x55f96f8c0b80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=756e7865f98cc02f server_cookie=41217d1ef6b60fb8 in_seq=0 out_seq=0 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.865+0000 7f3aeea00640 10 client.25537 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.866+0000 7f3aeea00640 1 -- 172.21.15.31:0/2016589678 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f96f810b50 con 0x55f96f8be770 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.866+0000 7f3aeea00640 10 client.25537 handle_command_reply: tid=0 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.866+0000 7f3b129d4740 1 client.25537 shutdown 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 msgr2=0x55f96f8b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b00034040 tx=0x7f3b00030ea0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 shutdown_connections 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8be770 0x55f96f8c0b80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b9cf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3aeea00640 0 client.25537 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 --2- 172.21.15.31:0/2016589678 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.867+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 >> 172.21.15.31:0/2016589678 conn(0x55f96f867f80 msgr2=0x55f96f89a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.870+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 shutdown_connections 2024-06-02T22:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.874+0000 7f3b129d4740 1 -- 172.21.15.31:0/2016589678 wait complete. 2024-06-02T22:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.875+0000 7f3b129d4740 20 client.25537 trim_cache size 0 max 16384 2024-06-02T22:41:34.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.921+0000 7f3b129d4740 1 Processor -- start 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 -- start start 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a5730 0x55f96f8b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a8390 con 0x55f96f8a5730 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a9ed0 con 0x55f96f89fbd0 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b129d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a8a60 con 0x55f96f8a05c0 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b07e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b0d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b07e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42716/0 (socket says 172.21.15.31:42716) 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.922+0000 7f3b07e00640 1 -- 172.21.15.31:0/147553110 learned_addr learned my addr 172.21.15.31:0/147553110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.923+0000 7f3b07e00640 1 -- 172.21.15.31:0/147553110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 msgr2=0x55f96f8b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.923+0000 7f3b07e00640 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.923+0000 7f3b07e00640 1 -- 172.21.15.31:0/147553110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a5730 msgr2=0x55f96f8b2c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.923+0000 7f3b07e00640 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a5730 0x55f96f8b2c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.923+0000 7f3b07e00640 1 -- 172.21.15.31:0/147553110 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96f8966a0 con 0x55f96f8a05c0 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.925+0000 7f3b07e00640 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a000 tx=0x7f3af4023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f683aa73a24c2ee2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.925+0000 7f3af9600640 1 -- 172.21.15.31:0/147553110 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af402c050 con 0x55f96f8a05c0 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.926+0000 7f3af9600640 1 -- 172.21.15.31:0/147553110 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af4036070 con 0x55f96f8a05c0 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.926+0000 7f3af9600640 1 -- 172.21.15.31:0/147553110 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af401f040 con 0x55f96f8a05c0 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 -- 172.21.15.31:0/147553110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 msgr2=0x55f96f8b9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a000 tx=0x7f3af4023000 comp rx=0 tx=0).stop 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 -- 172.21.15.31:0/147553110 shutdown_connections 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f8a5730 0x55f96f8b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a05c0 0x55f96f8b9cb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 --2- 172.21.15.31:0/147553110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f89fbd0 0x55f96f8b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 -- 172.21.15.31:0/147553110 >> 172.21.15.31:0/147553110 conn(0x55f96f867f80 msgr2=0x55f96f89b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 -- 172.21.15.31:0/147553110 shutdown_connections 2024-06-02T22:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.927+0000 7f3b129d4740 1 -- 172.21.15.31:0/147553110 wait complete. 2024-06-02T22:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.928+0000 7f3b129d4740 1 -- start start 2024-06-02T22:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.928+0000 7f3b129d4740 1 Processor -- start 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a9800 con 0x55f96f89fbd0 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a9130 con 0x55f96f8a05c0 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b081a6370 con 0x55f96f8a5730 2024-06-02T22:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.930+0000 7f3b129d4740 10 client.0 _ll_register_callbacks cb 0x7f3af4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.931+0000 7f3b0d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.931+0000 7f3b07e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.931+0000 7f3b07e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46646/0 (socket says 172.21.15.31:46646) 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.931+0000 7f3b07e00640 1 -- 172.21.15.31:0/1382882123 learned_addr learned my addr 172.21.15.31:0/1382882123 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.932+0000 7f3b07e00640 1 -- 172.21.15.31:0/1382882123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 msgr2=0x55f96f8b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.932+0000 7f3b07e00640 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.932+0000 7f3b07e00640 1 -- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 msgr2=0x55f96f8b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.932+0000 7f3b07e00640 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.932+0000 7f3b07e00640 1 -- 172.21.15.31:0/1382882123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96f8b89e0 con 0x55f96f8a05c0 2024-06-02T22:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.933+0000 7f3b07e00640 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ba0 tx=0x7f3af4025ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d839555fd8c34e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.933+0000 7f3aeea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.934+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af403e070 con 0x55f96f8a05c0 2024-06-02T22:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.934+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3af4043460 con 0x55f96f8a05c0 2024-06-02T22:41:34.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.934+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3af4036070 con 0x55f96f8a05c0 2024-06-02T22:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.935+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3af402c020 con 0x55f96f8a05c0 2024-06-02T22:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.935+0000 7f3b129d4740 10 client.25529 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.935+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f96f8b9cf0 con 0x55f96f8a05c0 2024-06-02T22:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.935+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3af4036070 con 0x55f96f8a05c0 2024-06-02T22:41:34.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3af4018070 con 0x55f96f8a05c0 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 10 client.25529 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 20 client.25529 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8adf40 0x55f96f8b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 4 client.25529 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:41:34.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.938+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f96f80aea0 con 0x55f96f8adf40 2024-06-02T22:41:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.940+0000 7f3b0d200640 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8adf40 0x55f96f8b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.942+0000 7f3b0d200640 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8adf40 0x55f96f8b0360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb0082d9311ea0ea server_cookie=48e6fa3744cfca46 in_seq=0 out_seq=0 2024-06-02T22:41:34.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:34.943+0000 7f3aeea00640 10 client.25529 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.051+0000 7f3aeea00640 1 -- 172.21.15.31:0/1382882123 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f96f80aea0 con 0x55f96f8adf40 2024-06-02T22:41:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.051+0000 7f3aeea00640 10 client.25529 handle_command_reply: tid=0 2024-06-02T22:41:35.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.051+0000 7f3b129d4740 1 client.25529 shutdown 2024-06-02T22:41:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.051+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 msgr2=0x55f96f8b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:35.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.051+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009ba0 tx=0x7f3af4025ae0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 shutdown_connections 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f96f8adf40 0x55f96f8b0360 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f96f8a5730 0x55f96f8b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f96f8a05c0 0x55f96f8b5420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 --2- 172.21.15.31:0/1382882123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f96f89fbd0 0x55f96f8b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 >> 172.21.15.31:0/1382882123 conn(0x55f96f867f80 msgr2=0x55f96f8a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3aeea00640 0 client.25529 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 shutdown_connections 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 1 -- 172.21.15.31:0/1382882123 wait complete. 2024-06-02T22:41:35.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.052+0000 7f3b129d4740 20 client.25529 trim_cache size 0 max 16384 2024-06-02T22:41:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:41:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:41:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:41:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 msgr2=0x7f3af00a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:35.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 0x7f3af00a5170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3af40099f0 tx=0x7f3af4000bc0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 msgr2=0x7f3b08199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 0x7f3b08199e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e9c0 tx=0x7f3afc00edc0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 shutdown_connections 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3af00a2cb0 0x7f3af00a5170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b081057d0 0x7f3b081a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b08104e10 0x7f3b0819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 --2- 172.21.15.31:0/727092047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b08103c20 0x7f3b08199e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 >> 172.21.15.31:0/727092047 conn(0x7f3b080ff190 msgr2=0x7f3b08108110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 shutdown_connections 2024-06-02T22:41:35.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:35.053+0000 7f3b0fc00640 1 -- 172.21.15.31:0/727092047 wait complete. 2024-06-02T22:41:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 250.0 s, 900.0 tps, lat 110.403 ms stddev 147.879 2024-06-02T22:41:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:35 smithi031 ceph-mon[31767]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-06-02T22:41:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:35 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:41:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:35 smithi098 ceph-mon[36750]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-06-02T22:41:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:35 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:41:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:35 smithi178 ceph-mon[36614]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 573 op/s 2024-06-02T22:41:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:35 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:41:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:37 smithi031 ceph-mon[31767]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.4 MiB/s wr, 741 op/s 2024-06-02T22:41:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:41:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:41:38.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:37 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:41:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:37 smithi098 ceph-mon[36750]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.4 MiB/s wr, 741 op/s 2024-06-02T22:41:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:41:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:41:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:37 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:41:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:37 smithi178 ceph-mon[36614]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.4 MiB/s wr, 741 op/s 2024-06-02T22:41:38.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:41:38.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:41:38.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:37 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:41:40.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:39 smithi031 ceph-mon[31767]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2024-06-02T22:41:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:39 smithi098 ceph-mon[36750]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2024-06-02T22:41:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 255.0 s, 802.6 tps, lat 124.861 ms stddev 147.146 2024-06-02T22:41:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:39 smithi178 ceph-mon[36614]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.8 MiB/s wr, 663 op/s 2024-06-02T22:41:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:41 smithi031 ceph-mon[31767]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 643 op/s 2024-06-02T22:41:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:41 smithi098 ceph-mon[36750]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 643 op/s 2024-06-02T22:41:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:41 smithi178 ceph-mon[36614]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 643 op/s 2024-06-02T22:41:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:43 smithi031 ceph-mon[31767]: pgmap v653: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.6 MiB/s wr, 709 op/s 2024-06-02T22:41:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:43 smithi098 ceph-mon[36750]: pgmap v653: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.6 MiB/s wr, 709 op/s 2024-06-02T22:41:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:43 smithi178 ceph-mon[36614]: pgmap v653: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.6 MiB/s wr, 709 op/s 2024-06-02T22:41:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 260.0 s, 1219.2 tps, lat 83.095 ms stddev 98.756 2024-06-02T22:41:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:45 smithi098 ceph-mon[36750]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 601 op/s 2024-06-02T22:41:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:45 smithi178 ceph-mon[36614]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 601 op/s 2024-06-02T22:41:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:45 smithi031 ceph-mon[31767]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.7 MiB/s wr, 601 op/s 2024-06-02T22:41:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:47 smithi098 ceph-mon[36750]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-06-02T22:41:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.256+0000 7f2066600640 1 -- 172.21.15.31:0/4086690775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 msgr2=0x7f206006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.256+0000 7f2066600640 1 --2- 172.21.15.31:0/4086690775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f206006db20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f204c009900 tx=0x7f204c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 -- 172.21.15.31:0/4086690775 shutdown_connections 2024-06-02T22:41:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 --2- 172.21.15.31:0/4086690775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006e060 0x7f206006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 --2- 172.21.15.31:0/4086690775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f206006db20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 --2- 172.21.15.31:0/4086690775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006f140 0x7f206006f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 -- 172.21.15.31:0/4086690775 >> 172.21.15.31:0/4086690775 conn(0x7f206006c5c0 msgr2=0x7f206006c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.257+0000 7f2066600640 1 -- 172.21.15.31:0/4086690775 shutdown_connections 2024-06-02T22:41:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.258+0000 7f2066600640 1 -- 172.21.15.31:0/4086690775 wait complete. 2024-06-02T22:41:48.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.259+0000 7f2066600640 1 Processor -- start 2024-06-02T22:41:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 -- start start 2024-06-02T22:41:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f20601a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 0x7f20601a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 0x7f20601ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f206011c590 con 0x7f206006e060 2024-06-02T22:41:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f206011c410 con 0x7f206006f140 2024-06-02T22:41:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.260+0000 7f2066600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f206011c710 con 0x7f206006d6c0 2024-06-02T22:41:48.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.261+0000 7f205ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 0x7f20601a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.261+0000 7f205ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 0x7f20601a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45496/0 (socket says 172.21.15.31:45496) 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.261+0000 7f205ea00640 1 -- 172.21.15.31:0/2345930314 learned_addr learned my addr 172.21.15.31:0/2345930314 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.261+0000 7f205f400640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f20601a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.261+0000 7f205fe00640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 0x7f20601ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.262+0000 7f205f400640 1 -- 172.21.15.31:0/2345930314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 msgr2=0x7f20601ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.262+0000 7f205f400640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 0x7f20601ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.262+0000 7f205f400640 1 -- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 msgr2=0x7f20601a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.262+0000 7f205f400640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 0x7f20601a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.262+0000 7f205f400640 1 -- 172.21.15.31:0/2345930314 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20601ae700 con 0x7f206006d6c0 2024-06-02T22:41:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.263+0000 7f205fe00640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 0x7f20601ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:41:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.263+0000 7f205f400640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f20601a6ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2050005fd0 tx=0x7f205000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.263+0000 7f2057e00640 1 -- 172.21.15.31:0/2345930314 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050009c30 con 0x7f206006d6c0 2024-06-02T22:41:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.263+0000 7f2057e00640 1 -- 172.21.15.31:0/2345930314 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2050009dd0 con 0x7f206006d6c0 2024-06-02T22:41:48.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.263+0000 7f2057e00640 1 -- 172.21.15.31:0/2345930314 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050010460 con 0x7f206006d6c0 2024-06-02T22:41:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.264+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20601ae9f0 con 0x7f206006d6c0 2024-06-02T22:41:48.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.264+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20601aeef0 con 0x7f206006d6c0 2024-06-02T22:41:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.271+0000 7f20693fa740 1 Processor -- start 2024-06-02T22:41:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.272+0000 7f20693fa740 1 -- start start 2024-06-02T22:41:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.273+0000 7f2057e00640 1 -- 172.21.15.31:0/2345930314 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f2050003f60 con 0x7f206006d6c0 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c9348190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c93481bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c934777420 con 0x55c9348145c0 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c93471ec50 con 0x55c934813bd0 2024-06-02T22:41:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f20693fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c9347733e0 con 0x55c934819730 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.275+0000 7f205fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56408/0 (socket says 172.21.15.31:56408) 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205fe00640 1 -- 172.21.15.31:0/2624509510 learned_addr learned my addr 172.21.15.31:0/2624509510 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205f400640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c9348190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205ea00640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c93481bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f2057e00640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 0x7f20440a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205ea00640 1 -- 172.21.15.31:0/2624509510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 msgr2=0x55c934813ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.276+0000 7f205ea00640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205ea00640 1 -- 172.21.15.31:0/2624509510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 msgr2=0x55c9348190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205ea00640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c9348190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205ea00640 1 -- 172.21.15.31:0/2624509510 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c93448b210 con 0x55c934819730 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205fe00640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f2057e00640 1 -- 172.21.15.31:0/2345930314 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f20500cedd0 con 0x7f206006d6c0 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205ea00640 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c93481bbc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f204c006010 tx=0x7f204c0043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16e3bb1326d62f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f205fe00640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 0x7f20440a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f2054c00640 1 -- 172.21.15.31:0/2624509510 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c035040 con 0x55c934819730 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.277+0000 7f2054c00640 1 -- 172.21.15.31:0/2624509510 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204c0046e0 con 0x55c934819730 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.278+0000 7f2054c00640 1 -- 172.21.15.31:0/2624509510 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0319f0 con 0x55c934819730 2024-06-02T22:41:48.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.279+0000 7f20693fa740 1 -- 172.21.15.31:0/2624509510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 msgr2=0x55c93481bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.279+0000 7f20693fa740 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c93481bbc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f204c006010 tx=0x7f204c0043b0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.279+0000 7f205fe00640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 0x7f20440a51c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2058007fd0 tx=0x7f2058004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.280+0000 7f20693fa740 1 -- 172.21.15.31:0/2624509510 shutdown_connections 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.280+0000 7f20693fa740 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c93481bbc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.280+0000 7f20693fa740 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c9348190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.280+0000 7f20693fa740 1 --2- 172.21.15.31:0/2624509510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934813ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.280+0000 7f20693fa740 1 -- 172.21.15.31:0/2624509510 >> 172.21.15.31:0/2624509510 conn(0x55c9347dbf80 msgr2=0x55c93480f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.281+0000 7f20693fa740 1 -- 172.21.15.31:0/2624509510 shutdown_connections 2024-06-02T22:41:48.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.281+0000 7f20693fa740 1 -- 172.21.15.31:0/2624509510 wait complete. 2024-06-02T22:41:48.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.283+0000 7f20693fa740 1 -- start start 2024-06-02T22:41:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 Processor -- start 2024-06-02T22:41:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93481dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c93481e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c93481c680 con 0x55c934813bd0 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c9347320b0 con 0x55c934819730 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c93481c800 con 0x55c9348145c0 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.284+0000 7f20693fa740 10 client.0 _ll_register_callbacks cb 0x55c93471df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:48.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.285+0000 7f205fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.285+0000 7f205fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56414/0 (socket says 172.21.15.31:56414) 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.285+0000 7f205fe00640 1 -- 172.21.15.31:0/4030812929 learned_addr learned my addr 172.21.15.31:0/4030812929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.285+0000 7f205ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c93481e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 -- 172.21.15.31:0/4030812929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 msgr2=0x55c93481e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c93481e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 -- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 msgr2=0x55c93481dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93481dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 -- 172.21.15.31:0/4030812929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c934557620 con 0x55c934819730 2024-06-02T22:41:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205ea00640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c93481e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:41:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f205fe00640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2058010da0 tx=0x7f2058004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ae6157583a4ac5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f2049600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:41:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.286+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058019070 con 0x55c934819730 2024-06-02T22:41:48.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.287+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2058013170 con 0x55c934819730 2024-06-02T22:41:48.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.288+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c0046e0 con 0x55c934819730 2024-06-02T22:41:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.288+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f205800dcd0 con 0x55c934819730 2024-06-02T22:41:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.289+0000 7f20693fa740 10 client.25538 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.289+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c934828840 con 0x55c934819730 2024-06-02T22:41:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.289+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f204c0046e0 con 0x55c934819730 2024-06-02T22:41:48.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.289+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2058032420 con 0x55c934819730 2024-06-02T22:41:48.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 10 client.25538 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 20 client.25538 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934829f20 0x55c93482c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 4 client.25538 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.290+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c934784b50 con 0x55c934829f20 2024-06-02T22:41:48.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.291+0000 7f205f400640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934829f20 0x55c93482c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.292+0000 7f205f400640 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934829f20 0x55c93482c3b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6930d2a463e8c532 server_cookie=5e39bc30c7fee06a in_seq=0 out_seq=0 2024-06-02T22:41:48.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.292+0000 7f2049600640 10 client.25538 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.294+0000 7f2049600640 1 -- 172.21.15.31:0/4030812929 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c934784b50 con 0x55c934829f20 2024-06-02T22:41:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.294+0000 7f2049600640 10 client.25538 handle_command_reply: tid=0 2024-06-02T22:41:48.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.294+0000 7f20693fa740 1 client.25538 shutdown 2024-06-02T22:41:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.294+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 msgr2=0x55c934825460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.294+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2058010da0 tx=0x7f2058004a40 comp rx=0 tx=0).stop 2024-06-02T22:41:48.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 shutdown_connections 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934829f20 0x55c93482c3b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c934825460 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c93481e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 --2- 172.21.15.31:0/4030812929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93481dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 >> 172.21.15.31:0/4030812929 conn(0x55c9347dbf80 msgr2=0x55c93480e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.295+0000 7f2049600640 0 client.25538 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.296+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 shutdown_connections 2024-06-02T22:41:48.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.296+0000 7f20693fa740 1 -- 172.21.15.31:0/4030812929 wait complete. 2024-06-02T22:41:48.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.296+0000 7f20693fa740 20 client.25538 trim_cache size 0 max 16384 2024-06-02T22:41:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:47 smithi178 ceph-mon[36614]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-06-02T22:41:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.329+0000 7f20693fa740 1 Processor -- start 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.330+0000 7f20693fa740 1 -- start start 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93482bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c934825420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c93481dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20601b93a0 con 0x55c934813bd0 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20601baee0 con 0x55c934819730 2024-06-02T22:41:48.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f20693fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f20601b9a70 con 0x55c9348145c0 2024-06-02T22:41:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f205ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c934825420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f205ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c934825420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58982/0 (socket says 172.21.15.31:58982) 2024-06-02T22:41:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.331+0000 7f205ea00640 1 -- 172.21.15.31:0/1365183996 learned_addr learned my addr 172.21.15.31:0/1365183996 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:48.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.332+0000 7f205fe00640 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c93481dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205f400640 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93482bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205fe00640 1 -- 172.21.15.31:0/1365183996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 msgr2=0x55c934825420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205fe00640 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c934825420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205fe00640 1 -- 172.21.15.31:0/1365183996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 msgr2=0x55c93482bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205fe00640 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93482bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.333+0000 7f205fe00640 1 -- 172.21.15.31:0/1365183996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c934810300 con 0x55c934819730 2024-06-02T22:41:48.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.335+0000 7f205fe00640 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c93481dee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2058032910 tx=0x7f205800f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6f7f329a52a116 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.336+0000 7f204be00640 1 -- 172.21.15.31:0/1365183996 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058019040 con 0x55c934819730 2024-06-02T22:41:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.336+0000 7f204be00640 1 -- 172.21.15.31:0/1365183996 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2058013170 con 0x55c934819730 2024-06-02T22:41:48.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.336+0000 7f204be00640 1 -- 172.21.15.31:0/1365183996 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058019040 con 0x55c934819730 2024-06-02T22:41:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.337+0000 7f20693fa740 1 -- 172.21.15.31:0/1365183996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 msgr2=0x55c93481dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.337+0000 7f20693fa740 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c93481dee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2058032910 tx=0x7f205800f640 comp rx=0 tx=0).stop 2024-06-02T22:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.340+0000 7f20693fa740 1 -- 172.21.15.31:0/1365183996 shutdown_connections 2024-06-02T22:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.340+0000 7f20693fa740 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934819730 0x55c93481dee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.340+0000 7f20693fa740 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9348145c0 0x55c934825420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.340+0000 7f20693fa740 1 --2- 172.21.15.31:0/1365183996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c934813bd0 0x55c93482bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.340+0000 7f20693fa740 1 -- 172.21.15.31:0/1365183996 >> 172.21.15.31:0/1365183996 conn(0x55c9347dbf80 msgr2=0x55c93480f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.341+0000 7f20693fa740 1 -- 172.21.15.31:0/1365183996 shutdown_connections 2024-06-02T22:41:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.341+0000 7f20693fa740 1 -- 172.21.15.31:0/1365183996 wait complete. 2024-06-02T22:41:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.341+0000 7f20693fa740 1 -- start start 2024-06-02T22:41:48.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.342+0000 7f20693fa740 1 Processor -- start 2024-06-02T22:41:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934825240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c934821dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c934822300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f205f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934825240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20601ba810 con 0x55c9348145c0 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20601ba140 con 0x55c934813bd0 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f20601b7380 con 0x55c934819730 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f20693fa740 10 client.0 _ll_register_callbacks cb 0x7f205800f900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:41:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f205fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c934822300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f205fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c934822300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58996/0 (socket says 172.21.15.31:58996) 2024-06-02T22:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.343+0000 7f205fe00640 1 -- 172.21.15.31:0/3525893939 learned_addr learned my addr 172.21.15.31:0/3525893939 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205ea00640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c934821dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205f400640 1 -- 172.21.15.31:0/3525893939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 msgr2=0x55c934822300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205f400640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c934822300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205f400640 1 -- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 msgr2=0x55c934821dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205f400640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c934821dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.344+0000 7f205f400640 1 -- 172.21.15.31:0/3525893939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c934892c80 con 0x55c934813bd0 2024-06-02T22:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.345+0000 7f205f400640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934825240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20500cc590 tx=0x7f20500d28b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6a4e7c48e47446d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.345+0000 7f2049600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.347+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20500af070 con 0x55c934813bd0 2024-06-02T22:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.347+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f20500035f0 con 0x55c934813bd0 2024-06-02T22:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.347+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2058013170 con 0x55c934813bd0 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.348+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f205009ade0 con 0x55c934813bd0 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.348+0000 7f20693fa740 10 client.25544 fetch_fsmap learned FSMap version 30 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.348+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c934893eb0 con 0x55c934813bd0 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.348+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2058013170 con 0x55c934813bd0 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.348+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2050097910 con 0x55c934813bd0 2024-06-02T22:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 10 client.25544 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:41:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:41:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 20 client.25544 populate_metadata read hostname 'smithi031' 2024-06-02T22:41:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934894760 0x55c934896b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:41:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 4 client.25544 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:41:48.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.349+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c93477eea0 con 0x55c934894760 2024-06-02T22:41:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.354+0000 7f205ea00640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934894760 0x55c934896b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:41:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.355+0000 7f205ea00640 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934894760 0x55c934896b80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7358331479a3fffc server_cookie=590a4e2782fa2fd9 in_seq=0 out_seq=0 2024-06-02T22:41:48.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.355+0000 7f2049600640 10 client.25544 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:48.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:47 smithi031 ceph-mon[31767]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-06-02T22:41:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.392+0000 7f2049600640 1 -- 172.21.15.31:0/3525893939 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c93477eea0 con 0x55c934894760 2024-06-02T22:41:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.392+0000 7f2049600640 10 client.25544 handle_command_reply: tid=0 2024-06-02T22:41:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.392+0000 7f20693fa740 1 client.25544 shutdown 2024-06-02T22:41:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 msgr2=0x55c934825240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934825240 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20500cc590 tx=0x7f20500d28b0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 shutdown_connections 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c934894760 0x55c934896b80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c934819730 0x55c934822300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c9348145c0 0x55c934821dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 --2- 172.21.15.31:0/3525893939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c934813bd0 0x55c934825240 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.393+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 >> 172.21.15.31:0/3525893939 conn(0x55c9347dbf80 msgr2=0x55c93481d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.394+0000 7f2049600640 0 client.25544 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:41:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.394+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 shutdown_connections 2024-06-02T22:41:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.394+0000 7f20693fa740 1 -- 172.21.15.31:0/3525893939 wait complete. 2024-06-02T22:41:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.394+0000 7f20693fa740 20 client.25544 trim_cache size 0 max 16384 2024-06-02T22:41:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:41:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:41:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.395+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 msgr2=0x7f20440a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.395+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 0x7f20440a51c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2058007fd0 tx=0x7f2058004ab0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.395+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 msgr2=0x7f20601a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.395+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f20601a6ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2050005fd0 tx=0x7f205000dde0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 shutdown_connections 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f20440a2d00 0x7f20440a51c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206006f140 0x7f20601ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f206006e060 0x7f20601a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 --2- 172.21.15.31:0/2345930314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206006d6c0 0x7f20601a6ae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:41:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 >> 172.21.15.31:0/2345930314 conn(0x7f206006c5c0 msgr2=0x7f206010a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:41:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 shutdown_connections 2024-06-02T22:41:48.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:41:48.396+0000 7f2066600640 1 -- 172.21.15.31:0/2345930314 wait complete. 2024-06-02T22:41:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:49 smithi098 ceph-mon[36750]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-06-02T22:41:50.225 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 265.0 s, 1089.6 tps, lat 91.875 ms stddev 116.414 2024-06-02T22:41:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:49 smithi178 ceph-mon[36614]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-06-02T22:41:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:49 smithi031 ceph-mon[31767]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 649 op/s 2024-06-02T22:41:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:51 smithi098 ceph-mon[36750]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 612 op/s 2024-06-02T22:41:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:51 smithi178 ceph-mon[36614]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 612 op/s 2024-06-02T22:41:52.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:51 smithi031 ceph-mon[31767]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 612 op/s 2024-06-02T22:41:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:53 smithi098 ceph-mon[36750]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-06-02T22:41:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:53 smithi178 ceph-mon[36614]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-06-02T22:41:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:53 smithi031 ceph-mon[31767]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-06-02T22:41:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 270.0 s, 1236.6 tps, lat 80.930 ms stddev 104.723 2024-06-02T22:41:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:55 smithi098 ceph-mon[36750]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 561 op/s 2024-06-02T22:41:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:55 smithi178 ceph-mon[36614]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 561 op/s 2024-06-02T22:41:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:55 smithi031 ceph-mon[31767]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 561 op/s 2024-06-02T22:41:58.173 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:57 smithi031 ceph-mon[31767]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 694 op/s 2024-06-02T22:41:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:57 smithi098 ceph-mon[36750]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 694 op/s 2024-06-02T22:41:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:57 smithi178 ceph-mon[36614]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 694 op/s 2024-06-02T22:42:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:41:59 smithi098 ceph-mon[36750]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-06-02T22:42:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 275.0 s, 831.0 tps, lat 117.946 ms stddev 122.726 2024-06-02T22:42:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:41:59 smithi178 ceph-mon[36614]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-06-02T22:42:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:41:59 smithi031 ceph-mon[31767]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 599 op/s 2024-06-02T22:42:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 -- 172.21.15.31:0/212028948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678094c80 msgr2=0x7f46780950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 --2- 172.21.15.31:0/212028948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678094c80 0x7f46780950a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f466c009900 tx=0x7f466c02a410 comp rx=0 tx=0).stop 2024-06-02T22:42:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 -- 172.21.15.31:0/212028948 shutdown_connections 2024-06-02T22:42:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 --2- 172.21.15.31:0/212028948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678096830 0x7f467809d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 --2- 172.21.15.31:0/212028948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f46780962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 --2- 172.21.15.31:0/212028948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678094c80 0x7f46780950a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.600+0000 7f4685800640 1 -- 172.21.15.31:0/212028948 >> 172.21.15.31:0/212028948 conn(0x7f46780901d0 msgr2=0x7f4678092630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.601+0000 7f4685800640 1 -- 172.21.15.31:0/212028948 shutdown_connections 2024-06-02T22:42:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.601+0000 7f4685800640 1 -- 172.21.15.31:0/212028948 wait complete. 2024-06-02T22:42:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.602+0000 7f4685800640 1 Processor -- start 2024-06-02T22:42:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.602+0000 7f4685800640 1 -- start start 2024-06-02T22:42:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 0x7f4678132790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678096830 0x7f4678139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46780a1a60 con 0x7f4678094c80 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46780a18e0 con 0x7f4678095e70 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f4685800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f46780a1be0 con 0x7f4678096830 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f467e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f467e000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34530/0 (socket says 172.21.15.31:34530) 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f467e000640 1 -- 172.21.15.31:0/3748099336 learned_addr learned my addr 172.21.15.31:0/3748099336 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.603+0000 7f467fe00640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678096830 0x7f4678139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467ea00640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 0x7f4678132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 -- 172.21.15.31:0/3748099336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678096830 msgr2=0x7f4678139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678096830 0x7f4678139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 -- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 msgr2=0x7f4678132790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 0x7f4678132790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 -- 172.21.15.31:0/3748099336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467813a3b0 con 0x7f4678095e70 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467ea00640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 0x7f4678132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.604+0000 7f467e000640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f467000e9f0 tx=0x7f467000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.605+0000 7f4677400640 1 -- 172.21.15.31:0/3748099336 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467000cd80 con 0x7f4678095e70 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.605+0000 7f4677400640 1 -- 172.21.15.31:0/3748099336 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4670005500 con 0x7f4678095e70 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.605+0000 7f4677400640 1 -- 172.21.15.31:0/3748099336 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670010690 con 0x7f4678095e70 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.605+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467813a6a0 con 0x7f4678095e70 2024-06-02T22:42:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.605+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467813aba0 con 0x7f4678095e70 2024-06-02T22:42:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.609+0000 7f4677400640 1 -- 172.21.15.31:0/3748099336 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f46700046c0 con 0x7f4678095e70 2024-06-02T22:42:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.609+0000 7f4688764740 1 Processor -- start 2024-06-02T22:42:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.610+0000 7f4688764740 1 -- start start 2024-06-02T22:42:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.612+0000 7f4688764740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.612+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.612+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34536/0 (socket says 172.21.15.31:34536) 2024-06-02T22:42:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.612+0000 7f4677400640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 0x7f46640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.613+0000 7f4677400640 1 -- 172.21.15.31:0/3748099336 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f46700cf880 con 0x7f4678095e70 2024-06-02T22:42:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f4688764740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f4688764740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f467fe00640 1 -- 172.21.15.31:0/4017450817 learned_addr learned my addr 172.21.15.31:0/4017450817 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561f6f414420 con 0x561f6f4b68f0 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561f6f3bbc50 con 0x561f6f4b0d90 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.614+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561f6f4103e0 con 0x561f6f4b1780 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467ea00640 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467e000640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 0x7f46640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467fe00640 1 -- 172.21.15.31:0/4017450817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 msgr2=0x561f6f4b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467fe00640 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467fe00640 1 -- 172.21.15.31:0/4017450817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 msgr2=0x561f6f4b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467fe00640 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.615+0000 7f467fe00640 1 -- 172.21.15.31:0/4017450817 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6f128210 con 0x561f6f4b0d90 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.616+0000 7f467fe00640 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f468002d870 tx=0x7f46800807c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2940a8c0830bf6c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.616+0000 7f467e000640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 0x7f46640a50d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f467000c6a0 tx=0x7f46700056b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.616+0000 7f466be00640 1 -- 172.21.15.31:0/4017450817 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800800d0 con 0x561f6f4b0d90 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.617+0000 7f466be00640 1 -- 172.21.15.31:0/4017450817 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f468007e910 con 0x561f6f4b0d90 2024-06-02T22:42:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.617+0000 7f466be00640 1 -- 172.21.15.31:0/4017450817 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468007d880 con 0x561f6f4b0d90 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.617+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 msgr2=0x561f6f4b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.617+0000 7f4688764740 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f468002d870 tx=0x7f46800807c0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 shutdown_connections 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 --2- 172.21.15.31:0/4017450817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4b11b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 >> 172.21.15.31:0/4017450817 conn(0x561f6f478f80 msgr2=0x561f6f4ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 shutdown_connections 2024-06-02T22:42:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.618+0000 7f4688764740 1 -- 172.21.15.31:0/4017450817 wait complete. 2024-06-02T22:42:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.619+0000 7f4688764740 1 -- start start 2024-06-02T22:42:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.619+0000 7f4688764740 1 Processor -- start 2024-06-02T22:42:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4bb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561f6f4b98a0 con 0x561f6f4b1780 2024-06-02T22:42:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561f6f3cf0b0 con 0x561f6f4b0d90 2024-06-02T22:42:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561f6f4b9a20 con 0x561f6f4b68f0 2024-06-02T22:42:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f4688764740 10 client.0 _ll_register_callbacks cb 0x561f6f3baf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34546/0 (socket says 172.21.15.31:34546) 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f467fe00640 1 -- 172.21.15.31:0/1964347544 learned_addr learned my addr 172.21.15.31:0/1964347544 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.620+0000 7f467fe00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467ea00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4bb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467fe00640 1 -- 172.21.15.31:0/1964347544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 msgr2=0x561f6f4c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467fe00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467fe00640 1 -- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 msgr2=0x561f6f4bb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467fe00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4bb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.621+0000 7f467fe00640 1 -- 172.21.15.31:0/1964347544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6f1f4620 con 0x561f6f4b0d90 2024-06-02T22:42:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.622+0000 7f467fe00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4680064b10 tx=0x7f4680073f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8a1fc32e310799 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.623+0000 7f4668c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:42:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.623+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468007eb80 con 0x561f6f4b0d90 2024-06-02T22:42:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.623+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f468007ed20 con 0x561f6f4b0d90 2024-06-02T22:42:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.623+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f468007e910 con 0x561f6f4b0d90 2024-06-02T22:42:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.624+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f468007e430 con 0x561f6f4b0d90 2024-06-02T22:42:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.624+0000 7f4688764740 10 client.25556 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.624+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561f6f4c5820 con 0x561f6f4b0d90 2024-06-02T22:42:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.625+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f468007e910 con 0x561f6f4b0d90 2024-06-02T22:42:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f468008a680 con 0x561f6f4b0d90 2024-06-02T22:42:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 10 client.25556 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 10 client.25556 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 20 client.25556 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f4c6d10 0x561f6f4c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 4 client.25556 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:42:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.628+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f6f421b50 con 0x561f6f4c6d10 2024-06-02T22:42:01.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.630+0000 7f467ea00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f4c6d10 0x561f6f4c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.631+0000 7f467ea00640 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f4c6d10 0x561f6f4c9150 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd85e546ed1d759 server_cookie=993222c0f0493779 in_seq=0 out_seq=0 2024-06-02T22:42:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.632+0000 7f4668c00640 10 client.25556 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.633+0000 7f4668c00640 1 -- 172.21.15.31:0/1964347544 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561f6f421b50 con 0x561f6f4c6d10 2024-06-02T22:42:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.633+0000 7f4668c00640 10 client.25556 handle_command_reply: tid=0 2024-06-02T22:42:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.633+0000 7f4688764740 1 client.25556 shutdown 2024-06-02T22:42:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.636+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 msgr2=0x561f6f4bafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.636+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4680064b10 tx=0x7f4680073f90 comp rx=0 tx=0).stop 2024-06-02T22:42:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 shutdown_connections 2024-06-02T22:42:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f4c6d10 0x561f6f4c9150 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4bb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 --2- 172.21.15.31:0/1964347544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bafa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 >> 172.21.15.31:0/1964347544 conn(0x561f6f478f80 msgr2=0x561f6f4ab970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.637+0000 7f4668c00640 0 client.25556 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.639+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 shutdown_connections 2024-06-02T22:42:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.639+0000 7f4688764740 1 -- 172.21.15.31:0/1964347544 wait complete. 2024-06-02T22:42:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.639+0000 7f4688764740 20 client.25556 trim_cache size 0 max 16384 2024-06-02T22:42:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 Processor -- start 2024-06-02T22:42:01.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 -- start start 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4678145150 con 0x561f6f4b1780 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4678146c90 con 0x561f6f4b0d90 2024-06-02T22:42:01.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.674+0000 7f4688764740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4678145820 con 0x561f6f4b68f0 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34562/0 (socket says 172.21.15.31:34562) 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 -- 172.21.15.31:0/2954790541 learned_addr learned my addr 172.21.15.31:0/2954790541 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 -- 172.21.15.31:0/2954790541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 msgr2=0x561f6f4cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 -- 172.21.15.31:0/2954790541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 msgr2=0x561f6f4c2470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4c2470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.675+0000 7f467fe00640 1 -- 172.21.15.31:0/2954790541 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6f4a7fd0 con 0x561f6f4b0d90 2024-06-02T22:42:01.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.676+0000 7f467fe00640 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f468004fa30 tx=0x7f46800807c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36d72e23f6f9027 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.678+0000 7f466b400640 1 -- 172.21.15.31:0/2954790541 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800a1040 con 0x561f6f4b0d90 2024-06-02T22:42:01.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.678+0000 7f466b400640 1 -- 172.21.15.31:0/2954790541 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4680084050 con 0x561f6f4b0d90 2024-06-02T22:42:01.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.679+0000 7f4688764740 1 -- 172.21.15.31:0/2954790541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 msgr2=0x561f6f4bb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.679+0000 7f4688764740 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f468004fa30 tx=0x7f46800807c0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.678+0000 7f466b400640 1 -- 172.21.15.31:0/2954790541 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468007e8d0 con 0x561f6f4b0d90 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.679+0000 7f4688764740 1 -- 172.21.15.31:0/2954790541 shutdown_connections 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.679+0000 7f4688764740 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b68f0 0x561f6f4cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.679+0000 7f4688764740 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b1780 0x561f6f4c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.680+0000 7f4688764740 1 --2- 172.21.15.31:0/2954790541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4bb2c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.680+0000 7f4688764740 1 -- 172.21.15.31:0/2954790541 >> 172.21.15.31:0/2954790541 conn(0x561f6f478f80 msgr2=0x561f6f4babb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.680+0000 7f4688764740 1 -- 172.21.15.31:0/2954790541 shutdown_connections 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.680+0000 7f4688764740 1 -- 172.21.15.31:0/2954790541 wait complete. 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.680+0000 7f4688764740 1 -- start start 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.681+0000 7f4688764740 1 Processor -- start 2024-06-02T22:42:01.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f4688764740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f4688764740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f4688764740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f4688764740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46781465c0 con 0x561f6f4b68f0 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f4688764740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4678145ef0 con 0x561f6f4b0d90 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f467fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:34578/0 (socket says 172.21.15.31:34578) 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f467fe00640 1 -- 172.21.15.31:0/3139415548 learned_addr learned my addr 172.21.15.31:0/3139415548 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.682+0000 7f467ea00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4678143130 con 0x561f6f4b1780 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f4688764740 10 client.0 _ll_register_callbacks cb 0x7f468007d770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467fe00640 1 -- 172.21.15.31:0/3139415548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 msgr2=0x561f6f4bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467fe00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467fe00640 1 -- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 msgr2=0x561f6f4bf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:01.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467fe00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467fe00640 1 -- 172.21.15.31:0/3139415548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6f4bf8b0 con 0x561f6f4b0d90 2024-06-02T22:42:01.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.683+0000 7f467ea00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:42:01.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.684+0000 7f467fe00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f468008d040 tx=0x7f468007e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8651428e6c3b1d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4668c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800a1070 con 0x561f6f4b0d90 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f468007e650 con 0x561f6f4b0d90 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4680084050 con 0x561f6f4b0d90 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f468007e850 con 0x561f6f4b0d90 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4688764740 10 client.25562 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.685+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561f6f530a80 con 0x561f6f4b0d90 2024-06-02T22:42:01.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4680084050 con 0x561f6f4b0d90 2024-06-02T22:42:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f46800b7070 con 0x561f6f4b0d90 2024-06-02T22:42:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 10 client.25562 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 10 client.25562 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 20 client.25562 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:01.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f531270 0x561f6f533690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 4 client.25562 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:42:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.686+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f6f41bea0 con 0x561f6f531270 2024-06-02T22:42:01.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.688+0000 7f467ea00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f531270 0x561f6f533690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.690+0000 7f467ea00640 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f531270 0x561f6f533690 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb02128ebe503b6 server_cookie=9146d3113c7ee21 in_seq=0 out_seq=0 2024-06-02T22:42:01.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.690+0000 7f4668c00640 10 client.25562 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.735+0000 7f4668c00640 1 -- 172.21.15.31:0/3139415548 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561f6f41bea0 con 0x561f6f531270 2024-06-02T22:42:01.734 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.735+0000 7f4668c00640 10 client.25562 handle_command_reply: tid=0 2024-06-02T22:42:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.735+0000 7f4688764740 1 client.25562 shutdown 2024-06-02T22:42:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 msgr2=0x561f6f4c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f468008d040 tx=0x7f468007e5d0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.735 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 shutdown_connections 2024-06-02T22:42:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561f6f531270 0x561f6f533690 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561f6f4b68f0 0x561f6f4bf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561f6f4b1780 0x561f6f4bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 --2- 172.21.15.31:0/3139415548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561f6f4b0d90 0x561f6f4c2250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.736+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 >> 172.21.15.31:0/3139415548 conn(0x561f6f478f80 msgr2=0x561f6f4af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.738+0000 7f4668c00640 0 client.25562 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.738+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 shutdown_connections 2024-06-02T22:42:01.737 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.738+0000 7f4688764740 1 -- 172.21.15.31:0/3139415548 wait complete. 2024-06-02T22:42:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.738+0000 7f4688764740 20 client.25562 trim_cache size 0 max 16384 2024-06-02T22:42:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:42:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:42:01.738 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:42:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.739+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 msgr2=0x7f46640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.739+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 0x7f46640a50d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f467000c6a0 tx=0x7f46700056b0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.739+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 msgr2=0x7f4678132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.739+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f467000e9f0 tx=0x7f467000edf0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 shutdown_connections 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f46640a2c10 0x7f46640a50d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678096830 0x7f4678139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4678095e70 0x7f4678132cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 --2- 172.21.15.31:0/3748099336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4678094c80 0x7f4678132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 >> 172.21.15.31:0/3748099336 conn(0x7f46780901d0 msgr2=0x7f467809d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 shutdown_connections 2024-06-02T22:42:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:01.740+0000 7f4685800640 1 -- 172.21.15.31:0/3748099336 wait complete. 2024-06-02T22:42:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:01 smithi098 ceph-mon[36750]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-06-02T22:42:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:01 smithi178 ceph-mon[36614]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-06-02T22:42:02.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:01 smithi031 ceph-mon[31767]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 546 op/s 2024-06-02T22:42:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:03 smithi098 ceph-mon[36750]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-06-02T22:42:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:03 smithi178 ceph-mon[36614]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-06-02T22:42:04.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:03 smithi031 ceph-mon[31767]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-06-02T22:42:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 280.0 s, 766.2 tps, lat 132.187 ms stddev 155.256 2024-06-02T22:42:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:05 smithi098 ceph-mon[36750]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 514 op/s 2024-06-02T22:42:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:05 smithi178 ceph-mon[36614]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 514 op/s 2024-06-02T22:42:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:05 smithi031 ceph-mon[31767]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 MiB/s wr, 514 op/s 2024-06-02T22:42:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:07 smithi098 ceph-mon[36750]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 641 op/s 2024-06-02T22:42:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:07 smithi178 ceph-mon[36614]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 641 op/s 2024-06-02T22:42:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:07 smithi031 ceph-mon[31767]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 641 op/s 2024-06-02T22:42:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:09 smithi098 ceph-mon[36750]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-06-02T22:42:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 285.0 s, 766.6 tps, lat 129.945 ms stddev 140.406 2024-06-02T22:42:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:09 smithi178 ceph-mon[36614]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-06-02T22:42:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:09 smithi031 ceph-mon[31767]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-06-02T22:42:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:11 smithi178 ceph-mon[36614]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:42:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:11 smithi031 ceph-mon[31767]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:42:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:11 smithi098 ceph-mon[36750]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:42:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:13 smithi178 ceph-mon[36614]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T22:42:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:13 smithi031 ceph-mon[31767]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T22:42:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:13 smithi098 ceph-mon[36750]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-06-02T22:42:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 -- 172.21.15.31:0/752031504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 msgr2=0x7f680c09b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 --2- 172.21.15.31:0/752031504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c09b460 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6800009900 tx=0x7f680002a3f0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 -- 172.21.15.31:0/752031504 shutdown_connections 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 --2- 172.21.15.31:0/752031504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c09deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 --2- 172.21.15.31:0/752031504 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c09b460 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 --2- 172.21.15.31:0/752031504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c093f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 -- 172.21.15.31:0/752031504 >> 172.21.15.31:0/752031504 conn(0x7f680c08f510 msgr2=0x7f680c091970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.936+0000 7f6817200640 1 -- 172.21.15.31:0/752031504 shutdown_connections 2024-06-02T22:42:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.937+0000 7f6817200640 1 -- 172.21.15.31:0/752031504 wait complete. 2024-06-02T22:42:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.941+0000 7f6817200640 1 Processor -- start 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 -- start start 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0a1ae0 con 0x7f680c093b00 2024-06-02T22:42:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0a1960 con 0x7f680c094460 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.943+0000 7f6817200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0a1c60 con 0x7f680c09b9f0 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6815400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6815400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43168/0 (socket says 172.21.15.31:43168) 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6815400640 1 -- 172.21.15.31:0/2792225777 learned_addr learned my addr 172.21.15.31:0/2792225777 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6815e00640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 -- 172.21.15.31:0/2792225777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 msgr2=0x7f680c132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 -- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 msgr2=0x7f680c132670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c132670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6816800640 1 -- 172.21.15.31:0/2792225777 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c14b2a0 con 0x7f680c09b9f0 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.944+0000 7f6815e00640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f6815400640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f6816800640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c139c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f680400b410 tx=0x7f680400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f680aa00640 1 -- 172.21.15.31:0/2792225777 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804015020 con 0x7f680c09b9f0 2024-06-02T22:42:14.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c14b590 con 0x7f680c09b9f0 2024-06-02T22:42:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f680aa00640 1 -- 172.21.15.31:0/2792225777 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6804011d10 con 0x7f680c09b9f0 2024-06-02T22:42:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f680aa00640 1 -- 172.21.15.31:0/2792225777 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680400f2e0 con 0x7f680c09b9f0 2024-06-02T22:42:14.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.945+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c14bb80 con 0x7f680c09b9f0 2024-06-02T22:42:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.954+0000 7f681b66e740 1 Processor -- start 2024-06-02T22:42:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.954+0000 7f680aa00640 1 -- 172.21.15.31:0/2792225777 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6804018020 con 0x7f680c09b9f0 2024-06-02T22:42:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.954+0000 7f681b66e740 1 -- start start 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.956+0000 7f680aa00640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 0x7f67f80a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.957+0000 7f680aa00640 1 -- 172.21.15.31:0/2792225777 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f68040cebe0 con 0x7f680c09b9f0 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d3621d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 0x561d3621fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561d3617b420 con 0x561d362187a0 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d36122c50 con 0x561d3621d910 2024-06-02T22:42:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.958+0000 7f681b66e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d361773e0 con 0x561d36217db0 2024-06-02T22:42:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.959+0000 7f6816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 0x561d3621fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.959+0000 7f6816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 0x561d3621fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43170/0 (socket says 172.21.15.31:43170) 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.959+0000 7f6816800640 1 -- 172.21.15.31:0/3228534942 learned_addr learned my addr 172.21.15.31:0/3228534942 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.959+0000 7f6815e00640 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.959+0000 7f6815400640 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d3621d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.960+0000 7f6815400640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 0x7f67f80a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.960+0000 7f6815400640 1 -- 172.21.15.31:0/3228534942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 msgr2=0x561d362181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.961+0000 7f6815400640 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362181d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.961+0000 7f6815400640 1 -- 172.21.15.31:0/3228534942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 msgr2=0x561d3621fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.961+0000 7f6815400640 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 0x561d3621fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.961+0000 7f6815400640 1 -- 172.21.15.31:0/3228534942 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d35e8f210 con 0x561d362187a0 2024-06-02T22:42:14.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.962+0000 7f6815400640 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d3621d2a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6800031610 tx=0x7f6800032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fef321881dc9f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:14.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.963+0000 7f6815400640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 0x7f67f80a50a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6800045000 tx=0x7f6800047000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.963+0000 7f67ff000640 1 -- 172.21.15.31:0/3228534942 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680004c070 con 0x561d362187a0 2024-06-02T22:42:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.963+0000 7f67ff000640 1 -- 172.21.15.31:0/3228534942 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680003d930 con 0x561d362187a0 2024-06-02T22:42:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.963+0000 7f67ff000640 1 -- 172.21.15.31:0/3228534942 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680004c070 con 0x561d362187a0 2024-06-02T22:42:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.964+0000 7f681b66e740 1 -- 172.21.15.31:0/3228534942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 msgr2=0x561d3621d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.964+0000 7f681b66e740 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d3621d2a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6800031610 tx=0x7f6800032d40 comp rx=0 tx=0).stop 2024-06-02T22:42:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.965+0000 7f681b66e740 1 -- 172.21.15.31:0/3228534942 shutdown_connections 2024-06-02T22:42:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.966+0000 7f681b66e740 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d3621d910 0x561d3621fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.966+0000 7f681b66e740 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d3621d2a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.966+0000 7f681b66e740 1 --2- 172.21.15.31:0/3228534942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362181d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.966+0000 7f681b66e740 1 -- 172.21.15.31:0/3228534942 >> 172.21.15.31:0/3228534942 conn(0x561d361dff80 msgr2=0x561d36213830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.968+0000 7f681b66e740 1 -- 172.21.15.31:0/3228534942 shutdown_connections 2024-06-02T22:42:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.968+0000 7f681b66e740 1 -- 172.21.15.31:0/3228534942 wait complete. 2024-06-02T22:42:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.969+0000 7f681b66e740 1 -- start start 2024-06-02T22:42:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.969+0000 7f681b66e740 1 Processor -- start 2024-06-02T22:42:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.970+0000 7f681b66e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d36217db0 0x561d36222170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.970+0000 7f681b66e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d362226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f681b66e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f6815e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d36217db0 0x561d36222170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f681b66e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561d36220860 con 0x561d362187a0 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f681b66e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d361360b0 con 0x561d36217db0 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f681b66e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d362209e0 con 0x561d3621d910 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f6816800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.971+0000 7f6816800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58132/0 (socket says 172.21.15.31:58132) 2024-06-02T22:42:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 -- 172.21.15.31:0/1672021452 learned_addr learned my addr 172.21.15.31:0/1672021452 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 -- 172.21.15.31:0/1672021452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d36217db0 msgr2=0x561d36222170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d36217db0 0x561d36222170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 -- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 msgr2=0x561d362226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d362226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.972+0000 7f6816800640 1 -- 172.21.15.31:0/1672021452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d35f5b620 con 0x561d3621d910 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.973+0000 7f681b66e740 10 client.0 _ll_register_callbacks cb 0x561d36121f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.973+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f680003d930 con 0x561d3621d910 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.974+0000 7f6816800640 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6804000c00 tx=0x7f680409af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c2a3fddc2ec5b4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.974+0000 7f67f3400640 10 client.25582 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.974+0000 7f67f3400640 1 -- 172.21.15.31:0/1672021452 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680409b0b0 con 0x561d3621d910 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.974+0000 7f67f3400640 1 -- 172.21.15.31:0/1672021452 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6804010510 con 0x561d3621d910 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.975+0000 7f67f3400640 1 -- 172.21.15.31:0/1672021452 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f680409f460 con 0x561d3621d910 2024-06-02T22:42:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.975+0000 7f681b66e740 10 client.25582 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.975+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561d3622ca50 con 0x561d3621d910 2024-06-02T22:42:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f67f3400640 1 -- 172.21.15.31:0/1672021452 <== mon.1 v2:172.21.15.178:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f680409f0d0 con 0x561d3621d910 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 10 client.25582 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 10 client.25582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 20 client.25582 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3622e080 0x561d36230470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 4 client.25582 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.976+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d36188b50 con 0x561d3622e080 2024-06-02T22:42:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.977+0000 7f6815e00640 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3622e080 0x561d36230470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.979+0000 7f6815e00640 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3622e080 0x561d36230470 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ede2b721c758e82 server_cookie=50ecaa4eff910171 in_seq=0 out_seq=0 2024-06-02T22:42:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.979+0000 7f67f3400640 10 client.25582 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.983+0000 7f67f3400640 1 -- 172.21.15.31:0/1672021452 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561d36188b50 con 0x561d3622e080 2024-06-02T22:42:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.983+0000 7f67f3400640 10 client.25582 handle_command_reply: tid=0 2024-06-02T22:42:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.983+0000 7f681b66e740 1 client.25582 shutdown 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.983+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 msgr2=0x561d362296f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.983+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6804000c00 tx=0x7f680409af70 comp rx=0 tx=0).stop 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 shutdown_connections 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3622e080 0x561d36230470 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d3621d910 0x561d362296f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d362187a0 0x561d362226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 --2- 172.21.15.31:0/1672021452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d36217db0 0x561d36222170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:14.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f67f3400640 0 client.25582 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 >> 172.21.15.31:0/1672021452 conn(0x561d361dff80 msgr2=0x561d36212970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.984+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 shutdown_connections 2024-06-02T22:42:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.985+0000 7f681b66e740 1 -- 172.21.15.31:0/1672021452 wait complete. 2024-06-02T22:42:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:14.985+0000 7f681b66e740 20 client.25582 trim_cache size 0 max 16384 2024-06-02T22:42:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.022+0000 7f681b66e740 1 Processor -- start 2024-06-02T22:42:15.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.022+0000 7f681b66e740 1 -- start start 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 0x561d362139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d36217db0 0x561d362296b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f680c156030 con 0x561d36217db0 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f680c157b70 con 0x561d361dff80 2024-06-02T22:42:15.022 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f681b66e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f680c156700 con 0x561d362187a0 2024-06-02T22:42:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f6816800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f6816800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58146/0 (socket says 172.21.15.31:58146) 2024-06-02T22:42:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.023+0000 7f6816800640 1 -- 172.21.15.31:0/857735172 learned_addr learned my addr 172.21.15.31:0/857735172 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.024+0000 7f6815e00640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 0x561d362139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.024+0000 7f6815400640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d36217db0 0x561d362296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 -- 172.21.15.31:0/857735172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 msgr2=0x561d36220d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 -- 172.21.15.31:0/857735172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d36217db0 msgr2=0x561d362296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d36217db0 0x561d362296b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 -- 172.21.15.31:0/857735172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d362307e0 con 0x561d361dff80 2024-06-02T22:42:15.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6816800640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:42:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f6815e00640 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 0x561d362139c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68100676b0 tx=0x7f681006d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b293bc25b7fe995a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f67fe600640 1 -- 172.21.15.31:0/857735172 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681006ae10 con 0x561d361dff80 2024-06-02T22:42:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f67fe600640 1 -- 172.21.15.31:0/857735172 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f681006ce20 con 0x561d361dff80 2024-06-02T22:42:15.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.025+0000 7f67fe600640 1 -- 172.21.15.31:0/857735172 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681007d3c0 con 0x561d361dff80 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 -- 172.21.15.31:0/857735172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 msgr2=0x561d362139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 0x561d362139c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f68100676b0 tx=0x7f681006d040 comp rx=0 tx=0).stop 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 -- 172.21.15.31:0/857735172 shutdown_connections 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d362187a0 0x561d36220d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d36217db0 0x561d362296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 --2- 172.21.15.31:0/857735172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d361dff80 0x561d362139c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 -- 172.21.15.31:0/857735172 >> 172.21.15.31:0/857735172 conn(0x561d36221d30 msgr2=0x561d362132b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:15.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.026+0000 7f681b66e740 1 -- 172.21.15.31:0/857735172 shutdown_connections 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.027+0000 7f681b66e740 1 -- 172.21.15.31:0/857735172 wait complete. 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.027+0000 7f681b66e740 1 -- start start 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.027+0000 7f681b66e740 1 Processor -- start 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 0x561d362272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 0x561d362287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1574a0 con 0x561d361dff80 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f680c156dd0 con 0x561d362187a0 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f680c154010 con 0x561d36217db0 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f681b66e740 10 client.0 _ll_register_callbacks cb 0x7f6804009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f6815e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 0x561d362272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f6816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 0x561d362287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f6816800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 0x561d362287f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43192/0 (socket says 172.21.15.31:43192) 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f6816800640 1 -- 172.21.15.31:0/995230491 learned_addr learned my addr 172.21.15.31:0/995230491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:15.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.028+0000 7f6815400640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 -- 172.21.15.31:0/995230491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 msgr2=0x561d362277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 -- 172.21.15.31:0/995230491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 msgr2=0x561d362287f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 0x561d362287f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 -- 172.21.15.31:0/995230491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d36228de0 con 0x561d361dff80 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.029+0000 7f6815e00640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 0x561d362272a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6810072000 tx=0x7f6810067af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bca61d398ae225 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.030+0000 7f67f3400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.030+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810089040 con 0x561d361dff80 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.030+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f681006c940 con 0x561d361dff80 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.031+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f681006ce20 con 0x561d361dff80 2024-06-02T22:42:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.031+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f681006a450 con 0x561d361dff80 2024-06-02T22:42:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.031+0000 7f681b66e740 10 client.15381 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.031+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d36299130 con 0x561d361dff80 2024-06-02T22:42:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f681006ce20 con 0x561d361dff80 2024-06-02T22:42:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6810096030 con 0x561d361dff80 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 10 client.15381 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 20 client.15381 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3621d910 0x561d3629ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 4 client.15381 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:42:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.032+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d36182ea0 con 0x561d3621d910 2024-06-02T22:42:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.033+0000 7f6815400640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3621d910 0x561d3629ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.035+0000 7f6815400640 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3621d910 0x561d3629ba20 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fecc6d82c325885d server_cookie=38176a0732073981 in_seq=0 out_seq=0 2024-06-02T22:42:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.035+0000 7f67f3400640 10 client.15381 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 290.0 s, 542.8 tps, lat 183.766 ms stddev 242.535 2024-06-02T22:42:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.258+0000 7f67f3400640 1 -- 172.21.15.31:0/995230491 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561d36182ea0 con 0x561d3621d910 2024-06-02T22:42:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.258+0000 7f67f3400640 10 client.15381 handle_command_reply: tid=0 2024-06-02T22:42:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.258+0000 7f681b66e740 1 client.15381 shutdown 2024-06-02T22:42:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 msgr2=0x561d362272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:15.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 0x561d362272a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6810072000 tx=0x7f6810067af0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 shutdown_connections 2024-06-02T22:42:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3621d910 0x561d3629ba20 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d362187a0 0x561d362287f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d36217db0 0x561d362277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 --2- 172.21.15.31:0/995230491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d361dff80 0x561d362272a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 >> 172.21.15.31:0/995230491 conn(0x561d36221d30 msgr2=0x561d362167e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f67f3400640 0 client.15381 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.259+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 shutdown_connections 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.260+0000 7f681b66e740 1 -- 172.21.15.31:0/995230491 wait complete. 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.260+0000 7f681b66e740 20 client.15381 trim_cache size 0 max 16384 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:42:15.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 msgr2=0x7f67f80a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 0x7f67f80a50a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6800045000 tx=0x7f6800047000 comp rx=0 tx=0).stop 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 msgr2=0x7f680c139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c139c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f680400b410 tx=0x7f680400b8d0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 shutdown_connections 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f67f80a2be0 0x7f67f80a50a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c09b9f0 0x7f680c139c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f680c094460 0x7f680c132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 --2- 172.21.15.31:0/2792225777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f680c093b00 0x7f680c132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 >> 172.21.15.31:0/2792225777 conn(0x7f680c08f510 msgr2=0x7f680c08f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 shutdown_connections 2024-06-02T22:42:15.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:15.261+0000 7f6817200640 1 -- 172.21.15.31:0/2792225777 wait complete. 2024-06-02T22:42:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:15 smithi178 ceph-mon[36614]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 528 op/s 2024-06-02T22:42:16.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:15 smithi031 ceph-mon[31767]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 528 op/s 2024-06-02T22:42:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:15 smithi098 ceph-mon[36750]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 528 op/s 2024-06-02T22:42:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:17 smithi178 ceph-mon[36614]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:42:18.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:17 smithi031 ceph-mon[31767]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:42:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:17 smithi098 ceph-mon[36750]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:42:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 295.0 s, 544.4 tps, lat 180.579 ms stddev 241.686 2024-06-02T22:42:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:19 smithi178 ceph-mon[36614]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T22:42:20.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:19 smithi031 ceph-mon[31767]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T22:42:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:19 smithi098 ceph-mon[36750]: pgmap v671: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T22:42:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:22 smithi178 ceph-mon[36614]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 598 op/s 2024-06-02T22:42:22.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:22 smithi031 ceph-mon[31767]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 598 op/s 2024-06-02T22:42:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:22 smithi098 ceph-mon[36750]: pgmap v672: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 598 op/s 2024-06-02T22:42:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:24 smithi178 ceph-mon[36614]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-06-02T22:42:24.375 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:24 smithi031 ceph-mon[31767]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-06-02T22:42:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:24 smithi098 ceph-mon[36750]: pgmap v673: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 15 MiB/s wr, 676 op/s 2024-06-02T22:42:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 300.0 s, 741.2 tps, lat 138.788 ms stddev 174.228 2024-06-02T22:42:26.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:26 smithi178 ceph-mon[36614]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 545 op/s 2024-06-02T22:42:26.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:26 smithi031 ceph-mon[31767]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 545 op/s 2024-06-02T22:42:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:26 smithi098 ceph-mon[36750]: pgmap v674: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 545 op/s 2024-06-02T22:42:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:28 smithi178 ceph-mon[36614]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-06-02T22:42:28.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:28 smithi031 ceph-mon[31767]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-06-02T22:42:28.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:28 smithi098 ceph-mon[36750]: pgmap v675: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 669 op/s 2024-06-02T22:42:28.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.470+0000 7f4d48600640 1 -- 172.21.15.31:0/2672356502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40108030 msgr2=0x7f4d40108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.470+0000 7f4d48600640 1 --2- 172.21.15.31:0/2672356502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40108030 0x7f4d40108450 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d2802a3f0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 -- 172.21.15.31:0/2672356502 shutdown_connections 2024-06-02T22:42:28.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 --2- 172.21.15.31:0/2672356502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 0x7f4d40110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 --2- 172.21.15.31:0/2672356502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40109220 0x7f4d401096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 --2- 172.21.15.31:0/2672356502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40108030 0x7f4d40108450 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 -- 172.21.15.31:0/2672356502 >> 172.21.15.31:0/2672356502 conn(0x7f4d40076ff0 msgr2=0x7f4d40079410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.471+0000 7f4d48600640 1 -- 172.21.15.31:0/2672356502 shutdown_connections 2024-06-02T22:42:28.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.472+0000 7f4d48600640 1 -- 172.21.15.31:0/2672356502 wait complete. 2024-06-02T22:42:28.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.474+0000 7f4d48600640 1 Processor -- start 2024-06-02T22:42:28.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 -- start start 2024-06-02T22:42:28.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40108030 0x7f4d4007f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 0x7f4d401ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40113cc0 con 0x7f4d40108030 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40113b40 con 0x7f4d40109be0 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.475+0000 7f4d48600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40113e40 con 0x7f4d40109220 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43026/0 (socket says 172.21.15.31:43026) 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 -- 172.21.15.31:0/863381655 learned_addr learned my addr 172.21.15.31:0/863381655 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d46600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 0x7f4d401ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45c00640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40108030 0x7f4d4007f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 -- 172.21.15.31:0/863381655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 msgr2=0x7f4d401ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 0x7f4d401ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 -- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40108030 msgr2=0x7f4d4007f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40108030 0x7f4d4007f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.476+0000 7f4d45200640 1 -- 172.21.15.31:0/863381655 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4007fcf0 con 0x7f4d40109220 2024-06-02T22:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.477+0000 7f4d45200640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009d50 tx=0x7f4d3800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.478+0000 7f4d3e000640 1 -- 172.21.15.31:0/863381655 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38003b70 con 0x7f4d40109220 2024-06-02T22:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.478+0000 7f4d3e000640 1 -- 172.21.15.31:0/863381655 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d38003d10 con 0x7f4d40109220 2024-06-02T22:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.478+0000 7f4d3e000640 1 -- 172.21.15.31:0/863381655 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d380108f0 con 0x7f4d40109220 2024-06-02T22:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.478+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d401ae9f0 con 0x7f4d40109220 2024-06-02T22:42:28.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.478+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d401aeec0 con 0x7f4d40109220 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.493+0000 7f4d3e000640 1 -- 172.21.15.31:0/863381655 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f4d38004020 con 0x7f4d40109220 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.494+0000 7f4d4b403740 1 Processor -- start 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.494+0000 7f4d4b403740 1 -- start start 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.494+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556cca960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556cca98bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d4b403740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5556cc9f4420 con 0x5556cca90bd0 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d4b403740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5556cc99bc50 con 0x5556cca915c0 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d4b403740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556cc9f03e0 con 0x5556cca96730 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d46600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d46600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49396/0 (socket says 172.21.15.31:49396) 2024-06-02T22:42:28.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.495+0000 7f4d46600640 1 -- 172.21.15.31:0/4180507159 learned_addr learned my addr 172.21.15.31:0/4180507159 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 -- 172.21.15.31:0/4180507159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 msgr2=0x5556cca98bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556cca98bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 -- 172.21.15.31:0/4180507159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 msgr2=0x5556cca960c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556cca960c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 -- 172.21.15.31:0/4180507159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556cc708210 con 0x5556cca90bd0 2024-06-02T22:42:28.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.496+0000 7f4d46600640 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009c90 tx=0x7f4d30011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4b91de7780ddd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.498+0000 7f4d36a00640 1 -- 172.21.15.31:0/4180507159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004230 con 0x5556cca90bd0 2024-06-02T22:42:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.498+0000 7f4d36a00640 1 -- 172.21.15.31:0/4180507159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d30009e40 con 0x5556cca90bd0 2024-06-02T22:42:28.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.498+0000 7f4d36a00640 1 -- 172.21.15.31:0/4180507159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d300197a0 con 0x5556cca90bd0 2024-06-02T22:42:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.499+0000 7f4d4b403740 1 -- 172.21.15.31:0/4180507159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 msgr2=0x5556cca90ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.499+0000 7f4d4b403740 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009c90 tx=0x7f4d30011810 comp rx=0 tx=0).stop 2024-06-02T22:42:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.500+0000 7f4d4b403740 1 -- 172.21.15.31:0/4180507159 shutdown_connections 2024-06-02T22:42:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.500+0000 7f4d4b403740 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556cca98bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.500+0000 7f4d4b403740 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556cca960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.500+0000 7f4d4b403740 1 --2- 172.21.15.31:0/4180507159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556cca90ff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.500+0000 7f4d4b403740 1 -- 172.21.15.31:0/4180507159 >> 172.21.15.31:0/4180507159 conn(0x5556cca58f80 msgr2=0x5556cca8c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.502+0000 7f4d4b403740 1 -- 172.21.15.31:0/4180507159 shutdown_connections 2024-06-02T22:42:28.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.503+0000 7f4d3e000640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 0x7f4d240a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.503+0000 7f4d3e000640 1 -- 172.21.15.31:0/863381655 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d380cf9b0 con 0x7f4d40109220 2024-06-02T22:42:28.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.503+0000 7f4d45c00640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 0x7f4d240a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.504+0000 7f4d45c00640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 0x7f4d240a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d28006010 tx=0x7f4d280315d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.504+0000 7f4d4b403740 1 -- 172.21.15.31:0/4180507159 wait complete. 2024-06-02T22:42:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.505+0000 7f4d4b403740 1 -- start start 2024-06-02T22:42:28.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.505+0000 7f4d4b403740 1 Processor -- start 2024-06-02T22:42:28.507 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.507+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccaabfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.507+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.507+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccab3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d45200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d45200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44848/0 (socket says 172.21.15.31:44848) 2024-06-02T22:42:28.508 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d45200640 1 -- 172.21.15.31:0/1128719011 learned_addr learned my addr 172.21.15.31:0/1128719011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5556ccaaa6f0 con 0x5556cca90bd0 2024-06-02T22:42:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d46600640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccab3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5556cc9af0b0 con 0x5556cca915c0 2024-06-02T22:42:28.509 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.508+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556ccaaa870 con 0x5556cca96730 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 -- 172.21.15.31:0/1128719011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 msgr2=0x5556ccab3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccab3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 -- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 msgr2=0x5556ccaabfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccaabfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556cc7d4620 con 0x5556cca915c0 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d4b403740 10 client.0 _ll_register_callbacks cb 0x5556cc99af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556cca01b50 con 0x5556cca915c0 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d45200640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d380982e0 tx=0x7f4d3809b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f65ca77ea08b304 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.509+0000 7f4d2f400640 10 client.25589 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:42:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.510+0000 7f4d2f400640 1 -- 172.21.15.31:0/1128719011 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3809c580 con 0x5556cca915c0 2024-06-02T22:42:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.510+0000 7f4d2f400640 1 -- 172.21.15.31:0/1128719011 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d380984f0 con 0x5556cca915c0 2024-06-02T22:42:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d2f400640 1 -- 172.21.15.31:0/1128719011 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d3809be80 con 0x5556cca915c0 2024-06-02T22:42:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d4b403740 10 client.25589 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:28.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5556ccab6720 con 0x5556cca915c0 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d2f400640 1 -- 172.21.15.31:0/1128719011 <== mon.2 v2:172.21.15.98:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4d38004310 con 0x5556cca915c0 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d4b403740 10 client.25589 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.511+0000 7f4d4b403740 10 client.25589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.512+0000 7f4d4b403740 20 client.25589 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.512+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccab7d70 0x5556ccaba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.512 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.512+0000 7f4d4b403740 4 client.25589 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:42:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.512+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556cc9fbea0 con 0x5556ccab7d70 2024-06-02T22:42:28.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.512+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccab7d70 0x5556ccaba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.516+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccab7d70 0x5556ccaba200 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b90f0d46334cd2 server_cookie=6d8c23efe0e7ebfd in_seq=0 out_seq=0 2024-06-02T22:42:28.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.516+0000 7f4d2f400640 10 client.25589 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:28.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.517+0000 7f4d2f400640 1 -- 172.21.15.31:0/1128719011 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5556cc9fbea0 con 0x5556ccab7d70 2024-06-02T22:42:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.518+0000 7f4d2f400640 10 client.25589 handle_command_reply: tid=0 2024-06-02T22:42:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.518+0000 7f4d4b403740 1 client.25589 shutdown 2024-06-02T22:42:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.518+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 msgr2=0x5556ccaac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.518+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d380982e0 tx=0x7f4d3809b9c0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 shutdown_connections 2024-06-02T22:42:28.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccab7d70 0x5556ccaba200 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccab3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca915c0 0x5556ccaac510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1128719011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccaabfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 >> 172.21.15.31:0/1128719011 conn(0x5556cca58f80 msgr2=0x5556cca8b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.519+0000 7f4d2f400640 0 client.25589 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:28.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.520+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 shutdown_connections 2024-06-02T22:42:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.521+0000 7f4d4b403740 1 -- 172.21.15.31:0/1128719011 wait complete. 2024-06-02T22:42:28.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.521+0000 7f4d4b403740 20 client.25589 trim_cache size 0 max 16384 2024-06-02T22:42:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.562+0000 7f4d4b403740 1 Processor -- start 2024-06-02T22:42:28.562 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.562+0000 7f4d4b403740 1 -- start start 2024-06-02T22:42:28.563 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 0x5556cca8b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca915c0 0x5556ccab3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccaaac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b0b20 con 0x5556cca915c0 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b2660 con 0x5556cca90bd0 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d4b403740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b11f0 con 0x5556cca96730 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.563+0000 7f4d46600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccaaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.564+0000 7f4d46600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccaaac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43042/0 (socket says 172.21.15.31:43042) 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.564+0000 7f4d46600640 1 -- 172.21.15.31:0/946358078 learned_addr learned my addr 172.21.15.31:0/946358078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:28.564 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.564+0000 7f4d45c00640 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 0x5556cca8b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.565 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.564+0000 7f4d45200640 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca915c0 0x5556ccab3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.565 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.565+0000 7f4d45c00640 1 -- 172.21.15.31:0/946358078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 msgr2=0x5556ccaaac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.565 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.565+0000 7f4d45c00640 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccaaac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.565+0000 7f4d45c00640 1 -- 172.21.15.31:0/946358078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca915c0 msgr2=0x5556ccab3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.565+0000 7f4d45c00640 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca915c0 0x5556ccab3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.565+0000 7f4d45c00640 1 -- 172.21.15.31:0/946358078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556cca87ff0 con 0x5556cca90bd0 2024-06-02T22:42:28.566 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.566+0000 7f4d45c00640 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 0x5556cca8b690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009230 tx=0x7f4d2802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a86aaaec444ee629 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.567 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.567+0000 7f4d36000640 1 -- 172.21.15.31:0/946358078 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28035050 con 0x5556cca90bd0 2024-06-02T22:42:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.567+0000 7f4d36000640 1 -- 172.21.15.31:0/946358078 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28051030 con 0x5556cca90bd0 2024-06-02T22:42:28.568 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.567+0000 7f4d36000640 1 -- 172.21.15.31:0/946358078 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d280039c0 con 0x5556cca90bd0 2024-06-02T22:42:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 -- 172.21.15.31:0/946358078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 msgr2=0x5556cca8b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 0x5556cca8b690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009230 tx=0x7f4d2802a3f0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 -- 172.21.15.31:0/946358078 shutdown_connections 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca96730 0x5556ccaaac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca915c0 0x5556ccab3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 --2- 172.21.15.31:0/946358078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca90bd0 0x5556cca8b690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 -- 172.21.15.31:0/946358078 >> 172.21.15.31:0/946358078 conn(0x5556cca58f80 msgr2=0x5556cca8af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 -- 172.21.15.31:0/946358078 shutdown_connections 2024-06-02T22:42:28.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.569+0000 7f4d4b403740 1 -- 172.21.15.31:0/946358078 wait complete. 2024-06-02T22:42:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.570+0000 7f4d4b403740 1 -- start start 2024-06-02T22:42:28.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.571+0000 7f4d4b403740 1 Processor -- start 2024-06-02T22:42:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.572+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccab0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.572+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 0x5556ccab0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.572+0000 7f4d4b403740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca96730 0x5556ccb20ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d4b403740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b1f90 con 0x5556cca90bd0 2024-06-02T22:42:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d4b403740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b18c0 con 0x5556cca96730 2024-06-02T22:42:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d4b403740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40073580 con 0x5556cca915c0 2024-06-02T22:42:28.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d4b403740 10 client.0 _ll_register_callbacks cb 0x7f4d38098120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d45200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 0x5556ccab0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d45200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 0x5556ccab0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43050/0 (socket says 172.21.15.31:43050) 2024-06-02T22:42:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.573+0000 7f4d45200640 1 -- 172.21.15.31:0/1617518376 learned_addr learned my addr 172.21.15.31:0/1617518376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d46600640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca96730 0x5556ccb20ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccab0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 -- 172.21.15.31:0/1617518376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 msgr2=0x5556ccab0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 0x5556ccab0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 -- 172.21.15.31:0/1617518376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca96730 msgr2=0x5556ccb20ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca96730 0x5556ccb20ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.574+0000 7f4d45c00640 1 -- 172.21.15.31:0/1617518376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ccab3730 con 0x5556cca90bd0 2024-06-02T22:42:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.575+0000 7f4d2f400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:42:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.575+0000 7f4d45c00640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccab0120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d28032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6645bec9423e41 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.576+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28035040 con 0x5556cca90bd0 2024-06-02T22:42:28.576 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.576+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d28004040 con 0x5556cca90bd0 2024-06-02T22:42:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.576+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d28051030 con 0x5556cca90bd0 2024-06-02T22:42:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.577+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d28004240 con 0x5556cca90bd0 2024-06-02T22:42:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.577+0000 7f4d4b403740 10 client.15396 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:28.577 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.577+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5556ccb21fb0 con 0x5556cca90bd0 2024-06-02T22:42:28.578 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.578+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d28051030 con 0x5556cca90bd0 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4d2803bb30 con 0x5556cca90bd0 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 10 client.15396 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 20 client.15396 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccb22950 0x5556ccb24d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 4 client.15396 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:42:28.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.579+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556cc9797a0 con 0x5556ccb22950 2024-06-02T22:42:28.580 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.580+0000 7f4d45200640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccb22950 0x5556ccb24d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.581+0000 7f4d45200640 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccb22950 0x5556ccb24d40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db83d8c7ec268e7 server_cookie=b91133c8cc7b9e20 in_seq=0 out_seq=0 2024-06-02T22:42:28.581 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.581+0000 7f4d2f400640 10 client.15396 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.608+0000 7f4d2f400640 1 -- 172.21.15.31:0/1617518376 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5556cc9797a0 con 0x5556ccb22950 2024-06-02T22:42:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.609+0000 7f4d2f400640 10 client.15396 handle_command_reply: tid=0 2024-06-02T22:42:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.609+0000 7f4d4b403740 1 client.15396 shutdown 2024-06-02T22:42:28.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.609+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 msgr2=0x5556ccab0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.609+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccab0120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009900 tx=0x7f4d28032cb0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 shutdown_connections 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5556ccb22950 0x5556ccb24d40 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5556cca96730 0x5556ccb20ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cca915c0 0x5556ccab0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 --2- 172.21.15.31:0/1617518376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5556cca90bd0 0x5556ccab0120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 >> 172.21.15.31:0/1617518376 conn(0x5556cca58f80 msgr2=0x5556cca8b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d2f400640 0 client.15396 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:28.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 shutdown_connections 2024-06-02T22:42:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.610+0000 7f4d4b403740 1 -- 172.21.15.31:0/1617518376 wait complete. 2024-06-02T22:42:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.611+0000 7f4d4b403740 20 client.15396 trim_cache size 0 max 16384 2024-06-02T22:42:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:42:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:42:28.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.611+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 msgr2=0x7f4d240a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.611+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 0x7f4d240a5170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4d28006010 tx=0x7f4d280315d0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 msgr2=0x7f4d4007f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009d50 tx=0x7f4d3800c6a0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 shutdown_connections 2024-06-02T22:42:28.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d240a2cb0 0x7f4d240a5170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d40109be0 0x7f4d401ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d40109220 0x7f4d4007f650 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 --2- 172.21.15.31:0/863381655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d40108030 0x7f4d4007f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 >> 172.21.15.31:0/863381655 conn(0x7f4d40076ff0 msgr2=0x7f4d4010c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 shutdown_connections 2024-06-02T22:42:28.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:28.612+0000 7f4d48600640 1 -- 172.21.15.31:0/863381655 wait complete. 2024-06-02T22:42:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 305.0 s, 799.6 tps, lat 122.907 ms stddev 139.902 2024-06-02T22:42:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:30 smithi178 ceph-mon[36614]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 581 op/s 2024-06-02T22:42:30.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:30 smithi031 ceph-mon[31767]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 581 op/s 2024-06-02T22:42:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:30 smithi098 ceph-mon[36750]: pgmap v676: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 581 op/s 2024-06-02T22:42:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:32 smithi178 ceph-mon[36614]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 547 op/s 2024-06-02T22:42:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:32 smithi031 ceph-mon[31767]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 547 op/s 2024-06-02T22:42:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:32 smithi098 ceph-mon[36750]: pgmap v677: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 547 op/s 2024-06-02T22:42:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:34 smithi178 ceph-mon[36614]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 599 op/s 2024-06-02T22:42:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:34 smithi031 ceph-mon[31767]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 599 op/s 2024-06-02T22:42:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:34 smithi098 ceph-mon[36750]: pgmap v678: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 599 op/s 2024-06-02T22:42:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 310.0 s, 735.6 tps, lat 135.141 ms stddev 167.130 2024-06-02T22:42:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:36 smithi031 ceph-mon[31767]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-06-02T22:42:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:36 smithi098 ceph-mon[36750]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-06-02T22:42:36.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:36 smithi178 ceph-mon[36614]: pgmap v679: 129 pgs: 129 active+clean; 1.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-06-02T22:42:38.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:38 smithi031 ceph-mon[31767]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 589 op/s 2024-06-02T22:42:38.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:38 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:42:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:38 smithi098 ceph-mon[36750]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 589 op/s 2024-06-02T22:42:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:38 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:42:38.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:38 smithi178 ceph-mon[36614]: pgmap v680: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 589 op/s 2024-06-02T22:42:38.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:38 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:42:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 315.0 s, 526.6 tps, lat 190.564 ms stddev 202.724 2024-06-02T22:42:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:40 smithi031 ceph-mon[31767]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 551 op/s 2024-06-02T22:42:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:42:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:42:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:40 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:42:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:40 smithi098 ceph-mon[36750]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 551 op/s 2024-06-02T22:42:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:42:40.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:42:40.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:40 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:42:40.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:40 smithi178 ceph-mon[36614]: pgmap v681: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 551 op/s 2024-06-02T22:42:40.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:42:40.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:42:40.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:40 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:42:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 -- 172.21.15.31:0/2191540004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341089a0 msgr2=0x7fc134108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 --2- 172.21.15.31:0/2191540004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341089a0 0x7fc134108dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc124009900 tx=0x7fc12402a420 comp rx=0 tx=0).stop 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 -- 172.21.15.31:0/2191540004 shutdown_connections 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 --2- 172.21.15.31:0/2191540004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc134110220 0x7fc134112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 --2- 172.21.15.31:0/2191540004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134109300 0x7fc13410fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 --2- 172.21.15.31:0/2191540004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341089a0 0x7fc134108dc0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc124009900 tx=0x7fc12402a420 comp rx=0 tx=0).stop 2024-06-02T22:42:41.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.813+0000 7fc13a000640 1 -- 172.21.15.31:0/2191540004 >> 172.21.15.31:0/2191540004 conn(0x7fc13406ea10 msgr2=0x7fc134070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.814+0000 7fc13a000640 1 -- 172.21.15.31:0/2191540004 shutdown_connections 2024-06-02T22:42:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.814+0000 7fc13a000640 1 -- 172.21.15.31:0/2191540004 wait complete. 2024-06-02T22:42:41.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.815+0000 7fc13a000640 1 Processor -- start 2024-06-02T22:42:41.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 -- start start 2024-06-02T22:42:41.818 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc134109300 0x7fc1341a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 0x7fc1341ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc13410b0a0 con 0x7fc1341ac380 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc13410af20 con 0x7fc134110220 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.818+0000 7fc13a000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc13410b220 con 0x7fc134109300 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.819 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42122/0 (socket says 172.21.15.31:42122) 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 -- 172.21.15.31:0/1505824448 learned_addr learned my addr 172.21.15.31:0/1505824448 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc133e00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 0x7fc1341ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 -- 172.21.15.31:0/1505824448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc134109300 msgr2=0x7fc1341a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc134109300 0x7fc1341a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 -- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 msgr2=0x7fc1341ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 0x7fc1341ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.820 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.819+0000 7fc132a00640 1 -- 172.21.15.31:0/1505824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1341aede0 con 0x7fc134110220 2024-06-02T22:42:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc132a00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b450 tx=0x7fc12000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc12be00640 1 -- 172.21.15.31:0/1505824448 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120015020 con 0x7fc134110220 2024-06-02T22:42:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1341af0d0 con 0x7fc134110220 2024-06-02T22:42:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc12be00640 1 -- 172.21.15.31:0/1505824448 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc120011d70 con 0x7fc134110220 2024-06-02T22:42:41.821 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc12be00640 1 -- 172.21.15.31:0/1505824448 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12000f340 con 0x7fc134110220 2024-06-02T22:42:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.820+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1341af6f0 con 0x7fc134110220 2024-06-02T22:42:41.822 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.821+0000 7fc133e00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 0x7fc1341ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:42:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.825+0000 7fc13ce7d740 1 Processor -- start 2024-06-02T22:42:41.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.825+0000 7fc13ce7d740 1 -- start start 2024-06-02T22:42:41.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae1610ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1616730 0x561ae1618bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ae1574420 con 0x561ae16115c0 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ae151bc50 con 0x561ae1616730 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.829+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561ae15703e0 con 0x561ae1610bd0 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.830+0000 7fc133400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.830+0000 7fc133400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51302/0 (socket says 172.21.15.31:51302) 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.830+0000 7fc133400640 1 -- 172.21.15.31:0/4244732511 learned_addr learned my addr 172.21.15.31:0/4244732511 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc12be00640 1 -- 172.21.15.31:0/1505824448 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fc120018020 con 0x7fc134110220 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 -- 172.21.15.31:0/4244732511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 msgr2=0x561ae1610ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae1610ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 -- 172.21.15.31:0/4244732511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1616730 msgr2=0x561ae1618bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:42:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1616730 0x561ae1618bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 -- 172.21.15.31:0/4244732511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ae1288210 con 0x561ae16115c0 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.831+0000 7fc133400640 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc124033000 tx=0x7fc124000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8a3d70c767fc36 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.832+0000 7fc11fe00640 1 -- 172.21.15.31:0/4244732511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12404f070 con 0x561ae16115c0 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.833+0000 7fc11fe00640 1 -- 172.21.15.31:0/4244732511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc124004470 con 0x561ae16115c0 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.833+0000 7fc12be00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 0x7fc1180a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.833+0000 7fc12be00640 1 -- 172.21.15.31:0/1505824448 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc1200cef40 con 0x7fc134110220 2024-06-02T22:42:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.834+0000 7fc13ce7d740 1 -- 172.21.15.31:0/4244732511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 msgr2=0x561ae16160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.834+0000 7fc11fe00640 1 -- 172.21.15.31:0/4244732511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124035040 con 0x561ae16115c0 2024-06-02T22:42:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.834+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc124033000 tx=0x7fc124000bc0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.834+0000 7fc133e00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 0x7fc1180a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.835+0000 7fc13ce7d740 1 -- 172.21.15.31:0/4244732511 shutdown_connections 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.835+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1616730 0x561ae1618bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.835+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae16160c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.835+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/4244732511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae1610ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.835+0000 7fc13ce7d740 1 -- 172.21.15.31:0/4244732511 >> 172.21.15.31:0/4244732511 conn(0x561ae15d8f80 msgr2=0x561ae160c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.836+0000 7fc133e00640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 0x7fc1180a51f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x561ae1611e20 tx=0x7fc12c007320 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.839+0000 7fc13ce7d740 1 -- 172.21.15.31:0/4244732511 shutdown_connections 2024-06-02T22:42:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.839+0000 7fc13ce7d740 1 -- 172.21.15.31:0/4244732511 wait complete. 2024-06-02T22:42:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.840+0000 7fc13ce7d740 1 -- start start 2024-06-02T22:42:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.841+0000 7fc13ce7d740 1 Processor -- start 2024-06-02T22:42:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.841+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae161ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.842+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.842+0000 7fc133400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae161ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.842+0000 7fc133400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae161ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57556/0 (socket says 172.21.15.31:57556) 2024-06-02T22:42:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.842+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.842+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42140/0 (socket says 172.21.15.31:42140) 2024-06-02T22:42:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.843+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae16223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.843+0000 7fc133400640 1 -- 172.21.15.31:0/98533746 learned_addr learned my addr 172.21.15.31:0/98533746 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561ae1619680 con 0x561ae1616730 2024-06-02T22:42:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561ae152f0b0 con 0x561ae16115c0 2024-06-02T22:42:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561ae1619800 con 0x561ae1610bd0 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc132a00640 1 -- 172.21.15.31:0/98533746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 msgr2=0x561ae161ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc132a00640 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae161ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc132a00640 1 -- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 msgr2=0x561ae16223d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc132a00640 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae16223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc13ce7d740 10 client.0 _ll_register_callbacks cb 0x561ae151af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:41.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.845+0000 7fc132a00640 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ae1354620 con 0x561ae16115c0 2024-06-02T22:42:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.846+0000 7fc132a00640 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc12009b0b0 tx=0x7fc12009bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9ce083ac3eeec2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.846+0000 7fc11cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:42:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.846+0000 7fc11cc00640 1 -- 172.21.15.31:0/98533746 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1200b4060 con 0x561ae16115c0 2024-06-02T22:42:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.846+0000 7fc11cc00640 1 -- 172.21.15.31:0/98533746 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc1200cc760 con 0x561ae16115c0 2024-06-02T22:42:41.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.847+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc124004470 con 0x561ae16115c0 2024-06-02T22:42:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.847+0000 7fc11cc00640 1 -- 172.21.15.31:0/98533746 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc1200b9050 con 0x561ae16115c0 2024-06-02T22:42:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.847+0000 7fc13ce7d740 10 client.25601 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.847+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561ae1625470 con 0x561ae16115c0 2024-06-02T22:42:41.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.848+0000 7fc11cc00640 1 -- 172.21.15.31:0/98533746 <== mon.2 v2:172.21.15.98:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc1200b4200 con 0x561ae16115c0 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.848+0000 7fc13ce7d740 10 client.25601 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.848+0000 7fc13ce7d740 10 client.25601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.848+0000 7fc13ce7d740 20 client.25601 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.848+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1626f30 0x561ae16293b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.849+0000 7fc13ce7d740 4 client.25601 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:42:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.849+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc124004470 con 0x561ae1626f30 2024-06-02T22:42:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.850+0000 7fc133400640 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1626f30 0x561ae16293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.851+0000 7fc133400640 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1626f30 0x561ae16293b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a4a8f84411c240 server_cookie=61c41c1d9d14e58e in_seq=0 out_seq=0 2024-06-02T22:42:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.851+0000 7fc11cc00640 10 client.25601 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.853+0000 7fc11cc00640 1 -- 172.21.15.31:0/98533746 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fc124004470 con 0x561ae1626f30 2024-06-02T22:42:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.853+0000 7fc11cc00640 10 client.25601 handle_command_reply: tid=0 2024-06-02T22:42:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.854+0000 7fc13ce7d740 1 client.25601 shutdown 2024-06-02T22:42:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.854+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 msgr2=0x561ae161b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.854+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc12009b0b0 tx=0x7fc12009bab0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 shutdown_connections 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1626f30 0x561ae16293b0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae16223d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae161b390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/98533746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae161ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 >> 172.21.15.31:0/98533746 conn(0x561ae15d8f80 msgr2=0x561ae160b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc11cc00640 0 client.25601 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 shutdown_connections 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 1 -- 172.21.15.31:0/98533746 wait complete. 2024-06-02T22:42:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.855+0000 7fc13ce7d740 20 client.25601 trim_cache size 0 max 16384 2024-06-02T22:42:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 Processor -- start 2024-06-02T22:42:41.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 -- start start 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae160c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae16222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae160af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.887+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc1341b1290 con 0x561ae1616730 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1341b2dd0 con 0x561ae16115c0 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc1341b1960 con 0x561ae1610bd0 2024-06-02T22:42:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae16222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc132a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae16222f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42156/0 (socket says 172.21.15.31:42156) 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc133400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae160c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc132a00640 1 -- 172.21.15.31:0/247791614 learned_addr learned my addr 172.21.15.31:0/247791614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.888+0000 7fc133e00640 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae160af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 -- 172.21.15.31:0/247791614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 msgr2=0x561ae16222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae16222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 -- 172.21.15.31:0/247791614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 msgr2=0x561ae160af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae160af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 -- 172.21.15.31:0/247791614 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ae1607ff0 con 0x561ae1610bd0 2024-06-02T22:42:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc133400640 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae160c7e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc124031610 tx=0x7fc124057040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4db49f55e3c0672a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.889+0000 7fc11f400640 1 -- 172.21.15.31:0/247791614 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124065070 con 0x561ae1610bd0 2024-06-02T22:42:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.892+0000 7fc11f400640 1 -- 172.21.15.31:0/247791614 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc124003d50 con 0x561ae1610bd0 2024-06-02T22:42:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.892+0000 7fc11f400640 1 -- 172.21.15.31:0/247791614 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12404f040 con 0x561ae1610bd0 2024-06-02T22:42:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 -- 172.21.15.31:0/247791614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 msgr2=0x561ae160c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae160c7e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc124031610 tx=0x7fc124057040 comp rx=0 tx=0).stop 2024-06-02T22:42:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 -- 172.21.15.31:0/247791614 shutdown_connections 2024-06-02T22:42:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae1616730 0x561ae160af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae16115c0 0x561ae16222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/247791614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1610bd0 0x561ae160c7e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.893+0000 7fc13ce7d740 1 -- 172.21.15.31:0/247791614 >> 172.21.15.31:0/247791614 conn(0x561ae15d8f80 msgr2=0x561ae160c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.894+0000 7fc13ce7d740 1 -- 172.21.15.31:0/247791614 shutdown_connections 2024-06-02T22:42:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.894+0000 7fc13ce7d740 1 -- 172.21.15.31:0/247791614 wait complete. 2024-06-02T22:42:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.895+0000 7fc13ce7d740 1 -- start start 2024-06-02T22:42:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.896+0000 7fc13ce7d740 1 Processor -- start 2024-06-02T22:42:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.896+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.896+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae161fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.896+0000 7fc13ce7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 0x561ae1620be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc1341b2700 con 0x561ae16115c0 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc1341b2030 con 0x561ae1610bd0 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc13ce7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc134120e50 con 0x561ae1616730 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc13ce7d740 10 client.0 _ll_register_callbacks cb 0x7fc12009aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42172/0 (socket says 172.21.15.31:42172) 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 -- 172.21.15.31:0/1621828617 learned_addr learned my addr 172.21.15.31:0/1621828617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133e00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 0x561ae1620be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc132a00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae161fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 -- 172.21.15.31:0/1621828617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 msgr2=0x561ae1620be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 0x561ae1620be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 -- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 msgr2=0x561ae161fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae161fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133400640 1 -- 172.21.15.31:0/1621828617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ae16211d0 con 0x561ae1610bd0 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc133e00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 0x561ae1620be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.897+0000 7fc132a00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae161fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc133400640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc124009850 tx=0x7fc124003fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e118de9acdcf77 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc11cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12406e060 con 0x561ae1610bd0 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc124003800 con 0x561ae1610bd0 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc124003d50 con 0x561ae1610bd0 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc12404f070 con 0x561ae1610bd0 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc13ce7d740 10 client.25607 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.898+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561ae16224e0 con 0x561ae1610bd0 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc124003d50 con 0x561ae1610bd0 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc12404a040 con 0x561ae1610bd0 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 10 client.25607 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 10 client.25607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 20 client.25607 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1691e50 0x561ae1694240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 4 client.25607 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:42:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.899+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ae161ac40 con 0x561ae1691e50 2024-06-02T22:42:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.900+0000 7fc132a00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1691e50 0x561ae1694240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.901+0000 7fc132a00640 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1691e50 0x561ae1694240 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f36a22ffafde3 server_cookie=6e0b69d7a67aabc in_seq=0 out_seq=0 2024-06-02T22:42:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.901+0000 7fc11cc00640 10 client.25607 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.932+0000 7fc11cc00640 1 -- 172.21.15.31:0/1621828617 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561ae161ac40 con 0x561ae1691e50 2024-06-02T22:42:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.932+0000 7fc11cc00640 10 client.25607 handle_command_reply: tid=0 2024-06-02T22:42:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.932+0000 7fc13ce7d740 1 client.25607 shutdown 2024-06-02T22:42:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.932+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 msgr2=0x561ae161f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.932+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc124009850 tx=0x7fc124003fd0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 shutdown_connections 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561ae1691e50 0x561ae1694240 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561ae1616730 0x561ae1620be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561ae16115c0 0x561ae161fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 --2- 172.21.15.31:0/1621828617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561ae1610bd0 0x561ae161f690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 >> 172.21.15.31:0/1621828617 conn(0x561ae15d8f80 msgr2=0x561ae160af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc11cc00640 0 client.25607 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 shutdown_connections 2024-06-02T22:42:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 1 -- 172.21.15.31:0/1621828617 wait complete. 2024-06-02T22:42:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.933+0000 7fc13ce7d740 20 client.25607 trim_cache size 0 max 16384 2024-06-02T22:42:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:42:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:42:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:42:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 msgr2=0x7fc1180a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 0x7fc1180a51f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x561ae1611e20 tx=0x7fc12c007320 comp rx=0 tx=0).stop 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 msgr2=0x7fc1341a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b450 tx=0x7fc12000b910 comp rx=0 tx=0).stop 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 shutdown_connections 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc1180a2d30 0x7fc1180a51f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1341ac380 0x7fc1341ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc134110220 0x7fc1341a7320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 --2- 172.21.15.31:0/1505824448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc134109300 0x7fc1341a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 >> 172.21.15.31:0/1505824448 conn(0x7fc13406ea10 msgr2=0x7fc13410e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 shutdown_connections 2024-06-02T22:42:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:41.934+0000 7fc13a000640 1 -- 172.21.15.31:0/1505824448 wait complete. 2024-06-02T22:42:42.366 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:42 smithi178 ceph-mon[36614]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 535 op/s 2024-06-02T22:42:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:42 smithi031 ceph-mon[31767]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 535 op/s 2024-06-02T22:42:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:42 smithi098 ceph-mon[36750]: pgmap v682: 129 pgs: 129 active+clean; 1.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 535 op/s 2024-06-02T22:42:44.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:44 smithi031 ceph-mon[31767]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 635 op/s 2024-06-02T22:42:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:44 smithi098 ceph-mon[36750]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 635 op/s 2024-06-02T22:42:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:44 smithi178 ceph-mon[36614]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 635 op/s 2024-06-02T22:42:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 320.0 s, 770.2 tps, lat 131.346 ms stddev 157.976 2024-06-02T22:42:46.465 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:46 smithi098 ceph-mon[36750]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 544 op/s 2024-06-02T22:42:46.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:46 smithi178 ceph-mon[36614]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 544 op/s 2024-06-02T22:42:46.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:46 smithi031 ceph-mon[31767]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 544 op/s 2024-06-02T22:42:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:48 smithi098 ceph-mon[36750]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 642 op/s 2024-06-02T22:42:48.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:48 smithi178 ceph-mon[36614]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 642 op/s 2024-06-02T22:42:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:48 smithi031 ceph-mon[31767]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 642 op/s 2024-06-02T22:42:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 325.0 s, 689.2 tps, lat 144.664 ms stddev 179.746 2024-06-02T22:42:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:50 smithi098 ceph-mon[36750]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 618 op/s 2024-06-02T22:42:50.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:50 smithi178 ceph-mon[36614]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 618 op/s 2024-06-02T22:42:50.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:50 smithi031 ceph-mon[31767]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 618 op/s 2024-06-02T22:42:52.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:52 smithi098 ceph-mon[36750]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-06-02T22:42:52.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:52 smithi178 ceph-mon[36614]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-06-02T22:42:52.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:52 smithi031 ceph-mon[31767]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 522 op/s 2024-06-02T22:42:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:54 smithi098 ceph-mon[36750]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 635 op/s 2024-06-02T22:42:54.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:54 smithi178 ceph-mon[36614]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 635 op/s 2024-06-02T22:42:54.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:54 smithi031 ceph-mon[31767]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 635 op/s 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3563801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 msgr2=0x7fe7b0073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3563801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b0073dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009900 tx=0x7fe7a002a480 comp rx=0 tx=0).stop 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3563801 shutdown_connections 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3563801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 0x7fe7b010bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3563801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3563801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b0073dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3563801 >> 172.21.15.31:0/3563801 conn(0x7fe7b00fcf90 msgr2=0x7fe7b00ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3563801 shutdown_connections 2024-06-02T22:42:55.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.137+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3563801 wait complete. 2024-06-02T22:42:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 Processor -- start 2024-06-02T22:42:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 -- start start 2024-06-02T22:42:55.138 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 0x7fe7b01a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b010f870 con 0x7fe7b0109890 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b010f6f0 con 0x7fe7b0075980 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.139+0000 7fe7b4e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b010f9f0 con 0x7fe7b00743a0 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51482/0 (socket says 172.21.15.31:51482) 2024-06-02T22:42:55.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 -- 172.21.15.31:0/3155108862 learned_addr learned my addr 172.21.15.31:0/3155108862 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ad400640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ae800640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 0x7fe7b01a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 -- 172.21.15.31:0/3155108862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 msgr2=0x7fe7b019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 -- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 msgr2=0x7fe7b01a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 0x7fe7b01a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.140+0000 7fe7ade00640 1 -- 172.21.15.31:0/3155108862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b01a1a70 con 0x7fe7b00743a0 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.141+0000 7fe7ade00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009230 tx=0x7fe7a0031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.141+0000 7fe7a6a00640 1 -- 172.21.15.31:0/3155108862 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a003f030 con 0x7fe7b00743a0 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.141+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b01a1d00 con 0x7fe7b00743a0 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.142+0000 7fe7a6a00640 1 -- 172.21.15.31:0/3155108862 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7a0003ad0 con 0x7fe7b00743a0 2024-06-02T22:42:55.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.142+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b01a2190 con 0x7fe7b00743a0 2024-06-02T22:42:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.142+0000 7fe7a6a00640 1 -- 172.21.15.31:0/3155108862 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0049060 con 0x7fe7b00743a0 2024-06-02T22:42:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.147+0000 7fe7a6a00640 1 -- 172.21.15.31:0/3155108862 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe7a0042030 con 0x7fe7b00743a0 2024-06-02T22:42:55.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.149+0000 7fe7b7c05740 1 Processor -- start 2024-06-02T22:42:55.149 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.150+0000 7fe7b7c05740 1 -- start start 2024-06-02T22:42:55.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.151+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.151+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7c83bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7ae800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7ae800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c7bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33046/0 (socket says 172.21.15.31:33046) 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560bf7bdf420 con 0x560bf7c7c5c0 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7ae800640 1 -- 172.21.15.31:0/2440029657 learned_addr learned my addr 172.21.15.31:0/2440029657 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bf7b86c50 con 0x560bf7c7bbd0 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.152+0000 7fe7ad400640 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7c83bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.153+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560bf7bdb3e0 con 0x560bf7c81730 2024-06-02T22:42:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.153+0000 7fe7a6a00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 0x7fe7940a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.153+0000 7fe7a6a00640 1 -- 172.21.15.31:0/3155108862 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe7a003b460 con 0x7fe7b00743a0 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.154+0000 7fe7ad400640 1 -- 172.21.15.31:0/2440029657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 msgr2=0x560bf7c7bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.154+0000 7fe7ad400640 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c7bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.154+0000 7fe7ad400640 1 -- 172.21.15.31:0/2440029657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 msgr2=0x560bf7c810c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.154+0000 7fe7ad400640 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.154+0000 7fe7ad400640 1 -- 172.21.15.31:0/2440029657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf78f3210 con 0x560bf7c81730 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.155+0000 7fe7ae800640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 0x7fe7940a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.155+0000 7fe7ad400640 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7c83bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009bd0 tx=0x7fe79c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5592f547f0001d30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.156+0000 7fe79b400640 1 -- 172.21.15.31:0/2440029657 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c004230 con 0x560bf7c81730 2024-06-02T22:42:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.156+0000 7fe79b400640 1 -- 172.21.15.31:0/2440029657 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe79c009e40 con 0x560bf7c81730 2024-06-02T22:42:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.156+0000 7fe79b400640 1 -- 172.21.15.31:0/2440029657 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c004d70 con 0x560bf7c81730 2024-06-02T22:42:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.157+0000 7fe7ae800640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 0x7fe7940a51f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560bf7c7ce20 tx=0x7fe7a8004ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.159+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 msgr2=0x560bf7c83bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.159+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7c83bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009bd0 tx=0x7fe79c011810 comp rx=0 tx=0).stop 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.160+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 shutdown_connections 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.160+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7c83bc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.160+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.160+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2440029657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c7bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.160+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 >> 172.21.15.31:0/2440029657 conn(0x560bf7c43f80 msgr2=0x560bf7c77650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.161+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 shutdown_connections 2024-06-02T22:42:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.162+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2440029657 wait complete. 2024-06-02T22:42:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.162+0000 7fe7b7c05740 1 -- start start 2024-06-02T22:42:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 Processor -- start 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c864d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560bf7c846e0 con 0x560bf7c7c5c0 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560bf7b9a0b0 con 0x560bf7c81730 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560bf7c84860 con 0x560bf7c7bbd0 2024-06-02T22:42:55.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.163+0000 7fe7b7c05740 10 client.0 _ll_register_callbacks cb 0x560bf7b85f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.165+0000 7fe7ad400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.165+0000 7fe7ade00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.165+0000 7fe7ae800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.165+0000 7fe7ae800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33048/0 (socket says 172.21.15.31:33048) 2024-06-02T22:42:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.165+0000 7fe7ae800640 1 -- 172.21.15.31:0/1833272777 learned_addr learned my addr 172.21.15.31:0/1833272777 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ad400640 1 -- 172.21.15.31:0/1833272777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 msgr2=0x560bf7c85f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ad400640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ad400640 1 -- 172.21.15.31:0/1833272777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 msgr2=0x560bf7c8d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ad400640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ad400640 1 -- 172.21.15.31:0/1833272777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf79bf620 con 0x560bf7c7c5c0 2024-06-02T22:42:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ade00640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:42:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.166+0000 7fe7ae800640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:42:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.167+0000 7fe7ad400640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c864d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe79c011d10 tx=0x7fe79c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a29609e5c67b7dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.167+0000 7fe78fe00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:42:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.168+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c027020 con 0x560bf7c7c5c0 2024-06-02T22:42:55.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.168+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560bf7becb50 con 0x560bf7c7c5c0 2024-06-02T22:42:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.168+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe79c003c10 con 0x560bf7c7c5c0 2024-06-02T22:42:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.169+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe79c01e040 con 0x560bf7c7c5c0 2024-06-02T22:42:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.169+0000 7fe7b7c05740 10 client.15411 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.169+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560bf7c908b0 con 0x560bf7c7c5c0 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.170+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560bf7becb50 con 0x560bf7c7c5c0 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.170+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe79c018070 con 0x560bf7c7c5c0 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 10 client.15411 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 20 client.15411 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7c91df0 0x560bf7c94210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 4 client.15411 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:42:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bf7be6ea0 con 0x560bf7c91df0 2024-06-02T22:42:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.171+0000 7fe7ade00640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7c91df0 0x560bf7c94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.173+0000 7fe7ade00640 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7c91df0 0x560bf7c94210 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac21bdc605dfeafd server_cookie=df515b6c2f50686c in_seq=0 out_seq=0 2024-06-02T22:42:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.174+0000 7fe78fe00640 10 client.15411 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.179+0000 7fe78fe00640 1 -- 172.21.15.31:0/1833272777 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560bf7be6ea0 con 0x560bf7c91df0 2024-06-02T22:42:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.179+0000 7fe78fe00640 10 client.15411 handle_command_reply: tid=0 2024-06-02T22:42:55.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.179+0000 7fe7b7c05740 1 client.15411 shutdown 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.183+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 msgr2=0x560bf7c864d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.183+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c864d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe79c011d10 tx=0x7fe79c003820 comp rx=0 tx=0).stop 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 shutdown_connections 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7c91df0 0x560bf7c94210 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c81730 0x560bf7c8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c864d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/1833272777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe78fe00640 0 client.15411 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 >> 172.21.15.31:0/1833272777 conn(0x560bf7c43f80 msgr2=0x560bf7c76810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 shutdown_connections 2024-06-02T22:42:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 1 -- 172.21.15.31:0/1833272777 wait complete. 2024-06-02T22:42:55.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.184+0000 7fe7b7c05740 20 client.15411 trim_cache size 0 max 16384 2024-06-02T22:42:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 Processor -- start 2024-06-02T22:42:55.221 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 -- start start 2024-06-02T22:42:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 0x560bf7c857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe79000fca0 con 0x560bf7c81730 2024-06-02T22:42:55.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900117e0 con 0x560bf7c7bbd0 2024-06-02T22:42:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.222+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe790010370 con 0x560bf7c7c5c0 2024-06-02T22:42:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51514/0 (socket says 172.21.15.31:51514) 2024-06-02T22:42:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 -- 172.21.15.31:0/3823412280 learned_addr learned my addr 172.21.15.31:0/3823412280 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:55.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ade00640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 330.0 s, 768.9 tps, lat 126.070 ms stddev 145.796 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 -- 172.21.15.31:0/3823412280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 msgr2=0x560bf7c85260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 -- 172.21.15.31:0/3823412280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 msgr2=0x560bf7c857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ae800640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 0x560bf7c857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 0x560bf7c857a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ad400640 1 -- 172.21.15.31:0/3823412280 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf7c78300 con 0x560bf7c7c5c0 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.223+0000 7fe7ae800640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 0x560bf7c857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.224+0000 7fe7ad400640 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe79c001eb0 tx=0x7fe79c009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb939eb8a2e80e9c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.224+0000 7fe79aa00640 1 -- 172.21.15.31:0/3823412280 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c039070 con 0x560bf7c7c5c0 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.224+0000 7fe79aa00640 1 -- 172.21.15.31:0/3823412280 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe79c003e70 con 0x560bf7c7c5c0 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.224+0000 7fe79aa00640 1 -- 172.21.15.31:0/3823412280 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c027030 con 0x560bf7c7c5c0 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 -- 172.21.15.31:0/3823412280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 msgr2=0x560bf7c8d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe79c001eb0 tx=0x7fe79c009ad0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 -- 172.21.15.31:0/3823412280 shutdown_connections 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c81730 0x560bf7c857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8d4d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/3823412280 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c85260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 -- 172.21.15.31:0/3823412280 >> 172.21.15.31:0/3823412280 conn(0x560bf7c43f80 msgr2=0x560bf7c7d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 -- 172.21.15.31:0/3823412280 shutdown_connections 2024-06-02T22:42:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.225+0000 7fe7b7c05740 1 -- 172.21.15.31:0/3823412280 wait complete. 2024-06-02T22:42:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.226+0000 7fe7b7c05740 1 -- start start 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.226+0000 7fe7b7c05740 1 Processor -- start 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7d032b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe790011110 con 0x560bf7c7c5c0 2024-06-02T22:42:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe790010a40 con 0x560bf7c7bbd0 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe79000dc80 con 0x560bf7c81730 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7b7c05740 10 client.0 _ll_register_callbacks cb 0x7fe7a8009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7ade00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7ad400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7ade00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33072/0 (socket says 172.21.15.31:33072) 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7ade00640 1 -- 172.21.15.31:0/2963026563 learned_addr learned my addr 172.21.15.31:0/2963026563 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.227+0000 7fe7ae800640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7d032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 -- 172.21.15.31:0/2963026563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 msgr2=0x560bf7c8a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 -- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 msgr2=0x560bf7c8a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 -- 172.21.15.31:0/2963026563 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf7c8d6c0 con 0x560bf7c81730 2024-06-02T22:42:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ade00640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe7ae800640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7d032b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8005bd0 tx=0x7fe7a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fbff0122555a18a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.228+0000 7fe78fe00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8026030 con 0x560bf7c81730 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe7a8004b20 con 0x560bf7c81730 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe79c003e70 con 0x560bf7c81730 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe7a8032050 con 0x560bf7c81730 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe7b7c05740 10 client.25627 fetch_fsmap learned FSMap version 30 2024-06-02T22:42:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.229+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560bf7d04750 con 0x560bf7c81730 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe79c003e70 con 0x560bf7c81730 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe7a800f040 con 0x560bf7c81730 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe7b7c05740 10 client.25627 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe7b7c05740 10 client.25627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe7b7c05740 20 client.25627 populate_metadata read hostname 'smithi031' 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.230+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7d051b0 0x560bf7d075d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.231+0000 7fe7b7c05740 4 client.25627 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:42:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.231+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560bf7b647a0 con 0x560bf7d051b0 2024-06-02T22:42:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.231+0000 7fe7ade00640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7d051b0 0x560bf7d075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:42:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.232+0000 7fe7ade00640 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7d051b0 0x560bf7d075d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a666e31abff6ed09 server_cookie=4c46bdaa3f8225fa in_seq=0 out_seq=0 2024-06-02T22:42:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.232+0000 7fe78fe00640 10 client.25627 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.260+0000 7fe78fe00640 1 -- 172.21.15.31:0/2963026563 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560bf7b647a0 con 0x560bf7d051b0 2024-06-02T22:42:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.260+0000 7fe78fe00640 10 client.25627 handle_command_reply: tid=0 2024-06-02T22:42:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.260+0000 7fe7b7c05740 1 client.25627 shutdown 2024-06-02T22:42:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.260+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 msgr2=0x560bf7d032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.260+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7d032b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8005bd0 tx=0x7fe7a8004a40 comp rx=0 tx=0).stop 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 shutdown_connections 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560bf7d051b0 0x560bf7d075d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560bf7c81730 0x560bf7d032b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560bf7c7c5c0 0x560bf7c8a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 --2- 172.21.15.31:0/2963026563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560bf7c7bbd0 0x560bf7c8a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 >> 172.21.15.31:0/2963026563 conn(0x560bf7c43f80 msgr2=0x560bf7c75f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe78fe00640 0 client.25627 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 shutdown_connections 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 1 -- 172.21.15.31:0/2963026563 wait complete. 2024-06-02T22:42:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.261+0000 7fe7b7c05740 20 client.25627 trim_cache size 0 max 16384 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 msgr2=0x7fe7940a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 0x7fe7940a51f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x560bf7c7ce20 tx=0x7fe7a8004ab0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 msgr2=0x7fe7b0199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:42:55.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009230 tx=0x7fe7a0031b60 comp rx=0 tx=0).stop 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 shutdown_connections 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7940a2d30 0x7fe7940a51f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7b0109890 0x7fe7b01a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7b0075980 0x7fe7b019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 --2- 172.21.15.31:0/3155108862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00743a0 0x7fe7b0199e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 >> 172.21.15.31:0/3155108862 conn(0x7fe7b00fcf90 msgr2=0x7fe7b0105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 shutdown_connections 2024-06-02T22:42:55.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:42:55.262+0000 7fe7b4e00640 1 -- 172.21.15.31:0/3155108862 wait complete. 2024-06-02T22:42:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:56 smithi098 ceph-mon[36750]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 508 op/s 2024-06-02T22:42:56.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:56 smithi178 ceph-mon[36614]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 508 op/s 2024-06-02T22:42:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:56 smithi031 ceph-mon[31767]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 508 op/s 2024-06-02T22:42:58.423 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:42:58 smithi031 ceph-mon[31767]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 620 op/s 2024-06-02T22:42:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:42:58 smithi098 ceph-mon[36750]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 620 op/s 2024-06-02T22:42:58.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:42:58 smithi178 ceph-mon[36614]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 620 op/s 2024-06-02T22:43:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 335.0 s, 667.7 tps, lat 152.678 ms stddev 205.732 2024-06-02T22:43:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:00 smithi098 ceph-mon[36750]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 565 op/s 2024-06-02T22:43:00.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:00 smithi178 ceph-mon[36614]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 565 op/s 2024-06-02T22:43:00.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:00 smithi031 ceph-mon[31767]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 565 op/s 2024-06-02T22:43:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:02 smithi098 ceph-mon[36750]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 492 op/s 2024-06-02T22:43:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:02 smithi178 ceph-mon[36614]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 492 op/s 2024-06-02T22:43:02.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:02 smithi031 ceph-mon[31767]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 492 op/s 2024-06-02T22:43:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:04 smithi098 ceph-mon[36750]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-06-02T22:43:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:04 smithi178 ceph-mon[36614]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-06-02T22:43:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:04 smithi031 ceph-mon[31767]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-06-02T22:43:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 340.0 s, 778.0 tps, lat 127.403 ms stddev 153.950 2024-06-02T22:43:06.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:06 smithi178 ceph-mon[36614]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 489 op/s 2024-06-02T22:43:06.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:06 smithi031 ceph-mon[31767]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 489 op/s 2024-06-02T22:43:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:06 smithi098 ceph-mon[36750]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 489 op/s 2024-06-02T22:43:07.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:07 smithi178 ceph-mon[36614]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-06-02T22:43:07.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:07 smithi031 ceph-mon[31767]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-06-02T22:43:07.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:07 smithi098 ceph-mon[36750]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-06-02T22:43:08.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.454+0000 7fd441600640 1 -- 172.21.15.31:0/3234022421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1002e0 msgr2=0x7fd43c100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.454+0000 7fd441600640 1 --2- 172.21.15.31:0/3234022421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1002e0 0x7fd43c100700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd424009900 tx=0x7fd42402a480 comp rx=0 tx=0).stop 2024-06-02T22:43:08.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 -- 172.21.15.31:0/3234022421 shutdown_connections 2024-06-02T22:43:08.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 --2- 172.21.15.31:0/3234022421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1015e0 0x7fd43c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 --2- 172.21.15.31:0/3234022421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 --2- 172.21.15.31:0/3234022421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1002e0 0x7fd43c100700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 -- 172.21.15.31:0/3234022421 >> 172.21.15.31:0/3234022421 conn(0x7fd43c0fbe60 msgr2=0x7fd43c0fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 -- 172.21.15.31:0/3234022421 shutdown_connections 2024-06-02T22:43:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.455+0000 7fd441600640 1 -- 172.21.15.31:0/3234022421 wait complete. 2024-06-02T22:43:08.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.456+0000 7fd441600640 1 Processor -- start 2024-06-02T22:43:08.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.457+0000 7fd441600640 1 -- start start 2024-06-02T22:43:08.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.457+0000 7fd441600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd441600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1063d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd441600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1015e0 0x7fd43c10b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd441600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c06bcc0 con 0x7fd43c100c40 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd441600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c06bb40 con 0x7fd43c1002e0 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd441600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c06be40 con 0x7fd43c1015e0 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48550/0 (socket says 172.21.15.31:48550) 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 -- 172.21.15.31:0/1228314337 learned_addr learned my addr 172.21.15.31:0/1228314337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:08.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43b400640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1015e0 0x7fd43c10b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd432000640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 -- 172.21.15.31:0/1228314337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1015e0 msgr2=0x7fd43c10b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1015e0 0x7fd43c10b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 -- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 msgr2=0x7fd43c1063d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.458+0000 7fd43aa00640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1063d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd43aa00640 1 -- 172.21.15.31:0/1228314337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c10baa0 con 0x7fd43c1002e0 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd432000640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:08.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd43aa00640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd424031440 tx=0x7fd424032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd433e00640 1 -- 172.21.15.31:0/1228314337 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42403f030 con 0x7fd43c1002e0 2024-06-02T22:43:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd433e00640 1 -- 172.21.15.31:0/1228314337 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd424003ce0 con 0x7fd43c1002e0 2024-06-02T22:43:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd433e00640 1 -- 172.21.15.31:0/1228314337 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424035070 con 0x7fd43c1002e0 2024-06-02T22:43:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.459+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c10bd30 con 0x7fd43c1002e0 2024-06-02T22:43:08.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.460+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c10c1d0 con 0x7fd43c1002e0 2024-06-02T22:43:08.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.464+0000 7fd433e00640 1 -- 172.21.15.31:0/1228314337 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fd424042030 con 0x7fd43c1002e0 2024-06-02T22:43:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.467+0000 7fd4443ef740 1 Processor -- start 2024-06-02T22:43:08.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.467+0000 7fd4443ef740 1 -- start start 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.468+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252364ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c25236cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd4443ef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c2522c8420 con 0x55c252364bd0 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd4443ef740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c25226fc50 con 0x55c25236a730 2024-06-02T22:43:08.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd4443ef740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c2522c43e0 con 0x55c2523655c0 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd43b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252364ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd43b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252364ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55452/0 (socket says 172.21.15.31:55452) 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd43b400640 1 -- 172.21.15.31:0/533204432 learned_addr learned my addr 172.21.15.31:0/533204432 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.469+0000 7fd432000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c25236cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 -- 172.21.15.31:0/533204432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 msgr2=0x55c25236a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 -- 172.21.15.31:0/533204432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 msgr2=0x55c252364ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252364ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 -- 172.21.15.31:0/533204432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c251fdc210 con 0x55c25236a730 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd432000640 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c25236cbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005fd0 tx=0x7fd42c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169758c47a2c8f20 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.470+0000 7fd433e00640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 0x7fd4200a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.471+0000 7fd433e00640 1 -- 172.21.15.31:0/1228314337 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd4240ef9a0 con 0x7fd43c1002e0 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.471+0000 7fd42b400640 1 -- 172.21.15.31:0/533204432 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c003b70 con 0x55c25236a730 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.471+0000 7fd42b400640 1 -- 172.21.15.31:0/533204432 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd42c003d10 con 0x55c25236a730 2024-06-02T22:43:08.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.471+0000 7fd42b400640 1 -- 172.21.15.31:0/533204432 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c011900 con 0x55c25236a730 2024-06-02T22:43:08.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.471+0000 7fd43b400640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 0x7fd4200a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 -- 172.21.15.31:0/533204432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 msgr2=0x55c25236cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c25236cbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd42c005fd0 tx=0x7fd42c00f730 comp rx=0 tx=0).stop 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd43b400640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 0x7fd4200a5170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55c252365e20 tx=0x7fd434005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 -- 172.21.15.31:0/533204432 shutdown_connections 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c25236cbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 --2- 172.21.15.31:0/533204432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252364ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.473+0000 7fd4443ef740 1 -- 172.21.15.31:0/533204432 >> 172.21.15.31:0/533204432 conn(0x55c25232cf80 msgr2=0x55c252360650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.474+0000 7fd4443ef740 1 -- 172.21.15.31:0/533204432 shutdown_connections 2024-06-02T22:43:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.474+0000 7fd4443ef740 1 -- 172.21.15.31:0/533204432 wait complete. 2024-06-02T22:43:08.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.474+0000 7fd4443ef740 1 -- start start 2024-06-02T22:43:08.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 Processor -- start 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252376490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c25236d6e0 con 0x55c25236a730 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2522830b0 con 0x55c252364bd0 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c25236d860 con 0x55c2523655c0 2024-06-02T22:43:08.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.475+0000 7fd4443ef740 10 client.0 _ll_register_callbacks cb 0x55c25226ef40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48570/0 (socket says 172.21.15.31:48570) 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 -- 172.21.15.31:0/2696644727 learned_addr learned my addr 172.21.15.31:0/2696644727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd432000640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43b400640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252376490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 -- 172.21.15.31:0/2696644727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 msgr2=0x55c25236f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 -- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 msgr2=0x55c252376490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252376490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 -- 172.21.15.31:0/2696644727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2520a8620 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd43aa00640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd424006010 tx=0x7fd424009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7264d332a96c682 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.476+0000 7fd41fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240f5020 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd424003800 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd42c003d10 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd424049070 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd4443ef740 10 client.25637 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.477+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c252379800 con 0x55c252364bd0 2024-06-02T22:43:08.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.478+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd42c003d10 con 0x55c252364bd0 2024-06-02T22:43:08.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.478+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd4240b8480 con 0x55c252364bd0 2024-06-02T22:43:08.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.479+0000 7fd4443ef740 10 client.25637 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:08.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.479+0000 7fd4443ef740 10 client.25637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:08.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.479+0000 7fd4443ef740 20 client.25637 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:08.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.479+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c25237af60 0x55c25237d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.480+0000 7fd4443ef740 4 client.25637 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:43:08.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.480+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2522d5b50 con 0x55c25237af60 2024-06-02T22:43:08.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.481+0000 7fd432000640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c25237af60 0x55c25237d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.483+0000 7fd432000640 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c25237af60 0x55c25237d420 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d656d07061ccae3 server_cookie=fefcd929183ada30 in_seq=0 out_seq=0 2024-06-02T22:43:08.482 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.483+0000 7fd41fe00640 10 client.25637 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.484+0000 7fd41fe00640 1 -- 172.21.15.31:0/2696644727 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c2522d5b50 con 0x55c25237af60 2024-06-02T22:43:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.484+0000 7fd41fe00640 10 client.25637 handle_command_reply: tid=0 2024-06-02T22:43:08.483 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.484+0000 7fd4443ef740 1 client.25637 shutdown 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.485+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 msgr2=0x55c25236ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd424006010 tx=0x7fd424009620 comp rx=0 tx=0).stop 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 shutdown_connections 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c25237af60 0x55c25237d420 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252376490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.485 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c25236f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 --2- 172.21.15.31:0/2696644727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236ef10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd41fe00640 0 client.25637 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.486+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 >> 172.21.15.31:0/2696644727 conn(0x55c25232cf80 msgr2=0x55c25235f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.487+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 shutdown_connections 2024-06-02T22:43:08.486 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.487+0000 7fd4443ef740 1 -- 172.21.15.31:0/2696644727 wait complete. 2024-06-02T22:43:08.487 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.487+0000 7fd4443ef740 20 client.25637 trim_cache size 0 max 16384 2024-06-02T22:43:08.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.521+0000 7fd4443ef740 1 Processor -- start 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.521+0000 7fd4443ef740 1 -- start start 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.521+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c252376420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252381ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd4443ef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1b92d0 con 0x55c25236a730 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd4443ef740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1bae10 con 0x55c252364bd0 2024-06-02T22:43:08.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd4443ef740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1b99a0 con 0x55c2523655c0 2024-06-02T22:43:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48582/0 (socket says 172.21.15.31:48582) 2024-06-02T22:43:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 -- 172.21.15.31:0/3271812575 learned_addr learned my addr 172.21.15.31:0/3271812575 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd432000640 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c252376420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43b400640 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252381ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 -- 172.21.15.31:0/3271812575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 msgr2=0x55c252376420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c252376420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 -- 172.21.15.31:0/3271812575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 msgr2=0x55c252381ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252381ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.522+0000 7fd43aa00640 1 -- 172.21.15.31:0/3271812575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2523659a0 con 0x55c252364bd0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.523+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd4240bbb10 tx=0x7fd424005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e990ed20ad515ec server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.523+0000 7fd42aa00640 1 -- 172.21.15.31:0/3271812575 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424005d50 con 0x55c252364bd0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.523+0000 7fd42aa00640 1 -- 172.21.15.31:0/3271812575 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4240bc510 con 0x55c252364bd0 2024-06-02T22:43:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.523+0000 7fd42aa00640 1 -- 172.21.15.31:0/3271812575 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240bb770 con 0x55c252364bd0 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 -- 172.21.15.31:0/3271812575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 msgr2=0x55c25236f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd4240bbb10 tx=0x7fd424005c90 comp rx=0 tx=0).stop 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 -- 172.21.15.31:0/3271812575 shutdown_connections 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c25236a730 0x55c252381ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c252376420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3271812575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c252364bd0 0x55c25236f230 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.524+0000 7fd4443ef740 1 -- 172.21.15.31:0/3271812575 >> 172.21.15.31:0/3271812575 conn(0x55c25232cf80 msgr2=0x55c25236eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.526+0000 7fd4443ef740 1 -- 172.21.15.31:0/3271812575 shutdown_connections 2024-06-02T22:43:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.530+0000 7fd4443ef740 1 -- 172.21.15.31:0/3271812575 wait complete. 2024-06-02T22:43:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.530+0000 7fd4443ef740 1 -- start start 2024-06-02T22:43:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.530+0000 7fd4443ef740 1 Processor -- start 2024-06-02T22:43:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252373d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c2523742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c2523752c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1ba740 con 0x55c252364bd0 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1ba070 con 0x55c25236a730 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c1b72b0 con 0x55c2523655c0 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.532+0000 7fd4443ef740 10 client.0 _ll_register_callbacks cb 0x7fd4240f5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.533+0000 7fd432000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c2523742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.533+0000 7fd432000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c2523742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37934/0 (socket says 172.21.15.31:37934) 2024-06-02T22:43:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.533+0000 7fd432000640 1 -- 172.21.15.31:0/3399418889 learned_addr learned my addr 172.21.15.31:0/3399418889 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.535+0000 7fd43b400640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c2523752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.535+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252373d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.535+0000 7fd43b400640 1 -- 172.21.15.31:0/3399418889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 msgr2=0x55c2523742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.535+0000 7fd43b400640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c2523742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.535+0000 7fd43b400640 1 -- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 msgr2=0x55c252373d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.536+0000 7fd43b400640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252373d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.536+0000 7fd43b400640 1 -- 172.21.15.31:0/3399418889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2523758b0 con 0x55c25236a730 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.536+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252373d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.537+0000 7fd43b400640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c2523752c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd434012cb0 tx=0x7fd4340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddc104d7df496264 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.537+0000 7fd41fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:43:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.538+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434009c10 con 0x55c25236a730 2024-06-02T22:43:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.538+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd434018030 con 0x55c25236a730 2024-06-02T22:43:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.538+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4240bc510 con 0x55c25236a730 2024-06-02T22:43:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.539+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd434005020 con 0x55c25236a730 2024-06-02T22:43:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.539+0000 7fd4443ef740 10 client.25643 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.539+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c2523e5f70 con 0x55c25236a730 2024-06-02T22:43:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4340047a0 con 0x55c25236a730 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd434028790 con 0x55c25236a730 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 10 client.25643 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 20 client.25643 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c2523e6990 0x55c2523e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 4 client.25643 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:43:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.540+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd4240bc510 con 0x55c2523e6990 2024-06-02T22:43:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.543+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c2523e6990 0x55c2523e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.546+0000 7fd43aa00640 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c2523e6990 0x55c2523e8db0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa395c548ef73b2 server_cookie=517f40992cd8516b in_seq=0 out_seq=0 2024-06-02T22:43:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.546+0000 7fd41fe00640 10 client.25643 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.845+0000 7fd41fe00640 1 -- 172.21.15.31:0/3399418889 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fd4240bc510 con 0x55c2523e6990 2024-06-02T22:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.845+0000 7fd41fe00640 10 client.25643 handle_command_reply: tid=0 2024-06-02T22:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.845+0000 7fd4443ef740 1 client.25643 shutdown 2024-06-02T22:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 msgr2=0x55c2523752c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c2523752c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd434012cb0 tx=0x7fd4340046c0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 shutdown_connections 2024-06-02T22:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c2523e6990 0x55c2523e8db0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c25236a730 0x55c2523752c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c2523655c0 0x55c2523742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 --2- 172.21.15.31:0/3399418889 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c252364bd0 0x55c252373d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 >> 172.21.15.31:0/3399418889 conn(0x55c25232cf80 msgr2=0x55c25236ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd41fe00640 0 client.25643 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.847+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 shutdown_connections 2024-06-02T22:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.848+0000 7fd4443ef740 1 -- 172.21.15.31:0/3399418889 wait complete. 2024-06-02T22:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.848+0000 7fd4443ef740 20 client.25643 trim_cache size 0 max 16384 2024-06-02T22:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.849+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 msgr2=0x7fd4200a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.849+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 0x7fd4200a5170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55c252365e20 tx=0x7fd434005f90 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.849+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 msgr2=0x7fd43c105e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.849+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd424031440 tx=0x7fd424032ce0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.849+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 shutdown_connections 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd4200a2cb0 0x7fd4200a5170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd43c1015e0 0x7fd43c10b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c100c40 0x7fd43c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 --2- 172.21.15.31:0/1228314337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd43c1002e0 0x7fd43c105e90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 >> 172.21.15.31:0/1228314337 conn(0x7fd43c0fbe60 msgr2=0x7fd43c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 shutdown_connections 2024-06-02T22:43:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:08.850+0000 7fd441600640 1 -- 172.21.15.31:0/1228314337 wait complete. 2024-06-02T22:43:09.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:09 smithi098 ceph-mon[36750]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 567 op/s 2024-06-02T22:43:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:09 smithi178 ceph-mon[36614]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 567 op/s 2024-06-02T22:43:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:09 smithi031 ceph-mon[31767]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 567 op/s 2024-06-02T22:43:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 345.0 s, 787.0 tps, lat 129.222 ms stddev 147.298 2024-06-02T22:43:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:11 smithi098 ceph-mon[36750]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 509 op/s 2024-06-02T22:43:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:11 smithi178 ceph-mon[36614]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 509 op/s 2024-06-02T22:43:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:11 smithi031 ceph-mon[31767]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 10 MiB/s wr, 509 op/s 2024-06-02T22:43:13.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:13 smithi098 ceph-mon[36750]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 696 op/s 2024-06-02T22:43:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:13 smithi178 ceph-mon[36614]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 696 op/s 2024-06-02T22:43:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:13 smithi031 ceph-mon[31767]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 696 op/s 2024-06-02T22:43:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 350.0 s, 690.8 tps, lat 147.554 ms stddev 195.176 2024-06-02T22:43:15.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:15 smithi098 ceph-mon[36750]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 549 op/s 2024-06-02T22:43:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:15 smithi178 ceph-mon[36614]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 549 op/s 2024-06-02T22:43:16.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:15 smithi031 ceph-mon[31767]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 549 op/s 2024-06-02T22:43:17.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:17 smithi098 ceph-mon[36750]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 640 op/s 2024-06-02T22:43:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:17 smithi178 ceph-mon[36614]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 640 op/s 2024-06-02T22:43:18.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:17 smithi031 ceph-mon[31767]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 12 MiB/s wr, 640 op/s 2024-06-02T22:43:19.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:19 smithi098 ceph-mon[36750]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 603 op/s 2024-06-02T22:43:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:19 smithi178 ceph-mon[36614]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 603 op/s 2024-06-02T22:43:20.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:19 smithi031 ceph-mon[31767]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 603 op/s 2024-06-02T22:43:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 355.0 s, 712.0 tps, lat 136.154 ms stddev 194.233 2024-06-02T22:43:21.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:21 smithi098 ceph-mon[36750]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-06-02T22:43:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.053+0000 7f179b200640 1 -- 172.21.15.31:0/2385340729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1794075980 msgr2=0x7f1794073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.053+0000 7f179b200640 1 --2- 172.21.15.31:0/2385340729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1794075980 0x7f1794073dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f178c009ca0 tx=0x7f178c02a950 comp rx=0 tx=0).stop 2024-06-02T22:43:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.054+0000 7f179b200640 1 -- 172.21.15.31:0/2385340729 shutdown_connections 2024-06-02T22:43:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.054+0000 7f179b200640 1 --2- 172.21.15.31:0/2385340729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1794109890 0x7f179410bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.054+0000 7f179b200640 1 --2- 172.21.15.31:0/2385340729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17940743a0 0x7f1794074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.054+0000 7f179b200640 1 --2- 172.21.15.31:0/2385340729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1794075980 0x7f1794073dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.054+0000 7f179b200640 1 -- 172.21.15.31:0/2385340729 >> 172.21.15.31:0/2385340729 conn(0x7f17940fcf90 msgr2=0x7f17940ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.057+0000 7f179b200640 1 -- 172.21.15.31:0/2385340729 shutdown_connections 2024-06-02T22:43:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.057+0000 7f179b200640 1 -- 172.21.15.31:0/2385340729 wait complete. 2024-06-02T22:43:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.058+0000 7f179b200640 1 Processor -- start 2024-06-02T22:43:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 -- start start 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1794075980 0x7f179419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1794109890 0x7f17941a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f179410f920 con 0x7f1794075980 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f179410f7a0 con 0x7f1794109890 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f179b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f179410faa0 con 0x7f17940743a0 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f1793e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.059+0000 7f1793e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51836/0 (socket says 172.21.15.31:51836) 2024-06-02T22:43:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 -- 172.21.15.31:0/3799589845 learned_addr learned my addr 172.21.15.31:0/3799589845 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:21 smithi178 ceph-mon[36614]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-06-02T22:43:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 -- 172.21.15.31:0/3799589845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1794109890 msgr2=0x7f17941a1430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:43:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1794109890 0x7f17941a1430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 -- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1794075980 msgr2=0x7f179419a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1794075980 0x7f179419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.060+0000 7f1793e00640 1 -- 172.21.15.31:0/3799589845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17941a1aa0 con 0x7f17940743a0 2024-06-02T22:43:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.063+0000 7f1793e00640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f178c02f870 tx=0x7f178c031eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.063+0000 7f1790c00640 1 -- 172.21.15.31:0/3799589845 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c034040 con 0x7f17940743a0 2024-06-02T22:43:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.063+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17941a1d30 con 0x7f17940743a0 2024-06-02T22:43:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.063+0000 7f1790c00640 1 -- 172.21.15.31:0/3799589845 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178c003e00 con 0x7f17940743a0 2024-06-02T22:43:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.063+0000 7f1790c00640 1 -- 172.21.15.31:0/3799589845 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c045480 con 0x7f17940743a0 2024-06-02T22:43:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.064+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17941a2290 con 0x7f17940743a0 2024-06-02T22:43:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.072+0000 7f1790c00640 1 -- 172.21.15.31:0/3799589845 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f178c037020 con 0x7f17940743a0 2024-06-02T22:43:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.076+0000 7f1790c00640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 0x7f17780a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.077+0000 7f1790c00640 1 -- 172.21.15.31:0/3799589845 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f178c0efff0 con 0x7f17940743a0 2024-06-02T22:43:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.077+0000 7f1793400640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 0x7f17780a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.079+0000 7f179e1d5740 1 Processor -- start 2024-06-02T22:43:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.079+0000 7f179e1d5740 1 -- start start 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.079+0000 7f1793400640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 0x7f17780a50f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f179419b390 tx=0x7f1784006c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.079+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda09bd0 0x5643cda09ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.079+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda0f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f179e1d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5643cd96d420 con 0x5643cda09bd0 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f179e1d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643cd914c50 con 0x5643cda0f730 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f179e1d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5643cd9693e0 con 0x5643cda0a5c0 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47904/0 (socket says 172.21.15.31:47904) 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 -- 172.21.15.31:0/4211670996 learned_addr learned my addr 172.21.15.31:0/4211670996 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1793400640 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda0f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 -- 172.21.15.31:0/4211670996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 msgr2=0x5643cda0f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda0f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 -- 172.21.15.31:0/4211670996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda09bd0 msgr2=0x5643cda09ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda09bd0 0x5643cda09ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.080+0000 7f1799200640 1 -- 172.21.15.31:0/4211670996 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643cd681210 con 0x5643cda0f730 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.081+0000 7f1799200640 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f178000ba00 tx=0x7f178000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c1fa834d45758c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.081+0000 7f1789600640 1 -- 172.21.15.31:0/4211670996 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780016070 con 0x5643cda0f730 2024-06-02T22:43:22.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.081+0000 7f1789600640 1 -- 172.21.15.31:0/4211670996 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1780005500 con 0x5643cda0f730 2024-06-02T22:43:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.081+0000 7f1789600640 1 -- 172.21.15.31:0/4211670996 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780010460 con 0x5643cda0f730 2024-06-02T22:43:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.082+0000 7f179e1d5740 1 -- 172.21.15.31:0/4211670996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 msgr2=0x5643cda11bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.082+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f178000ba00 tx=0x7f178000bec0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 -- 172.21.15.31:0/4211670996 shutdown_connections 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda11bc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda0f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4211670996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda09bd0 0x5643cda09ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 -- 172.21.15.31:0/4211670996 >> 172.21.15.31:0/4211670996 conn(0x5643cd9d1f80 msgr2=0x5643cda05650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 -- 172.21.15.31:0/4211670996 shutdown_connections 2024-06-02T22:43:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.086+0000 7f179e1d5740 1 -- 172.21.15.31:0/4211670996 wait complete. 2024-06-02T22:43:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.087+0000 7f179e1d5740 1 -- start start 2024-06-02T22:43:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.089+0000 7f179e1d5740 1 Processor -- start 2024-06-02T22:43:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 0x5643cda1ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda23c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5643cda126e0 con 0x5643cda0a5c0 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643cd9280b0 con 0x5643cda0f730 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5643cda12860 con 0x5643cda09bd0 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f179e1d5740 10 client.0 _ll_register_callbacks cb 0x5643cd913f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f1793e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f1793e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51860/0 (socket says 172.21.15.31:51860) 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.091+0000 7f1793e00640 1 -- 172.21.15.31:0/3436828449 learned_addr learned my addr 172.21.15.31:0/3436828449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.092+0000 7f1793e00640 1 -- 172.21.15.31:0/3436828449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 msgr2=0x5643cda23c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.092+0000 7f1793e00640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda23c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.092+0000 7f1793e00640 1 -- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 msgr2=0x5643cda1ccc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:43:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f1793400640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 0x5643cda1ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f1793e00640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 0x5643cda1ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f1793e00640 1 -- 172.21.15.31:0/3436828449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643cd74d620 con 0x5643cda09bd0 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f1793400640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 0x5643cda1ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f1793e00640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f178c009dc0 tx=0x7f178c0bbf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e41ea48b9f2dddb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.093+0000 7f177e000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.094+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0bc990 con 0x5643cda09bd0 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.094+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f178c0c4c80 con 0x5643cda09bd0 2024-06-02T22:43:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.094+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1780005500 con 0x5643cda09bd0 2024-06-02T22:43:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.095+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f178c0bc530 con 0x5643cda09bd0 2024-06-02T22:43:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.095+0000 7f179e1d5740 10 client.25657 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.095+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5643cda126e0 con 0x5643cda09bd0 2024-06-02T22:43:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.096+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1780005500 con 0x5643cda09bd0 2024-06-02T22:43:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f178c0bb980 con 0x5643cda09bd0 2024-06-02T22:43:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 10 client.25657 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 20 client.25657 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda286d0 0x5643cda2ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 4 client.25657 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:43:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.097+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643cd97ab50 con 0x5643cda286d0 2024-06-02T22:43:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.100+0000 7f1793400640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda286d0 0x5643cda2ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.104+0000 7f177e000640 10 client.25657 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.104+0000 7f1793400640 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda286d0 0x5643cda2ab00 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1447ec552aba2606 server_cookie=20a749d20b22717f in_seq=0 out_seq=0 2024-06-02T22:43:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.105+0000 7f177e000640 1 -- 172.21.15.31:0/3436828449 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5643cd97ab50 con 0x5643cda286d0 2024-06-02T22:43:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.105+0000 7f177e000640 10 client.25657 handle_command_reply: tid=0 2024-06-02T22:43:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.105+0000 7f179e1d5740 1 client.25657 shutdown 2024-06-02T22:43:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 msgr2=0x5643cda1c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f178c009dc0 tx=0x7f178c0bbf50 comp rx=0 tx=0).stop 2024-06-02T22:43:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 shutdown_connections 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda286d0 0x5643cda2ab00 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0f730 0x5643cda23c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0a5c0 0x5643cda1ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f177e000640 0 client.25657 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3436828449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda09bd0 0x5643cda1c780 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f178c009dc0 tx=0x7f178c0bbf50 comp rx=0 tx=0).stop 2024-06-02T22:43:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.106+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 >> 172.21.15.31:0/3436828449 conn(0x5643cd9d1f80 msgr2=0x5643cda04810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.108+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 shutdown_connections 2024-06-02T22:43:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.108+0000 7f179e1d5740 1 -- 172.21.15.31:0/3436828449 wait complete. 2024-06-02T22:43:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.108+0000 7f179e1d5740 20 client.25657 trim_cache size 0 max 16384 2024-06-02T22:43:22.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:21 smithi031 ceph-mon[31767]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-06-02T22:43:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.148+0000 7f179e1d5740 1 Processor -- start 2024-06-02T22:43:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.148+0000 7f179e1d5740 1 -- start start 2024-06-02T22:43:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda054d0 0x5643cda1c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a8420 con 0x5643cda054d0 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a9f60 con 0x5643cda0a5c0 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f179e1d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a8af0 con 0x5643cda0f730 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f1793400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f1793e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f1793400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51864/0 (socket says 172.21.15.31:51864) 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f1793e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47910/0 (socket says 172.21.15.31:47910) 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.149+0000 7f1793400640 1 -- 172.21.15.31:0/4203112582 learned_addr learned my addr 172.21.15.31:0/4203112582 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 -- 172.21.15.31:0/4203112582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 msgr2=0x5643cda04f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 -- 172.21.15.31:0/4203112582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda054d0 msgr2=0x5643cda1c390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:43:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda054d0 0x5643cda1c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 -- 172.21.15.31:0/4203112582 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643cda09160 con 0x5643cda0f730 2024-06-02T22:43:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793e00640 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:43:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1793400640 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1784006fd0 tx=0x7f1784011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95eb9b5be69d61eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1788c00640 1 -- 172.21.15.31:0/4203112582 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178400bab0 con 0x5643cda0f730 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1788c00640 1 -- 172.21.15.31:0/4203112582 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178400bc50 con 0x5643cda0f730 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.150+0000 7f1788c00640 1 -- 172.21.15.31:0/4203112582 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178402a610 con 0x5643cda0f730 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 -- 172.21.15.31:0/4203112582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 msgr2=0x5643cda23c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1784006fd0 tx=0x7f1784011000 comp rx=0 tx=0).stop 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 -- 172.21.15.31:0/4203112582 shutdown_connections 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda054d0 0x5643cda1c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0f730 0x5643cda23c50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 --2- 172.21.15.31:0/4203112582 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda0a5c0 0x5643cda04f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.152+0000 7f179e1d5740 1 -- 172.21.15.31:0/4203112582 >> 172.21.15.31:0/4203112582 conn(0x5643cd9d1f80 msgr2=0x5643cda08540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.153+0000 7f179e1d5740 1 -- 172.21.15.31:0/4203112582 shutdown_connections 2024-06-02T22:43:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.153+0000 7f179e1d5740 1 -- 172.21.15.31:0/4203112582 wait complete. 2024-06-02T22:43:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.153+0000 7f179e1d5740 1 -- start start 2024-06-02T22:43:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.154+0000 7f179e1d5740 1 Processor -- start 2024-06-02T22:43:22.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.155+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.155+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.155+0000 7f179e1d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0f730 0x5643cda22590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f1793e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f1793e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47916/0 (socket says 172.21.15.31:47916) 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f1793400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f1793400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51880/0 (socket says 172.21.15.31:51880) 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f1793e00640 1 -- 172.21.15.31:0/3116562977 learned_addr learned my addr 172.21.15.31:0/3116562977 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:22.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a9890 con 0x5643cda0f730 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a91c0 con 0x5643cda054d0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17941a6400 con 0x5643cda0a5c0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.156+0000 7f179e1d5740 10 client.0 _ll_register_callbacks cb 0x7f178c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1799200640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0f730 0x5643cda22590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 -- 172.21.15.31:0/3116562977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 msgr2=0x5643cda1f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 -- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0f730 msgr2=0x5643cda22590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0f730 0x5643cda22590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643cda22b80 con 0x5643cda054d0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793400640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f1793e00640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f80 tx=0x7f178c02a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb2d76959f010c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:22.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.157+0000 7f177e000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:43:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.159+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c0bc070 con 0x5643cda054d0 2024-06-02T22:43:22.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.159+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f178c0b8280 con 0x5643cda054d0 2024-06-02T22:43:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.160+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f178400bc50 con 0x5643cda054d0 2024-06-02T22:43:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.160+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f178c0bc300 con 0x5643cda054d0 2024-06-02T22:43:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.160+0000 7f179e1d5740 10 client.25655 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:22.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.160+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5643cda23e90 con 0x5643cda054d0 2024-06-02T22:43:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f178400bc50 con 0x5643cda054d0 2024-06-02T22:43:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f178c083b40 con 0x5643cda054d0 2024-06-02T22:43:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 10 client.25655 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:22.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 10 client.25655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:22.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 20 client.25655 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:22.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda17060 0x5643cda19480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:22.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 4 client.25655 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:43:22.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.161+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643cd974ea0 con 0x5643cda17060 2024-06-02T22:43:22.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.162+0000 7f1793400640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda17060 0x5643cda19480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.163+0000 7f1793400640 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda17060 0x5643cda19480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a733bf7dd3bfeb server_cookie=51e8aa7a3c7f5187 in_seq=0 out_seq=0 2024-06-02T22:43:22.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.163+0000 7f177e000640 10 client.25655 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.242+0000 7f177e000640 1 -- 172.21.15.31:0/3116562977 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5643cd974ea0 con 0x5643cda17060 2024-06-02T22:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.242+0000 7f177e000640 10 client.25655 handle_command_reply: tid=0 2024-06-02T22:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.242+0000 7f179e1d5740 1 client.25655 shutdown 2024-06-02T22:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 msgr2=0x5643cda1f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f80 tx=0x7f178c02a950 comp rx=0 tx=0).stop 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 shutdown_connections 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5643cda17060 0x5643cda19480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5643cda0f730 0x5643cda22590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643cda0a5c0 0x5643cda1f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 --2- 172.21.15.31:0/3116562977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643cda054d0 0x5643cda1f0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 >> 172.21.15.31:0/3116562977 conn(0x5643cd9d1f80 msgr2=0x5643cda1c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.243+0000 7f177e000640 0 client.25655 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.244+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 shutdown_connections 2024-06-02T22:43:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.244+0000 7f179e1d5740 1 -- 172.21.15.31:0/3116562977 wait complete. 2024-06-02T22:43:22.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.245+0000 7f179e1d5740 20 client.25655 trim_cache size 0 max 16384 2024-06-02T22:43:22.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:43:22.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:43:22.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:43:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.248+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 msgr2=0x7f17780a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.248+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 0x7f17780a50f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f179419b390 tx=0x7f1784006c80 comp rx=0 tx=0).stop 2024-06-02T22:43:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.248+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 msgr2=0x7f1794199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:22.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.248+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f178c02f870 tx=0x7f178c031eb0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 shutdown_connections 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f17780a2c30 0x7f17780a50f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1794109890 0x7f17941a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1794075980 0x7f179419a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 --2- 172.21.15.31:0/3799589845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17940743a0 0x7f1794199e80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.249+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 >> 172.21.15.31:0/3799589845 conn(0x7f17940fcf90 msgr2=0x7f1794105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:22.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.250+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 shutdown_connections 2024-06-02T22:43:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:22.250+0000 7f179b200640 1 -- 172.21.15.31:0/3799589845 wait complete. 2024-06-02T22:43:23.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:23 smithi098 ceph-mon[36750]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:43:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:23 smithi178 ceph-mon[36614]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:43:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:23 smithi031 ceph-mon[31767]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 679 op/s 2024-06-02T22:43:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 360.0 s, 700.0 tps, lat 140.575 ms stddev 199.299 2024-06-02T22:43:25.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:25 smithi098 ceph-mon[36750]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 505 op/s 2024-06-02T22:43:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:25 smithi178 ceph-mon[36614]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 505 op/s 2024-06-02T22:43:26.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:25 smithi031 ceph-mon[31767]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 505 op/s 2024-06-02T22:43:27.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:27 smithi098 ceph-mon[36750]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 598 op/s 2024-06-02T22:43:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:27 smithi178 ceph-mon[36614]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 598 op/s 2024-06-02T22:43:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:27 smithi031 ceph-mon[31767]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 598 op/s 2024-06-02T22:43:29.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:29 smithi098 ceph-mon[36750]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-06-02T22:43:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:29 smithi178 ceph-mon[36614]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-06-02T22:43:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:29 smithi031 ceph-mon[31767]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 601 op/s 2024-06-02T22:43:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 365.0 s, 762.0 tps, lat 135.280 ms stddev 192.008 2024-06-02T22:43:32.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:31 smithi178 ceph-mon[36614]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 MiB/s wr, 507 op/s 2024-06-02T22:43:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:31 smithi031 ceph-mon[31767]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 MiB/s wr, 507 op/s 2024-06-02T22:43:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:31 smithi098 ceph-mon[36750]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.6 MiB/s wr, 507 op/s 2024-06-02T22:43:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:33 smithi178 ceph-mon[36614]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 672 op/s 2024-06-02T22:43:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:33 smithi031 ceph-mon[31767]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 672 op/s 2024-06-02T22:43:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:33 smithi098 ceph-mon[36750]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 672 op/s 2024-06-02T22:43:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 370.0 s, 700.8 tps, lat 141.531 ms stddev 148.034 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 -- 172.21.15.31:0/3283893450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 msgr2=0x7f6928104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 --2- 172.21.15.31:0/3283893450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928104040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6920009ca0 tx=0x7f692002a8b0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 -- 172.21.15.31:0/3283893450 shutdown_connections 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 --2- 172.21.15.31:0/3283893450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69281057d0 0x7f692810c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 --2- 172.21.15.31:0/3283893450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6928104e10 0x7f6928105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 --2- 172.21.15.31:0/3283893450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928104040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 -- 172.21.15.31:0/3283893450 >> 172.21.15.31:0/3283893450 conn(0x7f69280ff190 msgr2=0x7f69281015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 -- 172.21.15.31:0/3283893450 shutdown_connections 2024-06-02T22:43:35.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.431+0000 7f692f400640 1 -- 172.21.15.31:0/3283893450 wait complete. 2024-06-02T22:43:35.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 Processor -- start 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 -- start start 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 0x7f692819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69281057d0 0x7f69281a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f692810f8f0 con 0x7f69281057d0 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f692810f770 con 0x7f6928103c20 2024-06-02T22:43:35.434 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.433+0000 7f692f400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f692810fa70 con 0x7f6928104e10 2024-06-02T22:43:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.434+0000 7f6927e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 0x7f692819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.434+0000 7f692ca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.434+0000 7f6927e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 0x7f692819a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54708/0 (socket says 172.21.15.31:54708) 2024-06-02T22:43:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.434+0000 7f692ca00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40574/0 (socket says 172.21.15.31:40574) 2024-06-02T22:43:35.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.434+0000 7f6927e00640 1 -- 172.21.15.31:0/1734688553 learned_addr learned my addr 172.21.15.31:0/1734688553 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.435+0000 7f692ca00640 1 -- 172.21.15.31:0/1734688553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 msgr2=0x7f692819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.435+0000 7f692ca00640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 0x7f692819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.435+0000 7f692ca00640 1 -- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69281057d0 msgr2=0x7f69281a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.435+0000 7f692ca00640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69281057d0 0x7f69281a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.435+0000 7f692ca00640 1 -- 172.21.15.31:0/1734688553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692806b4f0 con 0x7f6928103c20 2024-06-02T22:43:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.438+0000 7f692ca00640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f692002add0 tx=0x7f6920003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.439+0000 7f6925600640 1 -- 172.21.15.31:0/1734688553 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920004240 con 0x7f6928103c20 2024-06-02T22:43:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.439+0000 7f6925600640 1 -- 172.21.15.31:0/1734688553 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6920040070 con 0x7f6928103c20 2024-06-02T22:43:35.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.439+0000 7f6925600640 1 -- 172.21.15.31:0/1734688553 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6920031440 con 0x7f6928103c20 2024-06-02T22:43:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.440+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692806b780 con 0x7f6928103c20 2024-06-02T22:43:35.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.440+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f692806bc50 con 0x7f6928103c20 2024-06-02T22:43:35.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.447+0000 7f6925600640 1 -- 172.21.15.31:0/1734688553 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6920045600 con 0x7f6928103c20 2024-06-02T22:43:35.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.450+0000 7f69321c9740 1 Processor -- start 2024-06-02T22:43:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.450+0000 7f69321c9740 1 -- start start 2024-06-02T22:43:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.451+0000 7f6925600640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 0x7f690c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.451+0000 7f6925600640 1 -- 172.21.15.31:0/1734688553 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f69200f0920 con 0x7f6928103c20 2024-06-02T22:43:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.451+0000 7f692d400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 0x7f690c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.452 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b0a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556d88a65420 con 0x556d88b0a3e0 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556d88a0cc50 con 0x556d88b0ff40 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f69321c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d88a613e0 con 0x556d88b0add0 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.452+0000 7f692d400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 0x7f690c0a51f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6918005fd0 tx=0x7f6918005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40590/0 (socket says 172.21.15.31:40590) 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 -- 172.21.15.31:0/4053018658 learned_addr learned my addr 172.21.15.31:0/4053018658 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692ca00640 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b0a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 -- 172.21.15.31:0/4053018658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 msgr2=0x556d88b0f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 -- 172.21.15.31:0/4053018658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 msgr2=0x556d88b0a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b0a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.453+0000 7f692d400640 1 -- 172.21.15.31:0/4053018658 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d88779210 con 0x556d88b0ff40 2024-06-02T22:43:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.457+0000 7f692d400640 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f691800dd20 tx=0x7f6918010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5568d97b57e8a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.457+0000 7f691dc00640 1 -- 172.21.15.31:0/4053018658 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918017070 con 0x556d88b0ff40 2024-06-02T22:43:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.457+0000 7f691dc00640 1 -- 172.21.15.31:0/4053018658 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6918023070 con 0x556d88b0ff40 2024-06-02T22:43:35.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.457+0000 7f691dc00640 1 -- 172.21.15.31:0/4053018658 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691800f7e0 con 0x556d88b0ff40 2024-06-02T22:43:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 -- 172.21.15.31:0/4053018658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 msgr2=0x556d88b123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f691800dd20 tx=0x7f6918010000 comp rx=0 tx=0).stop 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 -- 172.21.15.31:0/4053018658 shutdown_connections 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b123d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b0f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 --2- 172.21.15.31:0/4053018658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b0a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.459+0000 7f69321c9740 1 -- 172.21.15.31:0/4053018658 >> 172.21.15.31:0/4053018658 conn(0x556d88ac9f80 msgr2=0x556d88afd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.460+0000 7f69321c9740 1 -- 172.21.15.31:0/4053018658 shutdown_connections 2024-06-02T22:43:35.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.460+0000 7f69321c9740 1 -- 172.21.15.31:0/4053018658 wait complete. 2024-06-02T22:43:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.461+0000 7f69321c9740 1 -- start start 2024-06-02T22:43:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.461+0000 7f69321c9740 1 Processor -- start 2024-06-02T22:43:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b146f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b1bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556d88b12e90 con 0x556d88b0a3e0 2024-06-02T22:43:35.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556d88a200b0 con 0x556d88b0ff40 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d88b13010 con 0x556d88b0add0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f6927e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f69321c9740 10 client.0 _ll_register_callbacks cb 0x556d88a0bf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f6927e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54728/0 (socket says 172.21.15.31:54728) 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.462+0000 7f6927e00640 1 -- 172.21.15.31:0/3449913911 learned_addr learned my addr 172.21.15.31:0/3449913911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f692d400640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b1bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f692ca00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f6927e00640 1 -- 172.21.15.31:0/3449913911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 msgr2=0x556d88b1bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f6927e00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b1bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f6927e00640 1 -- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 msgr2=0x556d88b146f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f6927e00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b146f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f6927e00640 1 -- 172.21.15.31:0/3449913911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d88845620 con 0x556d88b0add0 2024-06-02T22:43:35.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.463+0000 7f692ca00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.464+0000 7f6927e00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69100058c0 tx=0x7f691000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d7b9c4b46ce099 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.464+0000 7f6916000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:43:35.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.466+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691000fea0 con 0x556d88b0add0 2024-06-02T22:43:35.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.466+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6910004440 con 0x556d88b0add0 2024-06-02T22:43:35.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.466+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6918023070 con 0x556d88b0add0 2024-06-02T22:43:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.470+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69100035f0 con 0x556d88b0add0 2024-06-02T22:43:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.470+0000 7f69321c9740 10 client.25669 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.470+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556d88b1f0b0 con 0x556d88b0add0 2024-06-02T22:43:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.471+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6918023070 con 0x556d88b0add0 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6910011aa0 con 0x556d88b0add0 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 10 client.25669 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 10 client.25669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 20 client.25669 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b20750 0x556d88b22ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 4 client.25669 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.472+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d88a72b50 con 0x556d88b20750 2024-06-02T22:43:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.473+0000 7f692ca00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b20750 0x556d88b22ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.474+0000 7f692ca00640 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b20750 0x556d88b22ba0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=580daf5474ae4cd8 server_cookie=cda7b29f42e46266 in_seq=0 out_seq=0 2024-06-02T22:43:35.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.474+0000 7f6916000640 10 client.25669 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.476+0000 7f6916000640 1 -- 172.21.15.31:0/3449913911 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556d88a72b50 con 0x556d88b20750 2024-06-02T22:43:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.477+0000 7f6916000640 10 client.25669 handle_command_reply: tid=0 2024-06-02T22:43:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.477+0000 7f69321c9740 1 client.25669 shutdown 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 msgr2=0x556d88b14c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69100058c0 tx=0x7f691000f730 comp rx=0 tx=0).stop 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 shutdown_connections 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b20750 0x556d88b22ba0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b0ff40 0x556d88b1bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0add0 0x556d88b14c30 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69100058c0 tx=0x7f691000f730 comp rx=0 tx=0).stop 2024-06-02T22:43:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 --2- 172.21.15.31:0/3449913911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0a3e0 0x556d88b146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f6916000640 0 client.25669 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.479+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 >> 172.21.15.31:0/3449913911 conn(0x556d88ac9f80 msgr2=0x556d88afc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.483+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 shutdown_connections 2024-06-02T22:43:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.483+0000 7f69321c9740 1 -- 172.21.15.31:0/3449913911 wait complete. 2024-06-02T22:43:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.484+0000 7f69321c9740 20 client.25669 trim_cache size 0 max 16384 2024-06-02T22:43:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.518+0000 7f69321c9740 1 Processor -- start 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 -- start start 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b0c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0ff40 0x556d88b0c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6928071d50 con 0x556d88b0ff40 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6928073890 con 0x556d88b1bc30 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.522+0000 7f69321c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6928072420 con 0x556d88b0a3e0 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40604/0 (socket says 172.21.15.31:40604) 2024-06-02T22:43:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 -- 172.21.15.31:0/523687301 learned_addr learned my addr 172.21.15.31:0/523687301 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692ca00640 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b0c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 -- 172.21.15.31:0/523687301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 msgr2=0x556d88b0c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b0c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 -- 172.21.15.31:0/523687301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0ff40 msgr2=0x556d88b0c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0ff40 0x556d88b0c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692d400640 1 -- 172.21.15.31:0/523687301 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d88afe300 con 0x556d88b1bc30 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.523+0000 7f692ca00640 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b0c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.524+0000 7f692d400640 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f691800dd20 tx=0x7f6918010f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659ad89c9b9c6334 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.524+0000 7f691d200640 1 -- 172.21.15.31:0/523687301 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918017040 con 0x556d88b1bc30 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.524+0000 7f691d200640 1 -- 172.21.15.31:0/523687301 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6918023040 con 0x556d88b1bc30 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.524+0000 7f691d200640 1 -- 172.21.15.31:0/523687301 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918031cc0 con 0x556d88b1bc30 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.525+0000 7f69321c9740 1 -- 172.21.15.31:0/523687301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 msgr2=0x556d88b00510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.525+0000 7f69321c9740 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f691800dd20 tx=0x7f6918010f30 comp rx=0 tx=0).stop 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 -- 172.21.15.31:0/523687301 shutdown_connections 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b00510 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b0ff40 0x556d88b0c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 --2- 172.21.15.31:0/523687301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b0c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 -- 172.21.15.31:0/523687301 >> 172.21.15.31:0/523687301 conn(0x556d88ac9f80 msgr2=0x556d88afd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 -- 172.21.15.31:0/523687301 shutdown_connections 2024-06-02T22:43:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.526+0000 7f69321c9740 1 -- 172.21.15.31:0/523687301 wait complete. 2024-06-02T22:43:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.527+0000 7f69321c9740 1 -- start start 2024-06-02T22:43:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.527+0000 7f69321c9740 1 Processor -- start 2024-06-02T22:43:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.528+0000 7f69321c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.528+0000 7f69321c9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b17500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f69321c9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b1a460 0x556d88b1a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f692ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f692ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54734/0 (socket says 172.21.15.31:54734) 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f69280731c0 con 0x556d88b1a460 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6928072af0 con 0x556d88b1bc30 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f692806fd50 con 0x556d88b0a3e0 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f692ca00640 1 -- 172.21.15.31:0/3641339936 learned_addr learned my addr 172.21.15.31:0/3641339936 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f69321c9740 10 client.0 _ll_register_callbacks cb 0x7f691000b3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f692d400640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b1a460 0x556d88b1a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.529+0000 7f6927e00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b17500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 -- 172.21.15.31:0/3641339936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 msgr2=0x556d88b17500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b17500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 -- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b1a460 msgr2=0x556d88b1a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b1a460 0x556d88b1a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d88b1ae20 con 0x556d88b0a3e0 2024-06-02T22:43:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6918023040 con 0x556d88b0a3e0 2024-06-02T22:43:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f692ca00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6920009ca0 tx=0x7f69200459a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbe5437721ce74f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.530+0000 7f6916000640 10 client.25672 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:43:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.531+0000 7f6916000640 1 -- 172.21.15.31:0/3641339936 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69200c1140 con 0x556d88b0a3e0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.531+0000 7f6916000640 1 -- 172.21.15.31:0/3641339936 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f69200ee140 con 0x556d88b0a3e0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.531+0000 7f6916000640 1 -- 172.21.15.31:0/3641339936 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f69200c5a00 con 0x556d88b0a3e0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.531+0000 7f69321c9740 10 client.25672 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.531+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556d88b05d70 con 0x556d88b0a3e0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f6916000640 1 -- 172.21.15.31:0/3641339936 <== mon.1 v2:172.21.15.178:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f69200b9400 con 0x556d88b0a3e0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 10 client.25672 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 10 client.25672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 20 client.25672 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b065f0 0x556d88b08a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 4 client.25672 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d88a6cea0 con 0x556d88b065f0 2024-06-02T22:43:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.532+0000 7f6927e00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b065f0 0x556d88b08a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.533+0000 7f6927e00640 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b065f0 0x556d88b08a10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262c8a65d3b29c4b server_cookie=dcd7e77251dc335 in_seq=0 out_seq=0 2024-06-02T22:43:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.534+0000 7f6916000640 10 client.25672 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.635+0000 7f6916000640 1 -- 172.21.15.31:0/3641339936 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556d88a6cea0 con 0x556d88b065f0 2024-06-02T22:43:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.635+0000 7f6916000640 10 client.25672 handle_command_reply: tid=0 2024-06-02T22:43:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.635+0000 7f69321c9740 1 client.25672 shutdown 2024-06-02T22:43:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.635+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 msgr2=0x556d88b16fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.635+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6920009ca0 tx=0x7f69200459a0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 shutdown_connections 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d88b065f0 0x556d88b08a10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d88b1a460 0x556d88b1a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d88b1bc30 0x556d88b17500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 --2- 172.21.15.31:0/3641339936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d88b0a3e0 0x556d88b16fc0 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6920009ca0 tx=0x7f69200459a0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.636+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 >> 172.21.15.31:0/3641339936 conn(0x556d88ac9f80 msgr2=0x556d88b146d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.637+0000 7f6916000640 0 client.25672 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.637+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 shutdown_connections 2024-06-02T22:43:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.637+0000 7f69321c9740 1 -- 172.21.15.31:0/3641339936 wait complete. 2024-06-02T22:43:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.637+0000 7f69321c9740 20 client.25672 trim_cache size 0 max 16384 2024-06-02T22:43:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:43:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:43:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:43:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 msgr2=0x7f690c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 0x7f690c0a51f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6918005fd0 tx=0x7f6918005850 comp rx=0 tx=0).stop 2024-06-02T22:43:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 msgr2=0x7f6928199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f692002add0 tx=0x7f6920003ba0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 shutdown_connections 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f690c0a2d30 0x7f690c0a51f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69281057d0 0x7f69281a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6928104e10 0x7f692819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 --2- 172.21.15.31:0/1734688553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6928103c20 0x7f6928199e70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 >> 172.21.15.31:0/1734688553 conn(0x7f69280ff190 msgr2=0x7f6928108040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 shutdown_connections 2024-06-02T22:43:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:35.639+0000 7f692f400640 1 -- 172.21.15.31:0/1734688553 wait complete. 2024-06-02T22:43:36.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:35 smithi178 ceph-mon[36614]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 515 op/s 2024-06-02T22:43:36.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:35 smithi031 ceph-mon[31767]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 515 op/s 2024-06-02T22:43:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:35 smithi098 ceph-mon[36750]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.3 MiB/s wr, 515 op/s 2024-06-02T22:43:38.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:37 smithi178 ceph-mon[36614]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 584 op/s 2024-06-02T22:43:38.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:37 smithi031 ceph-mon[31767]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 584 op/s 2024-06-02T22:43:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:37 smithi098 ceph-mon[36750]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 584 op/s 2024-06-02T22:43:40.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:39 smithi178 ceph-mon[36614]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 591 op/s 2024-06-02T22:43:40.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:39 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:43:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:39 smithi031 ceph-mon[31767]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 591 op/s 2024-06-02T22:43:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:39 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:43:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:39 smithi098 ceph-mon[36750]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 MiB/s wr, 591 op/s 2024-06-02T22:43:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:39 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:43:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 375.0 s, 633.6 tps, lat 152.679 ms stddev 183.690 2024-06-02T22:43:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:41 smithi098 ceph-mon[36750]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 496 op/s 2024-06-02T22:43:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:41 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:41 smithi178 ceph-mon[36614]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 496 op/s 2024-06-02T22:43:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:41 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:41 smithi031 ceph-mon[31767]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 496 op/s 2024-06-02T22:43:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:41 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:43 smithi098 ceph-mon[36750]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 695 op/s 2024-06-02T22:43:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:43 smithi178 ceph-mon[36614]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 695 op/s 2024-06-02T22:43:44.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:43 smithi031 ceph-mon[31767]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 695 op/s 2024-06-02T22:43:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:45.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:44 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 380.0 s, 506.2 tps, lat 195.802 ms stddev 255.197 2024-06-02T22:43:45.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:45.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:44 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:45.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:45.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:44 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:45 smithi098 ceph-mon[36750]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 536 op/s 2024-06-02T22:43:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:45 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:45 smithi178 ceph-mon[36614]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 536 op/s 2024-06-02T22:43:46.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:45 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:45 smithi031 ceph-mon[31767]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.6 MiB/s wr, 536 op/s 2024-06-02T22:43:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:45 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:47 smithi098 ceph-mon[36750]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 599 op/s 2024-06-02T22:43:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:43:48.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:43:48.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:47 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:47 smithi178 ceph-mon[36614]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 599 op/s 2024-06-02T22:43:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:43:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:43:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:47 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:47 smithi031 ceph-mon[31767]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 599 op/s 2024-06-02T22:43:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:43:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:43:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:47 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:43:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.871+0000 7fdecda00640 1 -- 172.21.15.31:0/2045324279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 msgr2=0x7fdec8103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.871+0000 7fdecda00640 1 --2- 172.21.15.31:0/2045324279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8103070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009860 tx=0x7fdeb402a340 comp rx=0 tx=0).stop 2024-06-02T22:43:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 -- 172.21.15.31:0/2045324279 shutdown_connections 2024-06-02T22:43:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 --2- 172.21.15.31:0/2045324279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec81035b0 0x7fdec8109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 --2- 172.21.15.31:0/2045324279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8103070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 --2- 172.21.15.31:0/2045324279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec8101a00 0x7fdec8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 -- 172.21.15.31:0/2045324279 >> 172.21.15.31:0/2045324279 conn(0x7fdec80fcf90 msgr2=0x7fdec80ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 -- 172.21.15.31:0/2045324279 shutdown_connections 2024-06-02T22:43:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.873+0000 7fdecda00640 1 -- 172.21.15.31:0/2045324279 wait complete. 2024-06-02T22:43:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.875+0000 7fdecda00640 1 Processor -- start 2024-06-02T22:43:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.878+0000 7fdecda00640 1 -- start start 2024-06-02T22:43:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.878+0000 7fdecda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec8101a00 0x7fdec8075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.878+0000 7fdecda00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.878+0000 7fdecda00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 0x7fdec80742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdecda00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdec810d6b0 con 0x7fdec8101a00 2024-06-02T22:43:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdecda00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdec810d530 con 0x7fdec8102bf0 2024-06-02T22:43:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdec6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdec6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55526/0 (socket says 172.21.15.31:55526) 2024-06-02T22:43:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdec6000640 1 -- 172.21.15.31:0/1058793625 learned_addr learned my addr 172.21.15.31:0/1058793625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdec810d830 con 0x7fdec81035b0 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.879+0000 7fdec7400640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 0x7fdec80742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 -- 172.21.15.31:0/1058793625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 msgr2=0x7fdec8073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 -- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec8101a00 msgr2=0x7fdec8075750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec8101a00 0x7fdec8075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 -- 172.21.15.31:0/1058793625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec8074b60 con 0x7fdec81035b0 2024-06-02T22:43:48.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdec7400640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 0x7fdec80742d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800e970 tx=0x7fdeb800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.880+0000 7fdebf400640 1 -- 172.21.15.31:0/1058793625 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb800ccc0 con 0x7fdec81035b0 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.881+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec81a1de0 con 0x7fdec81035b0 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.881+0000 7fdec6000640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.881+0000 7fdebf400640 1 -- 172.21.15.31:0/1058793625 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeb8010910 con 0x7fdec81035b0 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.881+0000 7fdebf400640 1 -- 172.21.15.31:0/1058793625 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8018980 con 0x7fdec81035b0 2024-06-02T22:43:48.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.881+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec81a22a0 con 0x7fdec81035b0 2024-06-02T22:43:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.893+0000 7fded09ae740 1 Processor -- start 2024-06-02T22:43:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.893+0000 7fded09ae740 1 -- start start 2024-06-02T22:43:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f988d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f9b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558cc2eee420 con 0x558cc2f93dd0 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558cc2e95c50 con 0x558cc2f98f40 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.894+0000 7fded09ae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558cc2eea3e0 con 0x558cc2f933e0 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdebf400640 1 -- 172.21.15.31:0/1058793625 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fdeb8010ac0 con 0x7fdec81035b0 2024-06-02T22:43:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdec6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdec6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43656/0 (socket says 172.21.15.31:43656) 2024-06-02T22:43:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdec6000640 1 -- 172.21.15.31:0/3468641053 learned_addr learned my addr 172.21.15.31:0/3468641053 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdec6000640 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f9b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.895+0000 7fdec6a00640 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.896+0000 7fdec6000640 1 -- 172.21.15.31:0/3468641053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 msgr2=0x558cc2f9b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.896+0000 7fdec6000640 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f9b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.896+0000 7fdec6000640 1 -- 172.21.15.31:0/3468641053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 msgr2=0x558cc2f988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.896+0000 7fdec6000640 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.896+0000 7fdec6000640 1 -- 172.21.15.31:0/3468641053 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc2c02210 con 0x558cc2f933e0 2024-06-02T22:43:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.897+0000 7fdec6000640 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005b60 tx=0x7fdeb4030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414e88ed10c62518 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.897+0000 7fdeb3e00640 1 -- 172.21.15.31:0/3468641053 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4037070 con 0x558cc2f933e0 2024-06-02T22:43:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.898+0000 7fdeb3e00640 1 -- 172.21.15.31:0/3468641053 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeb40309c0 con 0x558cc2f933e0 2024-06-02T22:43:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.898+0000 7fdeb3e00640 1 -- 172.21.15.31:0/3468641053 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4003d00 con 0x558cc2f933e0 2024-06-02T22:43:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.898+0000 7fdebf400640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 0x7fdeac0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 -- 172.21.15.31:0/3468641053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 msgr2=0x558cc2f93800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005b60 tx=0x7fdeb4030340 comp rx=0 tx=0).stop 2024-06-02T22:43:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fdebf400640 1 -- 172.21.15.31:0/1058793625 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdeb80cf870 con 0x7fdec81035b0 2024-06-02T22:43:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 -- 172.21.15.31:0/3468641053 shutdown_connections 2024-06-02T22:43:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f9b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 --2- 172.21.15.31:0/3468641053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f93800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.899+0000 7fded09ae740 1 -- 172.21.15.31:0/3468641053 >> 172.21.15.31:0/3468641053 conn(0x558cc2f52f80 msgr2=0x558cc2f86650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.900+0000 7fdec6a00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 0x7fdeac0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.900+0000 7fded09ae740 1 -- 172.21.15.31:0/3468641053 shutdown_connections 2024-06-02T22:43:48.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.901+0000 7fded09ae740 1 -- 172.21.15.31:0/3468641053 wait complete. 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.902+0000 7fded09ae740 1 -- start start 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.903+0000 7fdec6a00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 0x7fdeac0a5240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558cc2f87500 tx=0x7fdec00097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.903+0000 7fded09ae740 1 Processor -- start 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.903+0000 7fded09ae740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 0x558cc2f8c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.903+0000 7fded09ae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2f8ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.903+0000 7fded09ae740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f91a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.904+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 0x558cc2f8c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 0x558cc2f8c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48732/0 (socket says 172.21.15.31:48732) 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fded09ae740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558cc2f8ac30 con 0x558cc2f933e0 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fded09ae740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558cc2ea90b0 con 0x558cc2f98f40 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fded09ae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558cc2f8adb0 con 0x558cc2f93dd0 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fdec6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2f8ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fdec7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f91a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fdec7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f91a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55550/0 (socket says 172.21.15.31:55550) 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fdec7400640 1 -- 172.21.15.31:0/781083743 learned_addr learned my addr 172.21.15.31:0/781083743 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.905+0000 7fded09ae740 10 client.0 _ll_register_callbacks cb 0x558cc2e94f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.906+0000 7fdec6000640 1 -- 172.21.15.31:0/781083743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 msgr2=0x558cc2f91a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.906+0000 7fdec6000640 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f91a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.906+0000 7fdec6000640 1 -- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 msgr2=0x558cc2f8c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.907+0000 7fdec6000640 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 0x558cc2f8c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.907+0000 7fdec6000640 1 -- 172.21.15.31:0/781083743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc2cce620 con 0x558cc2f93dd0 2024-06-02T22:43:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.909+0000 7fdec6000640 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2f8ca00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009230 tx=0x7fdeb4030cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adb5cd223e8f9f6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.909+0000 7fdeb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:43:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.909+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4037040 con 0x558cc2f93dd0 2024-06-02T22:43:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.909+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeb40309c0 con 0x558cc2f93dd0 2024-06-02T22:43:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.910+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdeb40307c0 con 0x558cc2f93dd0 2024-06-02T22:43:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.915+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdeb4059050 con 0x558cc2f93dd0 2024-06-02T22:43:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.915+0000 7fded09ae740 10 client.25684 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:48.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.915+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558cc2f8ac30 con 0x558cc2f93dd0 2024-06-02T22:43:48.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.916+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeb40309c0 con 0x558cc2f93dd0 2024-06-02T22:43:48.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.917+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdeb404b070 con 0x558cc2f93dd0 2024-06-02T22:43:48.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 10 client.25684 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:48.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 10 client.25684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 20 client.25684 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc2fb3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 4 client.25684 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:43:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.918+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cc2efbb50 con 0x558cc2fb1780 2024-06-02T22:43:48.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.919+0000 7fdec6a00640 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc2fb3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.920+0000 7fdec6a00640 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc2fb3b70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b01bee833328610 server_cookie=e1fbaccb9c2fcf43 in_seq=0 out_seq=0 2024-06-02T22:43:48.921 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.921+0000 7fdeb0c00640 10 client.25684 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.922+0000 7fdeb0c00640 1 -- 172.21.15.31:0/781083743 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558cc2efbb50 con 0x558cc2fb1780 2024-06-02T22:43:48.922 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.922+0000 7fdeb0c00640 10 client.25684 handle_command_reply: tid=0 2024-06-02T22:43:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.922+0000 7fded09ae740 1 client.25684 shutdown 2024-06-02T22:43:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.923+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 msgr2=0x558cc2f8ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.923+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2f8ca00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009230 tx=0x7fdeb4030cd0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.923+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 shutdown_connections 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.923+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc2fb3b70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.924+0000 7fdeb0c00640 0 client.25684 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.924+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f91a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.924+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2f8ca00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.924+0000 7fded09ae740 1 --2- 172.21.15.31:0/781083743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f933e0 0x558cc2f8c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.924 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.924+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 >> 172.21.15.31:0/781083743 conn(0x558cc2f52f80 msgr2=0x558cc2f85810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.925+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 shutdown_connections 2024-06-02T22:43:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.925+0000 7fded09ae740 1 -- 172.21.15.31:0/781083743 wait complete. 2024-06-02T22:43:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.926+0000 7fded09ae740 20 client.25684 trim_cache size 0 max 16384 2024-06-02T22:43:48.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.967+0000 7fded09ae740 1 Processor -- start 2024-06-02T22:43:48.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.967+0000 7fded09ae740 1 -- start start 2024-06-02T22:43:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.967+0000 7fded09ae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.967+0000 7fded09ae740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f89d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.967+0000 7fded09ae740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f85f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43688/0 (socket says 172.21.15.31:43688) 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fdec6a00640 1 -- 172.21.15.31:0/2150877269 learned_addr learned my addr 172.21.15.31:0/2150877269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a82a0 con 0x558cc2f93dd0 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fdec7400640 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f85f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a9de0 con 0x558cc2f98f40 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.969+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a8970 con 0x558cc2f933e0 2024-06-02T22:43:48.970 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.970+0000 7fdec6000640 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f89d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.970+0000 7fdec6a00640 1 -- 172.21.15.31:0/2150877269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 msgr2=0x558cc2f85f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.971+0000 7fdec6a00640 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f85f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.971+0000 7fdec6a00640 1 -- 172.21.15.31:0/2150877269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 msgr2=0x558cc2f89d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.971+0000 7fdec6a00640 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f89d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.971 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.971+0000 7fdec6a00640 1 -- 172.21.15.31:0/2150877269 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc2f937e0 con 0x558cc2f933e0 2024-06-02T22:43:48.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.972+0000 7fdec6a00640 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdec8102a50 tx=0x7fdec0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa341ba67d3a0469 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.972 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.972+0000 7fdeb3400640 1 -- 172.21.15.31:0/2150877269 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec002b070 con 0x558cc2f933e0 2024-06-02T22:43:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.973+0000 7fdeb3400640 1 -- 172.21.15.31:0/2150877269 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdec0030940 con 0x558cc2f933e0 2024-06-02T22:43:48.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.973+0000 7fdeb3400640 1 -- 172.21.15.31:0/2150877269 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0027880 con 0x558cc2f933e0 2024-06-02T22:43:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.977+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 msgr2=0x558cc2f8bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.977+0000 7fded09ae740 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdec8102a50 tx=0x7fdec0018000 comp rx=0 tx=0).stop 2024-06-02T22:43:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 shutdown_connections 2024-06-02T22:43:48.978 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f98f40 0x558cc2f85f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f93dd0 0x558cc2f89d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 --2- 172.21.15.31:0/2150877269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f933e0 0x558cc2f8bae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 >> 172.21.15.31:0/2150877269 conn(0x558cc2f52f80 msgr2=0x558cc2f89620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 shutdown_connections 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.978+0000 7fded09ae740 1 -- 172.21.15.31:0/2150877269 wait complete. 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.979+0000 7fded09ae740 1 -- start start 2024-06-02T22:43:48.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.979+0000 7fded09ae740 1 Processor -- start 2024-06-02T22:43:48.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.980+0000 7fded09ae740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 0x558cc2fc3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.981+0000 7fded09ae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2fc3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.981+0000 7fded09ae740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 0x558cc2fc4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.981+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 0x558cc2fc3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.981+0000 7fdec6a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 0x558cc2fc3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55570/0 (socket says 172.21.15.31:55570) 2024-06-02T22:43:48.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fdec6a00640 1 -- 172.21.15.31:0/619903221 learned_addr learned my addr 172.21.15.31:0/619903221 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.981+0000 7fdec6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2fc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fdec7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 0x558cc2fc4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a9710 con 0x558cc2f98f40 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a9040 con 0x558cc2f933e0 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81a6330 con 0x558cc2f93dd0 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.982+0000 7fded09ae740 10 client.0 _ll_register_callbacks cb 0x7fdeb8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec7400640 1 -- 172.21.15.31:0/619903221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 msgr2=0x558cc2fc3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec7400640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2fc3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec7400640 1 -- 172.21.15.31:0/619903221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 msgr2=0x558cc2fc3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:43:48.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec7400640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 0x558cc2fc3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:48.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec7400640 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc2fc4f80 con 0x558cc2f98f40 2024-06-02T22:43:48.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.983+0000 7fdec6000640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2fc3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:43:48.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.984+0000 7fdeb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:43:48.984 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.984+0000 7fdec7400640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 0x558cc2fc4990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809b9e0 tx=0x7fdeb809c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09c03ece31f3273 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:43:48.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.985+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb809b330 con 0x558cc2f98f40 2024-06-02T22:43:48.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.985+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdeb8018b20 con 0x558cc2f98f40 2024-06-02T22:43:48.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.985+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec0030940 con 0x558cc2f98f40 2024-06-02T22:43:48.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.986+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdeb80a4950 con 0x558cc2f98f40 2024-06-02T22:43:48.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.986+0000 7fded09ae740 10 client.15444 fetch_fsmap learned FSMap version 30 2024-06-02T22:43:48.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.986+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558cc301c5f0 con 0x558cc2f98f40 2024-06-02T22:43:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.987+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdec0030940 con 0x558cc2f98f40 2024-06-02T22:43:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fdeb8097a30 con 0x558cc2f98f40 2024-06-02T22:43:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 10 client.15444 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:43:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 10 client.15444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:43:48.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 20 client.15444 populate_metadata read hostname 'smithi031' 2024-06-02T22:43:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc301efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:43:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 4 client.15444 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:43:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558cc2f8c2b0 con 0x558cc2fb1780 2024-06-02T22:43:48.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.988+0000 7fdec6a00640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc301efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:43:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.990+0000 7fdec6a00640 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc301efe0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4516e284ae889544 server_cookie=fa99f1b9b735e0f5 in_seq=0 out_seq=0 2024-06-02T22:43:48.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:48.990+0000 7fdeb0c00640 10 client.15444 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:49 smithi098 ceph-mon[36750]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 605 op/s 2024-06-02T22:43:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 385.0 s, 363.4 tps, lat 271.506 ms stddev 371.163 2024-06-02T22:43:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:49 smithi178 ceph-mon[36614]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 605 op/s 2024-06-02T22:43:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:49 smithi031 ceph-mon[31767]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.7 MiB/s wr, 605 op/s 2024-06-02T22:43:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.627+0000 7fdeb0c00640 1 -- 172.21.15.31:0/619903221 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x558cc2f8c2b0 con 0x558cc2fb1780 2024-06-02T22:43:50.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.627+0000 7fdeb0c00640 10 client.15444 handle_command_reply: tid=0 2024-06-02T22:43:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 client.15444 shutdown 2024-06-02T22:43:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 msgr2=0x558cc2fc4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 0x558cc2fc4990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdeb809b9e0 tx=0x7fdeb809c3e0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 shutdown_connections 2024-06-02T22:43:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558cc2fb1780 0x558cc301efe0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558cc2f98f40 0x558cc2fc4990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558cc2f93dd0 0x558cc2fc3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 --2- 172.21.15.31:0/619903221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558cc2f933e0 0x558cc2fc3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.628+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 >> 172.21.15.31:0/619903221 conn(0x558cc2f52f80 msgr2=0x558cc2f84f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.629+0000 7fdeb0c00640 0 client.15444 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.630+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 shutdown_connections 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.630+0000 7fded09ae740 1 -- 172.21.15.31:0/619903221 wait complete. 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.630+0000 7fded09ae740 20 client.15444 trim_cache size 0 max 16384 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:43:50.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 msgr2=0x7fdeac0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 0x7fdeac0a5240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558cc2f87500 tx=0x7fdec00097e0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 msgr2=0x7fdec80742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 0x7fdec80742d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800e970 tx=0x7fdeb800ee30 comp rx=0 tx=0).stop 2024-06-02T22:43:50.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 shutdown_connections 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdeac0a2d80 0x7fdeac0a5240 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558cc2f87500 tx=0x7fdec00097e0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec81035b0 0x7fdec80742d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdec8102bf0 0x7fdec8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 --2- 172.21.15.31:0/1058793625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdec8101a00 0x7fdec8075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.632+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 >> 172.21.15.31:0/1058793625 conn(0x7fdec80fcf90 msgr2=0x7fdec8105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.633+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 shutdown_connections 2024-06-02T22:43:50.633 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:43:50.633+0000 7fdecda00640 1 -- 172.21.15.31:0/1058793625 wait complete. 2024-06-02T22:43:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:51 smithi178 ceph-mon[36614]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 539 op/s 2024-06-02T22:43:52.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:51 smithi031 ceph-mon[31767]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 539 op/s 2024-06-02T22:43:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:51 smithi098 ceph-mon[36750]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.0 MiB/s wr, 539 op/s 2024-06-02T22:43:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:53 smithi178 ceph-mon[36614]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2024-06-02T22:43:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:53 smithi031 ceph-mon[31767]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2024-06-02T22:43:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:53 smithi098 ceph-mon[36750]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2024-06-02T22:43:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 390.0 s, 778.4 tps, lat 137.531 ms stddev 212.073 2024-06-02T22:43:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:55 smithi178 ceph-mon[36614]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-06-02T22:43:56.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:55 smithi031 ceph-mon[31767]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-06-02T22:43:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:55 smithi098 ceph-mon[36750]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2024-06-02T22:43:58.264 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:57 smithi098 ceph-mon[36750]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.26k op/s 2024-06-02T22:43:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:57 smithi178 ceph-mon[36614]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.26k op/s 2024-06-02T22:43:58.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:57 smithi031 ceph-mon[31767]: pgmap v720: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.26k op/s 2024-06-02T22:44:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 395.0 s, 697.0 tps, lat 135.621 ms stddev 160.265 2024-06-02T22:44:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:43:59 smithi178 ceph-mon[36614]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-06-02T22:44:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:43:59 smithi031 ceph-mon[31767]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-06-02T22:44:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:43:59 smithi098 ceph-mon[36750]: pgmap v721: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-06-02T22:44:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:02 smithi178 ceph-mon[36614]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-06-02T22:44:02.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:02 smithi031 ceph-mon[31767]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-06-02T22:44:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:02 smithi098 ceph-mon[36750]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 -- 172.21.15.31:0/2312001641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120104e10 msgr2=0x7f7120105290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 --2- 172.21.15.31:0/2312001641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120104e10 0x7f7120105290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f710c009900 tx=0x7f710c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 -- 172.21.15.31:0/2312001641 shutdown_connections 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 --2- 172.21.15.31:0/2312001641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 0x7f712010c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 --2- 172.21.15.31:0/2312001641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120104e10 0x7f7120105290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 --2- 172.21.15.31:0/2312001641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120103c20 0x7f7120104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.828+0000 7f7127600640 1 -- 172.21.15.31:0/2312001641 >> 172.21.15.31:0/2312001641 conn(0x7f71200ff190 msgr2=0x7f71201015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:03.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.829+0000 7f7127600640 1 -- 172.21.15.31:0/2312001641 shutdown_connections 2024-06-02T22:44:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.829+0000 7f7127600640 1 -- 172.21.15.31:0/2312001641 wait complete. 2024-06-02T22:44:03.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.830+0000 7f7127600640 1 Processor -- start 2024-06-02T22:44:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.830+0000 7f7127600640 1 -- start start 2024-06-02T22:44:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120104e10 0x7f712019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 0x7f71201a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f712010f8f0 con 0x7f71201057d0 2024-06-02T22:44:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f712010f770 con 0x7f7120103c20 2024-06-02T22:44:03.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7127600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f712010fa70 con 0x7f7120104e10 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7124c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7125600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 0x7f71201a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.831+0000 7f7124c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:49700/0 (socket says 172.21.15.31:49700) 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 -- 172.21.15.31:0/1184534803 learned_addr learned my addr 172.21.15.31:0/1184534803 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f711fe00640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120104e10 0x7f712019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 -- 172.21.15.31:0/1184534803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120104e10 msgr2=0x7f712019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120104e10 0x7f712019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 -- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 msgr2=0x7f71201a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 0x7f71201a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 -- 172.21.15.31:0/1184534803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71201a5ee0 con 0x7f7120103c20 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.832+0000 7f7124c00640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9c0 tx=0x7f711400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.833+0000 7f711d600640 1 -- 172.21.15.31:0/1184534803 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711400cd80 con 0x7f7120103c20 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.833+0000 7f711d600640 1 -- 172.21.15.31:0/1184534803 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71140035f0 con 0x7f7120103c20 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.833+0000 7f711d600640 1 -- 172.21.15.31:0/1184534803 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114010690 con 0x7f7120103c20 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.833+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71201a61d0 con 0x7f7120103c20 2024-06-02T22:44:03.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.833+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71201a66a0 con 0x7f7120103c20 2024-06-02T22:44:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.837+0000 7f712a5bf740 1 Processor -- start 2024-06-02T22:44:03.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.838+0000 7f712a5bf740 1 -- start start 2024-06-02T22:44:03.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc992ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9980c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564bbc8f6420 con 0x564bbc998730 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564bbc89dc50 con 0x564bbc992bd0 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f712a5bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564bbc8f23e0 con 0x564bbc9935c0 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.839+0000 7f711fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54194/0 (socket says 172.21.15.31:54194) 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 -- 172.21.15.31:0/3666378747 learned_addr learned my addr 172.21.15.31:0/3666378747 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f7125600640 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc992ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 -- 172.21.15.31:0/3666378747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 msgr2=0x564bbc9980c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9980c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 -- 172.21.15.31:0/3666378747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 msgr2=0x564bbc992ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc992ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.840+0000 7f711fe00640 1 -- 172.21.15.31:0/3666378747 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bbc60a210 con 0x564bbc998730 2024-06-02T22:44:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.841+0000 7f711fe00640 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f710c031610 tx=0x7f710c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebbaf27cce57e1c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.842+0000 7f7111c00640 1 -- 172.21.15.31:0/3666378747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c035040 con 0x564bbc998730 2024-06-02T22:44:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.842+0000 7f7111c00640 1 -- 172.21.15.31:0/3666378747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f710c005520 con 0x564bbc998730 2024-06-02T22:44:03.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.842+0000 7f7111c00640 1 -- 172.21.15.31:0/3666378747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c031910 con 0x564bbc998730 2024-06-02T22:44:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.842+0000 7f711d600640 1 -- 172.21.15.31:0/1184534803 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f71140037a0 con 0x7f7120103c20 2024-06-02T22:44:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 -- 172.21.15.31:0/3666378747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 msgr2=0x564bbc99abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f710c031610 tx=0x7f710c004310 comp rx=0 tx=0).stop 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 -- 172.21.15.31:0/3666378747 shutdown_connections 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc99abc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 --2- 172.21.15.31:0/3666378747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc992ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 -- 172.21.15.31:0/3666378747 >> 172.21.15.31:0/3666378747 conn(0x564bbc95af80 msgr2=0x564bbc98e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 -- 172.21.15.31:0/3666378747 shutdown_connections 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.843+0000 7f712a5bf740 1 -- 172.21.15.31:0/3666378747 wait complete. 2024-06-02T22:44:03.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 -- start start 2024-06-02T22:44:03.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 Processor -- start 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc99d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc998730 0x564bbc9a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564bbc99b680 con 0x564bbc9935c0 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564bbc8b10b0 con 0x564bbc992bd0 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.844+0000 7f712a5bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564bbc99b800 con 0x564bbc998730 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f7125600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f7125600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:49716/0 (socket says 172.21.15.31:49716) 2024-06-02T22:44:03.845 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f7125600640 1 -- 172.21.15.31:0/2992595612 learned_addr learned my addr 172.21.15.31:0/2992595612 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f711d600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 0x7f71080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f712a5bf740 10 client.0 _ll_register_callbacks cb 0x564bbc89cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f711d600640 1 -- 172.21.15.31:0/1184534803 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f71140cf730 con 0x7f7120103c20 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f711fe00640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc998730 0x564bbc9a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.845+0000 7f7124c00640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc99d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 -- 172.21.15.31:0/2992595612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc998730 msgr2=0x564bbc9a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc998730 0x564bbc9a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.846 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 -- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 msgr2=0x564bbc99d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc99d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 -- 172.21.15.31:0/2992595612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bbc6d6620 con 0x564bbc992bd0 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7124c00640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc99d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 0x7f71080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7125600640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7118003db0 tx=0x7f7118004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0cb8d96c44df530 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.846+0000 7f7106000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:44:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.848+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118010c90 con 0x564bbc992bd0 2024-06-02T22:44:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.848+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f711801d440 con 0x564bbc992bd0 2024-06-02T22:44:03.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.848+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f710c005520 con 0x564bbc992bd0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.848+0000 7f7125600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 0x7f71080a50d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7118023000 tx=0x7f7118020000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.848+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f711802c020 con 0x564bbc992bd0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.849+0000 7f712a5bf740 10 client.25700 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.849+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564bbc9a78c0 con 0x564bbc992bd0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.849+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f710c005520 con 0x564bbc992bd0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7118028430 con 0x564bbc992bd0 2024-06-02T22:44:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 10 client.25700 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 20 client.25700 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbc9a8fb0 0x564bbc9ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 4 client.25700 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:44:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.850+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bbc903b50 con 0x564bbc9a8fb0 2024-06-02T22:44:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.854+0000 7f7124c00640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbc9a8fb0 0x564bbc9ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.858+0000 7f7106000640 10 client.25700 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.858+0000 7f7124c00640 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbc9a8fb0 0x564bbc9ab470 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e33bd92acf714101 server_cookie=7727465f8a5ef892 in_seq=0 out_seq=0 2024-06-02T22:44:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.862+0000 7f7106000640 1 -- 172.21.15.31:0/2992595612 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564bbc903b50 con 0x564bbc9a8fb0 2024-06-02T22:44:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.862+0000 7f7106000640 10 client.25700 handle_command_reply: tid=0 2024-06-02T22:44:03.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.862+0000 7f712a5bf740 1 client.25700 shutdown 2024-06-02T22:44:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.862+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 msgr2=0x564bbc99cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.862+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7118003db0 tx=0x7f7118004410 comp rx=0 tx=0).stop 2024-06-02T22:44:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 shutdown_connections 2024-06-02T22:44:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbc9a8fb0 0x564bbc9ab470 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc998730 0x564bbc9a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc99d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f7106000640 0 client.25700 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 --2- 172.21.15.31:0/2992595612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc99cf00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 >> 172.21.15.31:0/2992595612 conn(0x564bbc95af80 msgr2=0x564bbc98d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 shutdown_connections 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 1 -- 172.21.15.31:0/2992595612 wait complete. 2024-06-02T22:44:03.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.864+0000 7f712a5bf740 20 client.25700 trim_cache size 0 max 16384 2024-06-02T22:44:03.899 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.900+0000 7f712a5bf740 1 Processor -- start 2024-06-02T22:44:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.900+0000 7f712a5bf740 1 -- start start 2024-06-02T22:44:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.901+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.901+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.900 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.901+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc991b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.901 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f711fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f711fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58292/0 (socket says 172.21.15.31:58292) 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:49724/0 (socket says 172.21.15.31:49724) 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 -- 172.21.15.31:0/725606123 learned_addr learned my addr 172.21.15.31:0/725606123 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71201b0ce0 con 0x564bbc998730 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71201b2820 con 0x564bbc992bd0 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f71201b13b0 con 0x564bbc9935c0 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7125600640 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc991b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 -- 172.21.15.31:0/725606123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 msgr2=0x564bbc9a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 -- 172.21.15.31:0/725606123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 msgr2=0x564bbc991b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc991b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.902 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.902+0000 7f7124c00640 1 -- 172.21.15.31:0/725606123 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bbc9943d0 con 0x564bbc992bd0 2024-06-02T22:44:03.903 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.903+0000 7f7124c00640 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f711400c6a0 tx=0x7f711409b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5236fe5a680f3097 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.908+0000 7f7111200640 1 -- 172.21.15.31:0/725606123 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114099ea0 con 0x564bbc992bd0 2024-06-02T22:44:03.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.908+0000 7f7111200640 1 -- 172.21.15.31:0/725606123 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71140ccf50 con 0x564bbc992bd0 2024-06-02T22:44:03.907 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.908+0000 7f7111200640 1 -- 172.21.15.31:0/725606123 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140a4380 con 0x564bbc992bd0 2024-06-02T22:44:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 msgr2=0x564bbc991620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f711400c6a0 tx=0x7f711409b800 comp rx=0 tx=0).stop 2024-06-02T22:44:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 shutdown_connections 2024-06-02T22:44:03.908 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc998730 0x564bbc991b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc9935c0 0x564bbc9a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 --2- 172.21.15.31:0/725606123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc992bd0 0x564bbc991620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 >> 172.21.15.31:0/725606123 conn(0x564bbc95af80 msgr2=0x564bbc98e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 shutdown_connections 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.909+0000 7f712a5bf740 1 -- 172.21.15.31:0/725606123 wait complete. 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.910+0000 7f712a5bf740 1 -- start start 2024-06-02T22:44:03.909 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.910+0000 7f712a5bf740 1 Processor -- start 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.910+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 0x564bbc9a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc9a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 0x564bbc9a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71201b2150 con 0x564bbc9935c0 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71201b1a80 con 0x564bbc998730 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f71201aecc0 con 0x564bbc992bd0 2024-06-02T22:44:03.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f712a5bf740 10 client.0 _ll_register_callbacks cb 0x7f7118009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f7124c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 0x564bbc9a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f7124c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 0x564bbc9a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58308/0 (socket says 172.21.15.31:58308) 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f7124c00640 1 -- 172.21.15.31:0/1193262209 learned_addr learned my addr 172.21.15.31:0/1193262209 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.911+0000 7f7125600640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 0x564bbc9a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f711fe00640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc9a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f7125600640 1 -- 172.21.15.31:0/1193262209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 msgr2=0x564bbc9a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f7125600640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 0x564bbc9a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f7125600640 1 -- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 msgr2=0x564bbc9a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f7125600640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc9a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.912+0000 7f7125600640 1 -- 172.21.15.31:0/1193262209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bbc9a3200 con 0x564bbc998730 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.913+0000 7f711fe00640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc9a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.913+0000 7f7125600640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 0x564bbc9a2c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7118028ae0 tx=0x7f7118003990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d0fe7128a173c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:03.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.913+0000 7f7106000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:44:03.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.914+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118009e90 con 0x564bbc998730 2024-06-02T22:44:03.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.914+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7118028b60 con 0x564bbc998730 2024-06-02T22:44:03.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.914+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71140ccf50 con 0x564bbc998730 2024-06-02T22:44:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.915+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71180097f0 con 0x564bbc998730 2024-06-02T22:44:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.915+0000 7f712a5bf740 10 client.25706 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:03.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.915+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564bbc9a4510 con 0x564bbc998730 2024-06-02T22:44:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71140ccf50 con 0x564bbc998730 2024-06-02T22:44:03.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f71180329e0 con 0x564bbc998730 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 10 client.25706 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 20 client.25706 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbca14180 0x564bbca165a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 4 client.25706 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:44:03.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.916+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564bbc8fdea0 con 0x564bbca14180 2024-06-02T22:44:03.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.917+0000 7f7124c00640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbca14180 0x564bbca165a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:03.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.919+0000 7f7124c00640 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbca14180 0x564bbca165a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15102ffadf3ba6d0 server_cookie=4daaf0e6ecb12e0a in_seq=0 out_seq=0 2024-06-02T22:44:03.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:03.920+0000 7f7106000640 10 client.25706 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.109+0000 7f7106000640 1 -- 172.21.15.31:0/1193262209 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564bbc8fdea0 con 0x564bbca14180 2024-06-02T22:44:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.109+0000 7f7106000640 10 client.25706 handle_command_reply: tid=0 2024-06-02T22:44:04.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.109+0000 7f712a5bf740 1 client.25706 shutdown 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 msgr2=0x564bbc9a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 0x564bbc9a2c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7118028ae0 tx=0x7f7118003990 comp rx=0 tx=0).stop 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 shutdown_connections 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564bbca14180 0x564bbca165a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564bbc998730 0x564bbc9a2c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564bbc9935c0 0x564bbc9a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 --2- 172.21.15.31:0/1193262209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564bbc992bd0 0x564bbc9a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 >> 172.21.15.31:0/1193262209 conn(0x564bbc95af80 msgr2=0x564bbc991620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:04.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f7106000640 0 client.25706 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.110+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 shutdown_connections 2024-06-02T22:44:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.111+0000 7f712a5bf740 1 -- 172.21.15.31:0/1193262209 wait complete. 2024-06-02T22:44:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.111+0000 7f712a5bf740 20 client.25706 trim_cache size 0 max 16384 2024-06-02T22:44:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:44:04.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:44:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:44:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 msgr2=0x7f71080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:04.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 0x7f71080a50d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7118023000 tx=0x7f7118020000 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 msgr2=0x7f712019e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9c0 tx=0x7f711400ee80 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 shutdown_connections 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71080a2c10 0x7f71080a50d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71201057d0 0x7f71201a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7120104e10 0x7f712019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 --2- 172.21.15.31:0/1184534803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7120103c20 0x7f712019e2c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.112+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 >> 172.21.15.31:0/1184534803 conn(0x7f71200ff190 msgr2=0x7f7120077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.113+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 shutdown_connections 2024-06-02T22:44:04.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:04.113+0000 7f7127600640 1 -- 172.21.15.31:0/1184534803 wait complete. 2024-06-02T22:44:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:04 smithi178 ceph-mon[36614]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-06-02T22:44:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:04 smithi031 ceph-mon[31767]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-06-02T22:44:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:04 smithi098 ceph-mon[36750]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-06-02T22:44:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 400.0 s, 644.2 tps, lat 160.997 ms stddev 249.394 2024-06-02T22:44:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:06 smithi178 ceph-mon[36614]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 598 op/s 2024-06-02T22:44:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:06 smithi031 ceph-mon[31767]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 598 op/s 2024-06-02T22:44:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:06 smithi098 ceph-mon[36750]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.5 MiB/s wr, 598 op/s 2024-06-02T22:44:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:08 smithi178 ceph-mon[36614]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 559 op/s 2024-06-02T22:44:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:08 smithi031 ceph-mon[31767]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 559 op/s 2024-06-02T22:44:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:08 smithi098 ceph-mon[36750]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 559 op/s 2024-06-02T22:44:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 405.0 s, 549.0 tps, lat 183.997 ms stddev 240.446 2024-06-02T22:44:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:10 smithi178 ceph-mon[36614]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-06-02T22:44:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:10 smithi031 ceph-mon[31767]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-06-02T22:44:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:10 smithi098 ceph-mon[36750]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-06-02T22:44:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:12 smithi178 ceph-mon[36614]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:44:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:12 smithi031 ceph-mon[31767]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:44:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:12 smithi098 ceph-mon[36750]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:44:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:14 smithi031 ceph-mon[31767]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 MiB/s wr, 642 op/s 2024-06-02T22:44:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:14 smithi098 ceph-mon[36750]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 MiB/s wr, 642 op/s 2024-06-02T22:44:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:14 smithi178 ceph-mon[36614]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.7 MiB/s wr, 642 op/s 2024-06-02T22:44:15.224 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 410.0 s, 592.4 tps, lat 165.268 ms stddev 213.352 2024-06-02T22:44:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:16 smithi031 ceph-mon[31767]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-06-02T22:44:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:16 smithi098 ceph-mon[36750]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-06-02T22:44:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:16 smithi178 ceph-mon[36614]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 523 op/s 2024-06-02T22:44:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.308+0000 7f66daa00640 1 -- 172.21.15.31:0/4214729512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d41024a0 msgr2=0x7f66d4104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.308+0000 7f66daa00640 1 --2- 172.21.15.31:0/4214729512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d41024a0 0x7f66d4104890 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009ca0 tx=0x7f66cc02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 -- 172.21.15.31:0/4214729512 shutdown_connections 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 --2- 172.21.15.31:0/4214729512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 --2- 172.21.15.31:0/4214729512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d4104dd0 0x7f66d41071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 --2- 172.21.15.31:0/4214729512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d41024a0 0x7f66d4104890 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 -- 172.21.15.31:0/4214729512 >> 172.21.15.31:0/4214729512 conn(0x7f66d40fbeb0 msgr2=0x7f66d40fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 -- 172.21.15.31:0/4214729512 shutdown_connections 2024-06-02T22:44:17.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.310+0000 7f66daa00640 1 -- 172.21.15.31:0/4214729512 wait complete. 2024-06-02T22:44:17.310 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.311+0000 7f66daa00640 1 Processor -- start 2024-06-02T22:44:17.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.312+0000 7f66daa00640 1 -- start start 2024-06-02T22:44:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.312+0000 7f66daa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d41024a0 0x7f66d41124c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.312+0000 7f66daa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 0x7f66d4112a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.312+0000 7f66daa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.313+0000 7f66d3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 0x7f66d4112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.313+0000 7f66d3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 0x7f66d4112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49098/0 (socket says 172.21.15.31:49098) 2024-06-02T22:44:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66daa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410b490 con 0x7f66d4104dd0 2024-06-02T22:44:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66daa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410b310 con 0x7f66d4107700 2024-06-02T22:44:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66daa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410b610 con 0x7f66d41024a0 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66d3400640 1 -- 172.21.15.31:0/1316105103 learned_addr learned my addr 172.21.15.31:0/1316105103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66d8a00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66d3e00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d41024a0 0x7f66d41124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66d8a00640 1 -- 172.21.15.31:0/1316105103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d41024a0 msgr2=0x7f66d41124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.316+0000 7f66d8a00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d41024a0 0x7f66d41124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.317+0000 7f66d8a00640 1 -- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 msgr2=0x7f66d4112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.317+0000 7f66d8a00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 0x7f66d4112a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.317+0000 7f66d8a00640 1 -- 172.21.15.31:0/1316105103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d41111a0 con 0x7f66d4107700 2024-06-02T22:44:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.317+0000 7f66d8a00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4110b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66c400d680 tx=0x7f66c400db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.318+0000 7f66d0c00640 1 -- 172.21.15.31:0/1316105103 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4017070 con 0x7f66d4107700 2024-06-02T22:44:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.318+0000 7f66d0c00640 1 -- 172.21.15.31:0/1316105103 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66c4009820 con 0x7f66d4107700 2024-06-02T22:44:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.318+0000 7f66d0c00640 1 -- 172.21.15.31:0/1316105103 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4004e00 con 0x7f66d4107700 2024-06-02T22:44:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.319+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d4111490 con 0x7f66d4107700 2024-06-02T22:44:17.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.319+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d41af040 con 0x7f66d4107700 2024-06-02T22:44:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.333+0000 7f66dd7ec740 1 Processor -- start 2024-06-02T22:44:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.333+0000 7f66d0c00640 1 -- 172.21.15.31:0/1316105103 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f66c40099d0 con 0x7f66d4107700 2024-06-02T22:44:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 -- start start 2024-06-02T22:44:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645e4730 0x5563645e6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556364542420 con 0x5563645debd0 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5563644e9c50 con 0x5563645df5c0 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55636453e3e0 con 0x5563645e4730 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48800/0 (socket says 172.21.15.31:48800) 2024-06-02T22:44:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.334+0000 7f66d3e00640 1 -- 172.21.15.31:0/1056443026 learned_addr learned my addr 172.21.15.31:0/1056443026 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.335+0000 7f66d3e00640 1 -- 172.21.15.31:0/1056443026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645e4730 msgr2=0x5563645e6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.335+0000 7f66d3e00640 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645e4730 0x5563645e6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.335+0000 7f66d3e00640 1 -- 172.21.15.31:0/1056443026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 msgr2=0x5563645deff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.335+0000 7f66d3e00640 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.335+0000 7f66d3e00640 1 -- 172.21.15.31:0/1056443026 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556364256210 con 0x5563645df5c0 2024-06-02T22:44:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.337+0000 7f66d3e00640 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f80 tx=0x7f66cc005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3a4ba0538fbab9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.338+0000 7f66c9200640 1 -- 172.21.15.31:0/1056443026 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc031650 con 0x5563645df5c0 2024-06-02T22:44:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.338+0000 7f66c9200640 1 -- 172.21.15.31:0/1056443026 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc036040 con 0x5563645df5c0 2024-06-02T22:44:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.338+0000 7f66c9200640 1 -- 172.21.15.31:0/1056443026 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc004780 con 0x5563645df5c0 2024-06-02T22:44:17.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.338+0000 7f66d0c00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 0x7f66b80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.338+0000 7f66d0c00640 1 -- 172.21.15.31:0/1316105103 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f66c40cef70 con 0x7f66d4107700 2024-06-02T22:44:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.340+0000 7f66dd7ec740 1 -- 172.21.15.31:0/1056443026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 msgr2=0x5563645e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.340+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f80 tx=0x7f66cc005fa0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.340+0000 7f66d3400640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 0x7f66b80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66dd7ec740 1 -- 172.21.15.31:0/1056443026 shutdown_connections 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645e4730 0x5563645e6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645e40c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/1056443026 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645deff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66dd7ec740 1 -- 172.21.15.31:0/1056443026 >> 172.21.15.31:0/1056443026 conn(0x5563645a6f80 msgr2=0x5563645da650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.341+0000 7f66d3400640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 0x7f66b80a5190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66c00058c0 tx=0x7f66c0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.342+0000 7f66dd7ec740 1 -- 172.21.15.31:0/1056443026 shutdown_connections 2024-06-02T22:44:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.342+0000 7f66dd7ec740 1 -- 172.21.15.31:0/1056443026 wait complete. 2024-06-02T22:44:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.343+0000 7f66dd7ec740 1 -- start start 2024-06-02T22:44:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.343+0000 7f66dd7ec740 1 Processor -- start 2024-06-02T22:44:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.344+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 0x5563645e93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50276/0 (socket says 172.21.15.31:50276) 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645e4730 0x5563645f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66d3e00640 1 -- 172.21.15.31:0/3141664116 learned_addr learned my addr 172.21.15.31:0/3141664116 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5563645e7680 con 0x5563645df5c0 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5563644fd0b0 con 0x5563645e4730 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5563645e7800 con 0x5563645debd0 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.347+0000 7f66dd7ec740 10 client.0 _ll_register_callbacks cb 0x5563644e8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.348+0000 7f66d3400640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 0x5563645e93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.348+0000 7f66d3400640 1 -- 172.21.15.31:0/3141664116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 msgr2=0x5563645e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.348+0000 7f66d3400640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.348+0000 7f66d3400640 1 -- 172.21.15.31:0/3141664116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645e4730 msgr2=0x5563645f03f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.349+0000 7f66d3400640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645e4730 0x5563645f03f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.349+0000 7f66d3400640 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556364322620 con 0x5563645df5c0 2024-06-02T22:44:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.349+0000 7f66d3e00640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.349+0000 7f66d3400640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 0x5563645e93b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005f80 tx=0x7f66c000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae08bc14c6ddea9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.349+0000 7f66bd600640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.350+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c0023020 con 0x5563645df5c0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.350+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f66c0011440 con 0x5563645df5c0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.350+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66cc036040 con 0x5563645df5c0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.351+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f66c0011640 con 0x5563645df5c0 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.351+0000 7f66dd7ec740 10 client.15468 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.351+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5563645f3620 con 0x5563645df5c0 2024-06-02T22:44:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc036040 con 0x5563645df5c0 2024-06-02T22:44:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f66c001fa70 con 0x5563645df5c0 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 10 client.15468 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 10 client.15468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 20 client.15468 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645f4d10 0x5563645f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 4 client.15468 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:44:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.353+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55636454fb50 con 0x5563645f4d10 2024-06-02T22:44:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.355+0000 7f66d3e00640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645f4d10 0x5563645f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.357+0000 7f66d3e00640 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645f4d10 0x5563645f71a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133591bcf7102cfd server_cookie=41016973835fdf2a in_seq=0 out_seq=0 2024-06-02T22:44:17.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.357+0000 7f66bd600640 10 client.15468 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:17.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.362+0000 7f66bd600640 1 -- 172.21.15.31:0/3141664116 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55636454fb50 con 0x5563645f4d10 2024-06-02T22:44:17.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.362+0000 7f66bd600640 10 client.15468 handle_command_reply: tid=0 2024-06-02T22:44:17.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.362+0000 7f66dd7ec740 1 client.15468 shutdown 2024-06-02T22:44:17.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.362+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 msgr2=0x5563645e93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.362+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 0x5563645e93b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005f80 tx=0x7f66c000b650 comp rx=0 tx=0).stop 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 shutdown_connections 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645f4d10 0x5563645f71a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645e4730 0x5563645f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645df5c0 0x5563645e93b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/3141664116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66bd600640 0 client.15468 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 >> 172.21.15.31:0/3141664116 conn(0x5563645a6f80 msgr2=0x5563645d9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 shutdown_connections 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 1 -- 172.21.15.31:0/3141664116 wait complete. 2024-06-02T22:44:17.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.363+0000 7f66dd7ec740 20 client.15468 trim_cache size 0 max 16384 2024-06-02T22:44:17.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.410+0000 7f66dd7ec740 1 Processor -- start 2024-06-02T22:44:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.411+0000 7f66dd7ec740 1 -- start start 2024-06-02T22:44:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 0x5563645f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41b9580 con 0x5563645debd0 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41bb0c0 con 0x5563645a6f80 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41b9c50 con 0x5563645df5c0 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.412+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48812/0 (socket says 172.21.15.31:48812) 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d8a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 0x5563645f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d8a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 0x5563645f03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50290/0 (socket says 172.21.15.31:50290) 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 -- 172.21.15.31:0/664682684 learned_addr learned my addr 172.21.15.31:0/664682684 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 -- 172.21.15.31:0/664682684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 msgr2=0x5563645f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 0x5563645f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 -- 172.21.15.31:0/664682684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 msgr2=0x5563645e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.413+0000 7f66d3e00640 1 -- 172.21.15.31:0/664682684 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563645e3b40 con 0x5563645a6f80 2024-06-02T22:44:17.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.414+0000 7f66d3e00640 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f66cc02ade0 tx=0x7f66cc02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489afa434addf170 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.417+0000 7f66bfe00640 1 -- 172.21.15.31:0/664682684 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc004660 con 0x5563645a6f80 2024-06-02T22:44:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.417+0000 7f66bfe00640 1 -- 172.21.15.31:0/664682684 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc036050 con 0x5563645a6f80 2024-06-02T22:44:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.417+0000 7f66bfe00640 1 -- 172.21.15.31:0/664682684 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc004080 con 0x5563645a6f80 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.418+0000 7f66dd7ec740 1 -- 172.21.15.31:0/664682684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 msgr2=0x5563645e08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.418+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f66cc02ade0 tx=0x7f66cc02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.418+0000 7f66dd7ec740 1 -- 172.21.15.31:0/664682684 shutdown_connections 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.418+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645df5c0 0x5563645f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.419+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645debd0 0x5563645e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.419+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/664682684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645a6f80 0x5563645e08a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.419+0000 7f66dd7ec740 1 -- 172.21.15.31:0/664682684 >> 172.21.15.31:0/664682684 conn(0x5563645e4230 msgr2=0x5563645e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.419+0000 7f66dd7ec740 1 -- 172.21.15.31:0/664682684 shutdown_connections 2024-06-02T22:44:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.419+0000 7f66dd7ec740 1 -- 172.21.15.31:0/664682684 wait complete. 2024-06-02T22:44:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.420+0000 7f66dd7ec740 1 -- start start 2024-06-02T22:44:17.420 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.420+0000 7f66dd7ec740 1 Processor -- start 2024-06-02T22:44:17.421 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 0x5563645ed680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.421 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41ba9f0 con 0x5563645a6f80 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41ba320 con 0x5563645df5c0 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f66d41b7560 con 0x5563645debd0 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.422+0000 7f66dd7ec740 10 client.0 _ll_register_callbacks cb 0x7f66c000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.422 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48826/0 (socket says 172.21.15.31:48826) 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 -- 172.21.15.31:0/2196456911 learned_addr learned my addr 172.21.15.31:0/2196456911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d3400640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d3e00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 0x5563645ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 -- 172.21.15.31:0/2196456911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 msgr2=0x5563645edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645edbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.423+0000 7f66d8a00640 1 -- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 msgr2=0x5563645ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:17.423 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66d8a00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 0x5563645ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66d8a00640 1 -- 172.21.15.31:0/2196456911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563645ef100 con 0x5563645df5c0 2024-06-02T22:44:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66d3400640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:44:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66d3e00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 0x5563645ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:44:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66d8a00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f66c4097d80 tx=0x7f66c409b090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17facbc9c4c7a0a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:17.424 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.424+0000 7f66bd600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c409bb40 con 0x5563645df5c0 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f66c4097a20 con 0x5563645df5c0 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66cc036050 con 0x5563645df5c0 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f66c409b440 con 0x5563645df5c0 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66dd7ec740 10 client.25721 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:17.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.426+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5563645f0480 con 0x5563645df5c0 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc036050 con 0x5563645df5c0 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f66c40ccba0 con 0x5563645df5c0 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 10 client.25721 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 10 client.25721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 20 client.25721 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:17.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645e4730 0x556364661f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 4 client.25721 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:44:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.428+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556364549ea0 con 0x5563645e4730 2024-06-02T22:44:17.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.429+0000 7f66d3e00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645e4730 0x556364661f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.430+0000 7f66d3e00640 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645e4730 0x556364661f70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b3ebcd1facbe55 server_cookie=712a2d7b4b791486 in_seq=0 out_seq=0 2024-06-02T22:44:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.430+0000 7f66bd600640 10 client.25721 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.739+0000 7f66bd600640 1 -- 172.21.15.31:0/2196456911 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556364549ea0 con 0x5563645e4730 2024-06-02T22:44:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.739+0000 7f66bd600640 10 client.25721 handle_command_reply: tid=0 2024-06-02T22:44:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.740+0000 7f66dd7ec740 1 client.25721 shutdown 2024-06-02T22:44:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.740+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 msgr2=0x5563645eeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.740+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f66c4097d80 tx=0x7f66c409b090 comp rx=0 tx=0).stop 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 shutdown_connections 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5563645e4730 0x556364661f70 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563645df5c0 0x5563645eeb10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563645debd0 0x5563645edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 --2- 172.21.15.31:0/2196456911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5563645a6f80 0x5563645ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 >> 172.21.15.31:0/2196456911 conn(0x5563645e4230 msgr2=0x5563645e8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.741+0000 7f66bd600640 0 client.25721 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.742+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 shutdown_connections 2024-06-02T22:44:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.742+0000 7f66dd7ec740 1 -- 172.21.15.31:0/2196456911 wait complete. 2024-06-02T22:44:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.742+0000 7f66dd7ec740 20 client.25721 trim_cache size 0 max 16384 2024-06-02T22:44:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.743+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 msgr2=0x7f66b80a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.743+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 0x7f66b80a5190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f66c00058c0 tx=0x7f66c0005850 comp rx=0 tx=0).stop 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.743+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 msgr2=0x7f66d4110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.743+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4110b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66c400d680 tx=0x7f66c400db40 comp rx=0 tx=0).stop 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 shutdown_connections 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f66b80a2cd0 0x7f66b80a5190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66d4107700 0x7f66d4110b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66d4104dd0 0x7f66d4112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 --2- 172.21.15.31:0/1316105103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d41024a0 0x7f66d41124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 >> 172.21.15.31:0/1316105103 conn(0x7f66d40fbeb0 msgr2=0x7f66d4102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 shutdown_connections 2024-06-02T22:44:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:17.744+0000 7f66daa00640 1 -- 172.21.15.31:0/1316105103 wait complete. 2024-06-02T22:44:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:18 smithi031 ceph-mon[31767]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-06-02T22:44:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:18 smithi098 ceph-mon[36750]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-06-02T22:44:18.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:18 smithi178 ceph-mon[36614]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.9 MiB/s wr, 591 op/s 2024-06-02T22:44:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 415.0 s, 626.0 tps, lat 162.622 ms stddev 180.969 2024-06-02T22:44:20.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:20 smithi031 ceph-mon[31767]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.6 MiB/s wr, 571 op/s 2024-06-02T22:44:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:20 smithi098 ceph-mon[36750]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.6 MiB/s wr, 571 op/s 2024-06-02T22:44:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:20 smithi178 ceph-mon[36614]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.6 MiB/s wr, 571 op/s 2024-06-02T22:44:22.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:22 smithi031 ceph-mon[31767]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-06-02T22:44:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:22 smithi098 ceph-mon[36750]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-06-02T22:44:22.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:22 smithi178 ceph-mon[36614]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-06-02T22:44:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:24 smithi031 ceph-mon[31767]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-06-02T22:44:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:24 smithi098 ceph-mon[36750]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-06-02T22:44:24.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:24 smithi178 ceph-mon[36614]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-06-02T22:44:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 420.0 s, 555.8 tps, lat 176.824 ms stddev 218.227 2024-06-02T22:44:26.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:26 smithi031 ceph-mon[31767]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-06-02T22:44:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:26 smithi098 ceph-mon[36750]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-06-02T22:44:26.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:26 smithi178 ceph-mon[36614]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.3 MiB/s wr, 534 op/s 2024-06-02T22:44:28.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:28 smithi098 ceph-mon[36750]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-06-02T22:44:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:28 smithi178 ceph-mon[36614]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-06-02T22:44:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:28 smithi031 ceph-mon[31767]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-06-02T22:44:30.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 425.0 s, 679.8 tps, lat 148.988 ms stddev 163.262 2024-06-02T22:44:30.425 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:30 smithi031 ceph-mon[31767]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2024-06-02T22:44:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:30 smithi098 ceph-mon[36750]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2024-06-02T22:44:30.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:30 smithi178 ceph-mon[36614]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 5.9 MiB/s wr, 560 op/s 2024-06-02T22:44:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 -- 172.21.15.31:0/2284855906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c102a20 msgr2=0x7f122c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 --2- 172.21.15.31:0/2284855906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c102a20 0x7f122c102ea0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f121800dbf0 tx=0x7f121802e2a0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 -- 172.21.15.31:0/2284855906 shutdown_connections 2024-06-02T22:44:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 --2- 172.21.15.31:0/2284855906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 0x7f122c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 --2- 172.21.15.31:0/2284855906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c102a20 0x7f122c102ea0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.172+0000 7f1231800640 1 --2- 172.21.15.31:0/2284855906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c101830 0x7f122c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.173+0000 7f1231800640 1 -- 172.21.15.31:0/2284855906 >> 172.21.15.31:0/2284855906 conn(0x7f122c0fcda0 msgr2=0x7f122c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.173+0000 7f1231800640 1 -- 172.21.15.31:0/2284855906 shutdown_connections 2024-06-02T22:44:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.173+0000 7f1231800640 1 -- 172.21.15.31:0/2284855906 wait complete. 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 Processor -- start 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 -- start start 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 0x7f122c195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 0x7f122c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10b2a0 con 0x7f122c102a20 2024-06-02T22:44:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10b120 con 0x7f122c1033e0 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f1231800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f122c10b420 con 0x7f122c101830 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.174+0000 7f122be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f1230e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 0x7f122c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48282/0 (socket says 172.21.15.31:48282) 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 -- 172.21.15.31:0/3197007497 learned_addr learned my addr 172.21.15.31:0/3197007497 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:31.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122b400640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 0x7f122c195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 -- 172.21.15.31:0/3197007497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 msgr2=0x7f122c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 0x7f122c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 -- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 msgr2=0x7f122c195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 0x7f122c195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122be00640 1 -- 172.21.15.31:0/3197007497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f122c19d4c0 con 0x7f122c101830 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.175+0000 7f122b400640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 0x7f122c195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.176+0000 7f122be00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c970 tx=0x7f121c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.176+0000 7f1228c00640 1 -- 172.21.15.31:0/3197007497 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c007c10 con 0x7f122c101830 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.176+0000 7f1228c00640 1 -- 172.21.15.31:0/3197007497 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f121c007db0 con 0x7f122c101830 2024-06-02T22:44:31.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.176+0000 7f1228c00640 1 -- 172.21.15.31:0/3197007497 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c00f9b0 con 0x7f122c101830 2024-06-02T22:44:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.177+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122c19d7b0 con 0x7f122c101830 2024-06-02T22:44:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.177+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122c19dcb0 con 0x7f122c101830 2024-06-02T22:44:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.180+0000 7f1228c00640 1 -- 172.21.15.31:0/3197007497 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f121c00fb50 con 0x7f122c101830 2024-06-02T22:44:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 Processor -- start 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 -- start start 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1228c00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 0x7f12100a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e62d90 0x55d536e631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e63780 0x55d536e68280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1228c00640 1 -- 172.21.15.31:0/3197007497 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f121c0cf680 con 0x7f122c101830 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d536dc6420 con 0x55d536e63780 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d536d6dc50 con 0x55d536e688f0 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.182+0000 7f1235c0a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d536dc23e0 con 0x55d536e62d90 2024-06-02T22:44:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 0x7f12100a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58916/0 (socket says 172.21.15.31:58916) 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 -- 172.21.15.31:0/944539886 learned_addr learned my addr 172.21.15.31:0/944539886 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f122be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e62d90 0x55d536e631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f122b400640 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e63780 0x55d536e68280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 -- 172.21.15.31:0/944539886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e62d90 msgr2=0x55d536e631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e62d90 0x55d536e631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 -- 172.21.15.31:0/944539886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e63780 msgr2=0x55d536e68280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e63780 0x55d536e68280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.183+0000 7f1230e00640 1 -- 172.21.15.31:0/944539886 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d536ada210 con 0x55d536e688f0 2024-06-02T22:44:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.184+0000 7f1230e00640 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f122400e790 tx=0x7f122400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4195dee0a68b6b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.185+0000 7f1221600640 1 -- 172.21.15.31:0/944539886 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122401a480 con 0x55d536e688f0 2024-06-02T22:44:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.186+0000 7f1221600640 1 -- 172.21.15.31:0/944539886 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1224013070 con 0x55d536e688f0 2024-06-02T22:44:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.186+0000 7f1221600640 1 -- 172.21.15.31:0/944539886 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224019a10 con 0x55d536e688f0 2024-06-02T22:44:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.187+0000 7f1235c0a740 1 -- 172.21.15.31:0/944539886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 msgr2=0x55d536e6ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.187+0000 7f1235c0a740 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f122400e790 tx=0x7f122400ec50 comp rx=0 tx=0).stop 2024-06-02T22:44:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.187+0000 7f1230e00640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 0x7f12100a5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1224020000 tx=0x7f1224018710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 -- 172.21.15.31:0/944539886 shutdown_connections 2024-06-02T22:44:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e688f0 0x55d536e6ad80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e63780 0x55d536e68280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 --2- 172.21.15.31:0/944539886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e62d90 0x55d536e631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 -- 172.21.15.31:0/944539886 >> 172.21.15.31:0/944539886 conn(0x55d536e2af80 msgr2=0x55d536e5e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 -- 172.21.15.31:0/944539886 shutdown_connections 2024-06-02T22:44:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.188+0000 7f1235c0a740 1 -- 172.21.15.31:0/944539886 wait complete. 2024-06-02T22:44:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.189+0000 7f1235c0a740 1 -- start start 2024-06-02T22:44:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.189+0000 7f1235c0a740 1 Processor -- start 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e62d90 0x55d536e758d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 0x55d536e75e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 0x55d536e7ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d536e6b8a0 con 0x55d536e688f0 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d536d810b0 con 0x55d536e62d90 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d536e6ba20 con 0x55d536e63780 2024-06-02T22:44:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.190+0000 7f1235c0a740 10 client.0 _ll_register_callbacks cb 0x55d536d6cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.191+0000 7f122b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 0x55d536e75e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.191+0000 7f1230e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 0x55d536e7ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.191+0000 7f1230e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 0x55d536e7ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44464/0 (socket says 172.21.15.31:44464) 2024-06-02T22:44:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.191+0000 7f1230e00640 1 -- 172.21.15.31:0/3479511904 learned_addr learned my addr 172.21.15.31:0/3479511904 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.193+0000 7f122b400640 1 -- 172.21.15.31:0/3479511904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e62d90 msgr2=0x55d536e758d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.193+0000 7f122b400640 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e62d90 0x55d536e758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.193+0000 7f122b400640 1 -- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 msgr2=0x55d536e7ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.193+0000 7f122b400640 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 0x55d536e7ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.193+0000 7f122b400640 1 -- 172.21.15.31:0/3479511904 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d536ba6620 con 0x55d536e63780 2024-06-02T22:44:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.195+0000 7f122b400640 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 0x55d536e75e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f121800dbc0 tx=0x7f121800d230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8d11acced2c779e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.195+0000 7f1216000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:44:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.198+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218043060 con 0x55d536e63780 2024-06-02T22:44:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.199+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1224013070 con 0x55d536e63780 2024-06-02T22:44:31.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.202+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f12180368c0 con 0x55d536e63780 2024-06-02T22:44:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.203+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f121804a050 con 0x55d536e63780 2024-06-02T22:44:31.203 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.203+0000 7f1235c0a740 10 client.25726 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:31.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.203+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d536e80280 con 0x55d536e63780 2024-06-02T22:44:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.206+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1224013070 con 0x55d536e63780 2024-06-02T22:44:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.206+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f12180046c0 con 0x55d536e63780 2024-06-02T22:44:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 10 client.25726 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 20 client.25726 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536e81970 0x55d536e83d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 4 client.25726 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:44:31.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.207+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d536dd3b50 con 0x55d536e81970 2024-06-02T22:44:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.209+0000 7f122be00640 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536e81970 0x55d536e83d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.212+0000 7f122be00640 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536e81970 0x55d536e83d60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e85b721c75d75237 server_cookie=5de53d07f2802339 in_seq=0 out_seq=0 2024-06-02T22:44:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.213+0000 7f1216000640 10 client.25726 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.213+0000 7f1216000640 1 -- 172.21.15.31:0/3479511904 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d536dd3b50 con 0x55d536e81970 2024-06-02T22:44:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.213+0000 7f1216000640 10 client.25726 handle_command_reply: tid=0 2024-06-02T22:44:31.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 client.25726 shutdown 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 msgr2=0x55d536e75e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 0x55d536e75e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f121800dbc0 tx=0x7f121800d230 comp rx=0 tx=0).stop 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 shutdown_connections 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536e81970 0x55d536e83d60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e688f0 0x55d536e7ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1216000640 0 client.25726 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e63780 0x55d536e75e10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3479511904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e62d90 0x55d536e758d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.215+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 >> 172.21.15.31:0/3479511904 conn(0x55d536e2af80 msgr2=0x55d536e5d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.216+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 shutdown_connections 2024-06-02T22:44:31.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.216+0000 7f1235c0a740 1 -- 172.21.15.31:0/3479511904 wait complete. 2024-06-02T22:44:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.219+0000 7f1235c0a740 20 client.25726 trim_cache size 0 max 16384 2024-06-02T22:44:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.261+0000 7f1235c0a740 1 Processor -- start 2024-06-02T22:44:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.261+0000 7f1235c0a740 1 -- start start 2024-06-02T22:44:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.262+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.262+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.262+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536e64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.262+0000 7f1235c0a740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a8200 con 0x55d536e62d90 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f1235c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a9d40 con 0x55d536e63780 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f1235c0a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a88d0 con 0x55d536e688f0 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58944/0 (socket says 172.21.15.31:58944) 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122b400640 1 -- 172.21.15.31:0/507041637 learned_addr learned my addr 172.21.15.31:0/507041637 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:31.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f1230e00640 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536e64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122be00640 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122b400640 1 -- 172.21.15.31:0/507041637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 msgr2=0x55d536e64a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.263+0000 7f122b400640 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536e64a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f122b400640 1 -- 172.21.15.31:0/507041637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 msgr2=0x55d536e640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f122b400640 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f122b400640 1 -- 172.21.15.31:0/507041637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d536e5a1c0 con 0x55d536e63780 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f122b400640 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1218004c20 tx=0x7f1218005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919e466415c7e5d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f1220c00640 1 -- 172.21.15.31:0/507041637 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218043050 con 0x55d536e63780 2024-06-02T22:44:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f1220c00640 1 -- 172.21.15.31:0/507041637 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f121800d860 con 0x55d536e63780 2024-06-02T22:44:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.264+0000 7f1220c00640 1 -- 172.21.15.31:0/507041637 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12180053e0 con 0x55d536e63780 2024-06-02T22:44:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.265+0000 7f1235c0a740 1 -- 172.21.15.31:0/507041637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 msgr2=0x55d536e7ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.265+0000 7f1235c0a740 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1218004c20 tx=0x7f1218005f90 comp rx=0 tx=0).stop 2024-06-02T22:44:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 -- 172.21.15.31:0/507041637 shutdown_connections 2024-06-02T22:44:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536e64a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7ce10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 --2- 172.21.15.31:0/507041637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 -- 172.21.15.31:0/507041637 >> 172.21.15.31:0/507041637 conn(0x55d536e2af80 msgr2=0x55d536e5e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 -- 172.21.15.31:0/507041637 shutdown_connections 2024-06-02T22:44:31.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.268+0000 7f1235c0a740 1 -- 172.21.15.31:0/507041637 wait complete. 2024-06-02T22:44:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.269+0000 7f1235c0a740 1 -- start start 2024-06-02T22:44:31.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.269+0000 7f1235c0a740 1 Processor -- start 2024-06-02T22:44:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.272+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e79cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a9670 con 0x55d536e62d90 2024-06-02T22:44:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a8fa0 con 0x55d536e63780 2024-06-02T22:44:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f122c1a61e0 con 0x55d536e688f0 2024-06-02T22:44:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.273+0000 7f1235c0a740 10 client.0 _ll_register_callbacks cb 0x7f1224009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.274+0000 7f122b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.274+0000 7f1230e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.274+0000 7f122b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58952/0 (socket says 172.21.15.31:58952) 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.274+0000 7f1230e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48316/0 (socket says 172.21.15.31:48316) 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.274+0000 7f122b400640 1 -- 172.21.15.31:0/3631897758 learned_addr learned my addr 172.21.15.31:0/3631897758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f122be00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e79cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f1230e00640 1 -- 172.21.15.31:0/3631897758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 msgr2=0x55d536e7a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f1230e00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f1230e00640 1 -- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 msgr2=0x55d536e79cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f1230e00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e79cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f1230e00640 1 -- 172.21.15.31:0/3631897758 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d536eeab50 con 0x55d536e688f0 2024-06-02T22:44:31.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.275+0000 7f122be00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e79cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:44:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.276+0000 7f1230e00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1224018c10 tx=0x7f12240095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b4f8afdf95b3b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.276+0000 7f1216000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:44:31.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.278+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224004cb0 con 0x55d536e688f0 2024-06-02T22:44:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.278+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f122401a690 con 0x55d536e688f0 2024-06-02T22:44:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.280+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f121800d860 con 0x55d536e688f0 2024-06-02T22:44:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.280+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1224009880 con 0x55d536e688f0 2024-06-02T22:44:31.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.280+0000 7f1235c0a740 10 client.25732 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:31.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.280+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d536eebdd0 con 0x55d536e688f0 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f121800d860 con 0x55d536e688f0 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1224023070 con 0x55d536e688f0 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 10 client.25732 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 20 client.25732 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536eec5a0 0x55d536eee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 4 client.25732 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.281+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d536dcdea0 con 0x55d536eec5a0 2024-06-02T22:44:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.284+0000 7f122be00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536eec5a0 0x55d536eee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.285+0000 7f122be00640 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536eec5a0 0x55d536eee9c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1298e9c1a26db0 server_cookie=56c1fca6585d59a in_seq=0 out_seq=0 2024-06-02T22:44:31.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.285+0000 7f1216000640 10 client.25732 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.359+0000 7f1216000640 1 -- 172.21.15.31:0/3631897758 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d536dcdea0 con 0x55d536eec5a0 2024-06-02T22:44:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.359+0000 7f1216000640 10 client.25732 handle_command_reply: tid=0 2024-06-02T22:44:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.359+0000 7f1235c0a740 1 client.25732 shutdown 2024-06-02T22:44:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 msgr2=0x55d536eea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1224018c10 tx=0x7f12240095c0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 shutdown_connections 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d536eec5a0 0x55d536eee9c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d536e688f0 0x55d536eea610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d536e63780 0x55d536e7a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 --2- 172.21.15.31:0/3631897758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d536e62d90 0x55d536e79cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1216000640 0 client.25732 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 >> 172.21.15.31:0/3631897758 conn(0x55d536e2af80 msgr2=0x55d536e757d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 shutdown_connections 2024-06-02T22:44:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.360+0000 7f1235c0a740 1 -- 172.21.15.31:0/3631897758 wait complete. 2024-06-02T22:44:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.361+0000 7f1235c0a740 20 client.25732 trim_cache size 0 max 16384 2024-06-02T22:44:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:44:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:44:31.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:44:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 msgr2=0x7f12100a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 0x7f12100a5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1224020000 tx=0x7f1224018710 comp rx=0 tx=0).stop 2024-06-02T22:44:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 msgr2=0x7f122c1958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:31.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c970 tx=0x7f121c00ce30 comp rx=0 tx=0).stop 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 shutdown_connections 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f12100a2d50 0x7f12100a5210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f122c1033e0 0x7f122c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f122c102a20 0x7f122c195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 --2- 172.21.15.31:0/3197007497 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122c101830 0x7f122c1958a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 >> 172.21.15.31:0/3197007497 conn(0x7f122c0fcda0 msgr2=0x7f122c105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 shutdown_connections 2024-06-02T22:44:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:31.363+0000 7f1231800640 1 -- 172.21.15.31:0/3197007497 wait complete. 2024-06-02T22:44:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:32 smithi098 ceph-mon[36750]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 MiB/s wr, 512 op/s 2024-06-02T22:44:32.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:32 smithi178 ceph-mon[36614]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 MiB/s wr, 512 op/s 2024-06-02T22:44:32.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:32 smithi031 ceph-mon[31767]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.4 MiB/s wr, 512 op/s 2024-06-02T22:44:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:34 smithi098 ceph-mon[36750]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-06-02T22:44:34.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:34 smithi178 ceph-mon[36614]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-06-02T22:44:34.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:34 smithi031 ceph-mon[31767]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 638 op/s 2024-06-02T22:44:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 430.0 s, 529.7 tps, lat 183.626 ms stddev 213.460 2024-06-02T22:44:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:36 smithi098 ceph-mon[36750]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 531 op/s 2024-06-02T22:44:36.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:36 smithi178 ceph-mon[36614]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 531 op/s 2024-06-02T22:44:36.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:36 smithi031 ceph-mon[31767]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 531 op/s 2024-06-02T22:44:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:38 smithi098 ceph-mon[36750]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-06-02T22:44:38.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:38 smithi178 ceph-mon[36614]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-06-02T22:44:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:38 smithi031 ceph-mon[31767]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-06-02T22:44:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 435.0 s, 556.8 tps, lat 180.208 ms stddev 260.840 2024-06-02T22:44:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:40 smithi098 ceph-mon[36750]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-06-02T22:44:40.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:40 smithi178 ceph-mon[36614]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-06-02T22:44:40.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:40 smithi031 ceph-mon[31767]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 651 op/s 2024-06-02T22:44:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:42 smithi098 ceph-mon[36750]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-06-02T22:44:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:42 smithi178 ceph-mon[36614]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-06-02T22:44:42.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:42 smithi031 ceph-mon[31767]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 622 op/s 2024-06-02T22:44:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:44 smithi098 ceph-mon[36750]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 834 op/s 2024-06-02T22:44:44.476 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:44 smithi031 ceph-mon[31767]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 834 op/s 2024-06-02T22:44:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:44 smithi178 ceph-mon[36614]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.8 MiB/s wr, 834 op/s 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.709+0000 7f9ea0200640 1 -- 172.21.15.31:0/3453308084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e98104e20 msgr2=0x7f9e981052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.709+0000 7f9ea0200640 1 --2- 172.21.15.31:0/3453308084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e98104e20 0x7f9e981052a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009900 tx=0x7f9e8402a410 comp rx=0 tx=0).stop 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.710+0000 7f9ea0200640 1 -- 172.21.15.31:0/3453308084 shutdown_connections 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.710+0000 7f9ea0200640 1 --2- 172.21.15.31:0/3453308084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e981057e0 0x7f9e9810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.710+0000 7f9ea0200640 1 --2- 172.21.15.31:0/3453308084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e98104e20 0x7f9e981052a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.710+0000 7f9ea0200640 1 --2- 172.21.15.31:0/3453308084 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e98103c30 0x7f9e98104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.710+0000 7f9ea0200640 1 -- 172.21.15.31:0/3453308084 >> 172.21.15.31:0/3453308084 conn(0x7f9e980ff1c0 msgr2=0x7f9e981015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.713+0000 7f9ea0200640 1 -- 172.21.15.31:0/3453308084 shutdown_connections 2024-06-02T22:44:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.713+0000 7f9ea0200640 1 -- 172.21.15.31:0/3453308084 wait complete. 2024-06-02T22:44:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.715+0000 7f9ea0200640 1 Processor -- start 2024-06-02T22:44:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.715+0000 7f9ea0200640 1 -- start start 2024-06-02T22:44:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e98103c30 0x7f9e98195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 0x7f9e981961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 0x7f9e981ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810f890 con 0x7f9e981057e0 2024-06-02T22:44:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810f710 con 0x7f9e9819b1f0 2024-06-02T22:44:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9ea0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9810fa10 con 0x7f9e98103c30 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9e9e200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 0x7f9e981ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9e9e200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 0x7f9e981ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47988/0 (socket says 172.21.15.31:47988) 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9e9e200640 1 -- 172.21.15.31:0/4018067231 learned_addr learned my addr 172.21.15.31:0/4018067231 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.716+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 0x7f9e981961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9d800640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e98103c30 0x7f9e98195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9ce00640 1 -- 172.21.15.31:0/4018067231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e98103c30 msgr2=0x7f9e98195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e98103c30 0x7f9e98195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9ce00640 1 -- 172.21.15.31:0/4018067231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 msgr2=0x7f9e981ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 0x7f9e981ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.717+0000 7f9e9ce00640 1 -- 172.21.15.31:0/4018067231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e981aecd0 con 0x7f9e981057e0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.718+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 0x7f9e981961e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e84008000 tx=0x7f9e84031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.719+0000 7f9e96000640 1 -- 172.21.15.31:0/4018067231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8403f070 con 0x7f9e981057e0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.719+0000 7f9e96000640 1 -- 172.21.15.31:0/4018067231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e84003cd0 con 0x7f9e981057e0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.719+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e981aef00 con 0x7f9e981057e0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.719+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e981af310 con 0x7f9e981057e0 2024-06-02T22:44:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.719+0000 7f9e96000640 1 -- 172.21.15.31:0/4018067231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84035070 con 0x7f9e981057e0 2024-06-02T22:44:44.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.723+0000 7f9e96000640 1 -- 172.21.15.31:0/4018067231 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f9e8403b460 con 0x7f9e981057e0 2024-06-02T22:44:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.725+0000 7f9e96000640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 0x7f9e800a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.726+0000 7f9e96000640 1 -- 172.21.15.31:0/4018067231 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9e840ef4e0 con 0x7f9e981057e0 2024-06-02T22:44:44.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.726+0000 7f9e9d800640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 0x7f9e800a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.727+0000 7f9e9d800640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 0x7f9e800a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e98104c80 tx=0x7f9e8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.740 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.740+0000 7f9ea3176740 1 Processor -- start 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.740+0000 7f9ea3176740 1 -- start start 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 0x55f7b33d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 0x55f7b33d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d9730 0x55f7b33dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f7b3337420 con 0x55f7b33d9730 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f7b32dec50 con 0x55f7b33d3bd0 2024-06-02T22:44:44.741 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9ea3176740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f7b33333e0 con 0x55f7b33d45c0 2024-06-02T22:44:44.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 0x55f7b33d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 0x55f7b33d90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48378/0 (socket says 172.21.15.31:48378) 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9e9ce00640 1 -- 172.21.15.31:0/202490639 learned_addr learned my addr 172.21.15.31:0/202490639 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.741+0000 7f9e9d800640 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 0x55f7b33d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 -- 172.21.15.31:0/202490639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 msgr2=0x55f7b33d90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 0x55f7b33d90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 -- 172.21.15.31:0/202490639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d9730 msgr2=0x55f7b33dbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d9730 0x55f7b33dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 -- 172.21.15.31:0/202490639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b304b210 con 0x55f7b33d3bd0 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.742+0000 7f9e9d800640 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 0x55f7b33d3ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0117b0 tx=0x7f9e8c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c43a18b473980a8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.743+0000 7f9e8aa00640 1 -- 172.21.15.31:0/202490639 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c012e60 con 0x55f7b33d3bd0 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.743+0000 7f9e8aa00640 1 -- 172.21.15.31:0/202490639 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8c01fb00 con 0x55f7b33d3bd0 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.743+0000 7f9e8aa00640 1 -- 172.21.15.31:0/202490639 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c027bf0 con 0x55f7b33d3bd0 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 -- 172.21.15.31:0/202490639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 msgr2=0x55f7b33d3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 0x55f7b33d3ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0117b0 tx=0x7f9e8c014000 comp rx=0 tx=0).stop 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 -- 172.21.15.31:0/202490639 shutdown_connections 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d9730 0x55f7b33dbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d45c0 0x55f7b33d90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 --2- 172.21.15.31:0/202490639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d3bd0 0x55f7b33d3ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 -- 172.21.15.31:0/202490639 >> 172.21.15.31:0/202490639 conn(0x55f7b339bf80 msgr2=0x55f7b33cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.744+0000 7f9ea3176740 1 -- 172.21.15.31:0/202490639 shutdown_connections 2024-06-02T22:44:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.745+0000 7f9ea3176740 1 -- 172.21.15.31:0/202490639 wait complete. 2024-06-02T22:44:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.745+0000 7f9ea3176740 1 -- start start 2024-06-02T22:44:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.746+0000 7f9ea3176740 1 Processor -- start 2024-06-02T22:44:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.747+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.747+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.748+0000 7f9e9d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.748+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.748+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48006/0 (socket says 172.21.15.31:48006) 2024-06-02T22:44:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.748+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d9730 0x55f7b33e5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.748+0000 7f9e9d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46196/0 (socket says 172.21.15.31:46196) 2024-06-02T22:44:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9ea3176740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f7b33dc6e0 con 0x55f7b33d3bd0 2024-06-02T22:44:44.750 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9ea3176740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f7b32f20b0 con 0x55f7b33d45c0 2024-06-02T22:44:44.750 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9ea3176740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f7b33dc860 con 0x55f7b33d9730 2024-06-02T22:44:44.750 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1896471862 learned_addr learned my addr 172.21.15.31:0/1896471862 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:44.750 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9e200640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d9730 0x55f7b33e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9ea3176740 10 client.0 _ll_register_callbacks cb 0x55f7b32ddf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1896471862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d9730 msgr2=0x55f7b33e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d9730 0x55f7b33e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 msgr2=0x55f7b33ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.749+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1896471862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b3117620 con 0x55f7b33d45c0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e9d800640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e840314e0 tx=0x7f9e840bb370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb200336191dc41 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840d4060 con 0x55f7b33d45c0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.750+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9e840b7fc0 con 0x55f7b33d45c0 2024-06-02T22:44:44.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.751+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8c01fb00 con 0x55f7b33d45c0 2024-06-02T22:44:44.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.751+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e840d9050 con 0x55f7b33d45c0 2024-06-02T22:44:44.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.751+0000 7f9ea3176740 10 client.25748 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:44.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.751+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f7b33e87b0 con 0x55f7b33d45c0 2024-06-02T22:44:44.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.751+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8c01fb00 con 0x55f7b33d45c0 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9e840bbcb0 con 0x55f7b33d45c0 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 10 client.25748 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 10 client.25748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 20 client.25748 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33e9f10 0x55f7b33ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 4 client.25748 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.752+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7b3344b50 con 0x55f7b33e9f10 2024-06-02T22:44:44.753 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.753+0000 7f9e9d800640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33e9f10 0x55f7b33ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.754+0000 7f9e9d800640 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33e9f10 0x55f7b33ec3b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=392bfb168833d5f2 server_cookie=6bdd6062f6523c81 in_seq=0 out_seq=0 2024-06-02T22:44:44.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.754+0000 7f9e7f400640 10 client.25748 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.756+0000 7f9e7f400640 1 -- 172.21.15.31:0/1896471862 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f7b3344b50 con 0x55f7b33e9f10 2024-06-02T22:44:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.756+0000 7f9e7f400640 10 client.25748 handle_command_reply: tid=0 2024-06-02T22:44:44.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.757+0000 7f9ea3176740 1 client.25748 shutdown 2024-06-02T22:44:44.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.757+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 msgr2=0x55f7b33de440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e840314e0 tx=0x7f9e840bb370 comp rx=0 tx=0).stop 2024-06-02T22:44:44.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 shutdown_connections 2024-06-02T22:44:44.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33e9f10 0x55f7b33ec3b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d9730 0x55f7b33e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9e7f400640 0 client.25748 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33de440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.758+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1896471862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.759+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 >> 172.21.15.31:0/1896471862 conn(0x55f7b339bf80 msgr2=0x55f7b33ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.760+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 shutdown_connections 2024-06-02T22:44:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.760+0000 7f9ea3176740 1 -- 172.21.15.31:0/1896471862 wait complete. 2024-06-02T22:44:44.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.761+0000 7f9ea3176740 20 client.25748 trim_cache size 0 max 16384 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.795+0000 7f9ea3176740 1 Processor -- start 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.795+0000 7f9ea3176740 1 -- start start 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.795+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b339bf80 0x55f7b33cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.795+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.795+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9ea3176740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7800fc90 con 0x55f7b33d3bd0 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9ea3176740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780117d0 con 0x55f7b33d45c0 2024-06-02T22:44:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9ea3176740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78010360 con 0x55f7b339bf80 2024-06-02T22:44:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46200/0 (socket says 172.21.15.31:46200) 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1737558973 learned_addr learned my addr 172.21.15.31:0/1737558973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9d800640 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b339bf80 0x55f7b33cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9e200640 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1737558973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b339bf80 msgr2=0x55f7b33cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b339bf80 0x55f7b33cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1737558973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 msgr2=0x55f7b33cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.796+0000 7f9e9ce00640 1 -- 172.21.15.31:0/1737558973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b33d0300 con 0x55f7b33d3bd0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.797+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b7db0 tx=0x7f9e840b9e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee60abda5ffbcdd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.797+0000 7f9e8a000640 1 -- 172.21.15.31:0/1737558973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84048040 con 0x55f7b33d3bd0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.797+0000 7f9e8a000640 1 -- 172.21.15.31:0/1737558973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8403be50 con 0x55f7b33d3bd0 2024-06-02T22:44:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.797+0000 7f9e8a000640 1 -- 172.21.15.31:0/1737558973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ef190 con 0x55f7b33d3bd0 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 -- 172.21.15.31:0/1737558973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 msgr2=0x55f7b33e5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b7db0 tx=0x7f9e840b9e60 comp rx=0 tx=0).stop 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 -- 172.21.15.31:0/1737558973 shutdown_connections 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e5440 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 --2- 172.21.15.31:0/1737558973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b339bf80 0x55f7b33cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 -- 172.21.15.31:0/1737558973 >> 172.21.15.31:0/1737558973 conn(0x55f7b33d9270 msgr2=0x55f7b33d5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 -- 172.21.15.31:0/1737558973 shutdown_connections 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.798+0000 7f9ea3176740 1 -- 172.21.15.31:0/1737558973 wait complete. 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 -- start start 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 Processor -- start 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 0x55f7b33e2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78011100 con 0x55f7b339bf80 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78010a30 con 0x55f7b33d45c0 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7800dc70 con 0x55f7b33d3bd0 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9ea3176740 10 client.0 _ll_register_callbacks cb 0x7f9e84003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9e200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 0x55f7b33e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9ce00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 0x55f7b33e2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46216/0 (socket says 172.21.15.31:46216) 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9d800640 1 -- 172.21.15.31:0/2919976628 learned_addr learned my addr 172.21.15.31:0/2919976628 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.799+0000 7f9e9e200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48024/0 (socket says 172.21.15.31:48024) 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 -- 172.21.15.31:0/2919976628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 msgr2=0x55f7b33e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 -- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 msgr2=0x55f7b33e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 0x55f7b33e2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 -- 172.21.15.31:0/2919976628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b33e4090 con 0x55f7b33d3bd0 2024-06-02T22:44:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e9ce00640 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e2a90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b8320 tx=0x7f9e840c4450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ccbc8ac1a9ab3be server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:44.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84048030 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9e840ef190 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.800+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8403be50 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e840d4020 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 10 client.25750 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f7b33e4090 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8403be50 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9e840bbbb0 con 0x55f7b33d3bd0 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 10 client.25750 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 20 client.25750 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33d9730 0x55f7b3456d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 4 client.25750 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.801+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7b333eea0 con 0x55f7b33d9730 2024-06-02T22:44:44.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.802+0000 7f9e9d800640 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33d9730 0x55f7b3456d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.802+0000 7f9e9d800640 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33d9730 0x55f7b3456d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecc0b2ee0b4747c8 server_cookie=f57a3877003d0555 in_seq=0 out_seq=0 2024-06-02T22:44:44.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.802+0000 7f9e7f400640 10 client.25750 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.828+0000 7f9e7f400640 1 -- 172.21.15.31:0/2919976628 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f7b333eea0 con 0x55f7b33d9730 2024-06-02T22:44:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.828+0000 7f9e7f400640 10 client.25750 handle_command_reply: tid=0 2024-06-02T22:44:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.828+0000 7f9ea3176740 1 client.25750 shutdown 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.828+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 msgr2=0x55f7b33e2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.828+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e2a90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b8320 tx=0x7f9e840c4450 comp rx=0 tx=0).stop 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 shutdown_connections 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55f7b33d9730 0x55f7b3456d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f7b33d45c0 0x55f7b33e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9e7f400640 0 client.25750 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f7b33d3bd0 0x55f7b33e2a90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 --2- 172.21.15.31:0/2919976628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f7b339bf80 0x55f7b33e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 >> 172.21.15.31:0/2919976628 conn(0x55f7b33d9270 msgr2=0x55f7b33d5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 shutdown_connections 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 1 -- 172.21.15.31:0/2919976628 wait complete. 2024-06-02T22:44:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.829+0000 7f9ea3176740 20 client.25750 trim_cache size 0 max 16384 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 msgr2=0x7f9e800a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 0x7f9e800a5260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e98104c80 tx=0x7f9e8c005f90 comp rx=0 tx=0).stop 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 msgr2=0x7f9e981961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 0x7f9e981961e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e84008000 tx=0x7f9e84031b60 comp rx=0 tx=0).stop 2024-06-02T22:44:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 shutdown_connections 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9e800a2da0 0x7f9e800a5260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e9819b1f0 0x7f9e981ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e981057e0 0x7f9e981961e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 --2- 172.21.15.31:0/4018067231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e98103c30 0x7f9e98195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 >> 172.21.15.31:0/4018067231 conn(0x7f9e980ff1c0 msgr2=0x7f9e98077f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 shutdown_connections 2024-06-02T22:44:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:44.830+0000 7f9ea0200640 1 -- 172.21.15.31:0/4018067231 wait complete. 2024-06-02T22:44:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 440.0 s, 584.3 tps, lat 166.005 ms stddev 199.455 2024-06-02T22:44:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:46 smithi098 ceph-mon[36750]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-06-02T22:44:46.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:46 smithi178 ceph-mon[36614]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-06-02T22:44:46.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:46 smithi031 ceph-mon[31767]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.7 MiB/s wr, 732 op/s 2024-06-02T22:44:48.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 768 op/s 2024-06-02T22:44:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:44:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:48 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 768 op/s 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:48 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 768 op/s 2024-06-02T22:44:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:44:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:48.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:48 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 445.0 s, 515.7 tps, lat 198.877 ms stddev 264.009 2024-06-02T22:44:50.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:50 smithi178 ceph-mon[36614]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-06-02T22:44:50.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:50 smithi031 ceph-mon[31767]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-06-02T22:44:50.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:50 smithi098 ceph-mon[36750]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-06-02T22:44:51.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:44:51.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:44:51.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:51 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:44:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:44:51.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:51 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:44:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:44:51.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:51 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:44:52.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:52 smithi178 ceph-mon[36614]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:44:52.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:52 smithi031 ceph-mon[31767]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:44:52.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:52 smithi098 ceph-mon[36750]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:44:54.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:54 smithi178 ceph-mon[36614]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 690 op/s 2024-06-02T22:44:54.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:54 smithi031 ceph-mon[31767]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 690 op/s 2024-06-02T22:44:54.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:54 smithi098 ceph-mon[36750]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 690 op/s 2024-06-02T22:44:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 450.0 s, 547.8 tps, lat 180.884 ms stddev 276.366 2024-06-02T22:44:56.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:56 smithi178 ceph-mon[36614]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:44:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:56 smithi031 ceph-mon[31767]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:44:56.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:56 smithi098 ceph-mon[36750]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:44:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.060+0000 7f8a4b800640 1 -- 172.21.15.31:0/349075791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44104e30 msgr2=0x7f8a44107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.060+0000 7f8a4b800640 1 --2- 172.21.15.31:0/349075791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44104e30 0x7f8a44107220 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009860 tx=0x7f8a3002a340 comp rx=0 tx=0).stop 2024-06-02T22:44:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.061+0000 7f8a4b800640 1 -- 172.21.15.31:0/349075791 shutdown_connections 2024-06-02T22:44:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.061+0000 7f8a4b800640 1 --2- 172.21.15.31:0/349075791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44107760 0x7f8a44109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.061+0000 7f8a4b800640 1 --2- 172.21.15.31:0/349075791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44104e30 0x7f8a44107220 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.061+0000 7f8a4b800640 1 --2- 172.21.15.31:0/349075791 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44102500 0x7f8a441048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.061+0000 7f8a4b800640 1 -- 172.21.15.31:0/349075791 >> 172.21.15.31:0/349075791 conn(0x7f8a440fbe70 msgr2=0x7f8a440fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.063+0000 7f8a4b800640 1 -- 172.21.15.31:0/349075791 shutdown_connections 2024-06-02T22:44:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.064+0000 7f8a4b800640 1 -- 172.21.15.31:0/349075791 wait complete. 2024-06-02T22:44:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.065+0000 7f8a4b800640 1 Processor -- start 2024-06-02T22:44:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.065+0000 7f8a4b800640 1 -- start start 2024-06-02T22:44:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.067+0000 7f8a4b800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.067+0000 7f8a4b800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 0x7f8a44196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.067+0000 7f8a48e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.067+0000 7f8a48e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55218/0 (socket says 172.21.15.31:55218) 2024-06-02T22:44:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.067+0000 7f8a4b800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44107760 0x7f8a4419d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a4b800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4410d650 con 0x7f8a44104e30 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4410d4d0 con 0x7f8a44102500 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4410d7d0 con 0x7f8a44107760 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 -- 172.21.15.31:0/563124144 learned_addr learned my addr 172.21.15.31:0/563124144 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a49800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44107760 0x7f8a4419d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a43e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 0x7f8a44196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 -- 172.21.15.31:0/563124144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44107760 msgr2=0x7f8a4419d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44107760 0x7f8a4419d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 -- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 msgr2=0x7f8a44196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 0x7f8a44196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.068+0000 7f8a48e00640 1 -- 172.21.15.31:0/563124144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4419d6f0 con 0x7f8a44102500 2024-06-02T22:44:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.069+0000 7f8a43e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 0x7f8a44196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:44:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.070+0000 7f8a48e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800e9c0 tx=0x7f8a3800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.070+0000 7f8a41600640 1 -- 172.21.15.31:0/563124144 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800cde0 con 0x7f8a44102500 2024-06-02T22:44:58.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.071+0000 7f8a41600640 1 -- 172.21.15.31:0/563124144 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a380035f0 con 0x7f8a44102500 2024-06-02T22:44:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.071+0000 7f8a41600640 1 -- 172.21.15.31:0/563124144 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38010650 con 0x7f8a44102500 2024-06-02T22:44:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.071+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4419d9e0 con 0x7f8a44102500 2024-06-02T22:44:58.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.071+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4419dee0 con 0x7f8a44102500 2024-06-02T22:44:58.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.079+0000 7f8a41600640 1 -- 172.21.15.31:0/563124144 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f8a380037a0 con 0x7f8a44102500 2024-06-02T22:44:58.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.082+0000 7f8a41600640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 0x7f8a2c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.082+0000 7f8a41600640 1 -- 172.21.15.31:0/563124144 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8a380cf8c0 con 0x7f8a44102500 2024-06-02T22:44:58.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.085+0000 7f8a43e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 0x7f8a2c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.087+0000 7f8a43e00640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 0x7f8a2c0a50f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002a860 tx=0x7f8a30030db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.098+0000 7f8a4e61f740 1 Processor -- start 2024-06-02T22:44:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 -- start start 2024-06-02T22:44:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c2dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c330c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c33730 0x55fcc8c35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8b91420 con 0x55fcc8c33730 2024-06-02T22:44:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8b38c50 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.099+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8b8d3e0 con 0x55fcc8c2dbd0 2024-06-02T22:44:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.100+0000 7f8a48e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c2dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.100+0000 7f8a48e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c2dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45140/0 (socket says 172.21.15.31:45140) 2024-06-02T22:44:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.100+0000 7f8a48e00640 1 -- 172.21.15.31:0/1393167989 learned_addr learned my addr 172.21.15.31:0/1393167989 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.100+0000 7f8a43e00640 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a49800640 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c33730 0x55fcc8c35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a43e00640 1 -- 172.21.15.31:0/1393167989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 msgr2=0x55fcc8c2dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a43e00640 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c2dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a43e00640 1 -- 172.21.15.31:0/1393167989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c33730 msgr2=0x55fcc8c35bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a43e00640 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c33730 0x55fcc8c35bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.101+0000 7f8a43e00640 1 -- 172.21.15.31:0/1393167989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc88a5210 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.102+0000 7f8a43e00640 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c330c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002a930 tx=0x7f8a3003a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2d2603b583d658 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.107+0000 7f8a36000640 1 -- 172.21.15.31:0/1393167989 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30044040 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.107+0000 7f8a36000640 1 -- 172.21.15.31:0/1393167989 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a30038040 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.107+0000 7f8a36000640 1 -- 172.21.15.31:0/1393167989 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300049b0 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 -- 172.21.15.31:0/1393167989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 msgr2=0x55fcc8c330c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c330c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002a930 tx=0x7f8a3003a000 comp rx=0 tx=0).stop 2024-06-02T22:44:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 -- 172.21.15.31:0/1393167989 shutdown_connections 2024-06-02T22:44:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c33730 0x55fcc8c35bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c330c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/1393167989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c2dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.108+0000 7f8a4e61f740 1 -- 172.21.15.31:0/1393167989 >> 172.21.15.31:0/1393167989 conn(0x55fcc8bf5f80 msgr2=0x55fcc8c29650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.110+0000 7f8a4e61f740 1 -- 172.21.15.31:0/1393167989 shutdown_connections 2024-06-02T22:44:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.110+0000 7f8a4e61f740 1 -- 172.21.15.31:0/1393167989 wait complete. 2024-06-02T22:44:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.110+0000 7f8a4e61f740 1 -- start start 2024-06-02T22:44:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.111+0000 7f8a4e61f740 1 Processor -- start 2024-06-02T22:44:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.112+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.112+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c38470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.112+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8c36680 con 0x55fcc8c2dbd0 2024-06-02T22:44:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8b4c0b0 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fcc8c36800 con 0x55fcc8c33730 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a49800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a49800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45148/0 (socket says 172.21.15.31:45148) 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a49800640 1 -- 172.21.15.31:0/4007358416 learned_addr learned my addr 172.21.15.31:0/4007358416 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.113+0000 7f8a4e61f740 10 client.0 _ll_register_callbacks cb 0x55fcc8b37f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a48e00640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a49800640 1 -- 172.21.15.31:0/4007358416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 msgr2=0x55fcc8c38470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a49800640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c38470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a49800640 1 -- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 msgr2=0x55fcc8c37f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a49800640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.114+0000 7f8a49800640 1 -- 172.21.15.31:0/4007358416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcc8971620 con 0x55fcc8c33730 2024-06-02T22:44:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.117+0000 7f8a49800640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009d40 tx=0x7f8a3c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=680ec28f21d51d51 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.117+0000 7f8a2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:44:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.117+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c029070 con 0x55fcc8c33730 2024-06-02T22:44:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.118+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8a3c003970 con 0x55fcc8c33730 2024-06-02T22:44:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.118+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a30038040 con 0x55fcc8c33730 2024-06-02T22:44:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.118+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a3c003b70 con 0x55fcc8c33730 2024-06-02T22:44:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.118+0000 7f8a4e61f740 10 client.25762 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.118+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcc8c428d0 con 0x55fcc8c33730 2024-06-02T22:44:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a30038040 con 0x55fcc8c33730 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8a3c037470 con 0x55fcc8c33730 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 10 client.25762 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 20 client.25762 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8c44030 0x55fcc8c464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 4 client.25762 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.119+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcc8b9eb50 con 0x55fcc8c44030 2024-06-02T22:44:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.120+0000 7f8a48e00640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8c44030 0x55fcc8c464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.122+0000 7f8a48e00640 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8c44030 0x55fcc8c464c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da1be500d2432581 server_cookie=fd08f218b87c9bea in_seq=0 out_seq=0 2024-06-02T22:44:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.122+0000 7f8a2aa00640 10 client.25762 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.123+0000 7f8a2aa00640 1 -- 172.21.15.31:0/4007358416 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fcc8b9eb50 con 0x55fcc8c44030 2024-06-02T22:44:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.123+0000 7f8a2aa00640 10 client.25762 handle_command_reply: tid=0 2024-06-02T22:44:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.123+0000 7f8a4e61f740 1 client.25762 shutdown 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.123+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 msgr2=0x55fcc8c3f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009d40 tx=0x7f8a3c0107a0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 shutdown_connections 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8c44030 0x55fcc8c464c0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c3f4b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c38470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/4007358416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a2aa00640 0 client.25762 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 >> 172.21.15.31:0/4007358416 conn(0x55fcc8bf5f80 msgr2=0x55fcc8c28810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 shutdown_connections 2024-06-02T22:44:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.124+0000 7f8a4e61f740 1 -- 172.21.15.31:0/4007358416 wait complete. 2024-06-02T22:44:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.125+0000 7f8a4e61f740 20 client.25762 trim_cache size 0 max 16384 2024-06-02T22:44:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.159+0000 7f8a4e61f740 1 Processor -- start 2024-06-02T22:44:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.159+0000 7f8a4e61f740 1 -- start start 2024-06-02T22:44:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c38470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b0c90 con 0x55fcc8c2dbd0 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b27d0 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b1360 con 0x55fcc8c33730 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.160+0000 7f8a43e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a49800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c38470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55252/0 (socket says 172.21.15.31:55252) 2024-06-02T22:44:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 -- 172.21.15.31:0/2159067467 learned_addr learned my addr 172.21.15.31:0/2159067467 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a48e00640 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 -- 172.21.15.31:0/2159067467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 msgr2=0x55fcc8c38470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c38470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 -- 172.21.15.31:0/2159067467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 msgr2=0x55fcc8c37f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.161+0000 7f8a43e00640 1 -- 172.21.15.31:0/2159067467 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcc8c23c20 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.162+0000 7f8a43e00640 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8a30030b80 tx=0x7f8a30005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad46c9874fbd7f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.162+0000 7f8a35600640 1 -- 172.21.15.31:0/2159067467 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30044030 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.162+0000 7f8a35600640 1 -- 172.21.15.31:0/2159067467 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a30038040 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.163+0000 7f8a35600640 1 -- 172.21.15.31:0/2159067467 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004bf0 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.163+0000 7f8a4e61f740 1 -- 172.21.15.31:0/2159067467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 msgr2=0x55fcc8c3f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.163+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8a30030b80 tx=0x7f8a30005f90 comp rx=0 tx=0).stop 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 -- 172.21.15.31:0/2159067467 shutdown_connections 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c33730 0x55fcc8c38470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3f470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/2159067467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c37f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 -- 172.21.15.31:0/2159067467 >> 172.21.15.31:0/2159067467 conn(0x55fcc8bf5f80 msgr2=0x55fcc8c2f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 -- 172.21.15.31:0/2159067467 shutdown_connections 2024-06-02T22:44:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 -- 172.21.15.31:0/2159067467 wait complete. 2024-06-02T22:44:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.164+0000 7f8a4e61f740 1 -- start start 2024-06-02T22:44:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.165+0000 7f8a4e61f740 1 Processor -- start 2024-06-02T22:44:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.166+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.166+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.166+0000 7f8a4e61f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b2100 con 0x55fcc8c2dbd0 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b1a30 con 0x55fcc8c33730 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a4e61f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44071ee0 con 0x55fcc8c2e5c0 2024-06-02T22:44:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a4e61f740 10 client.0 _ll_register_callbacks cb 0x7f8a3c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a49800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a49800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55254/0 (socket says 172.21.15.31:55254) 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a49800640 1 -- 172.21.15.31:0/998310949 learned_addr learned my addr 172.21.15.31:0/998310949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.167+0000 7f8a48e00640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 -- 172.21.15.31:0/998310949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2e5c0 msgr2=0x55fcc8c3c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 -- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 msgr2=0x55fcc8c3c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:44:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c3c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 -- 172.21.15.31:0/998310949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcc8cad2d0 con 0x55fcc8c33730 2024-06-02T22:44:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.168+0000 7f8a49800640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c037720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3073db0e4a9672b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:44:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.169+0000 7f8a2aa00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:44:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.170+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c037d30 con 0x55fcc8c33730 2024-06-02T22:44:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.171+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8a3c0049e0 con 0x55fcc8c33730 2024-06-02T22:44:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.171+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a30038040 con 0x55fcc8c33730 2024-06-02T22:44:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.171+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a3c004be0 con 0x55fcc8c33730 2024-06-02T22:44:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.171+0000 7f8a4e61f740 10 client.25769 fetch_fsmap learned FSMap version 30 2024-06-02T22:44:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.172+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcc8cae640 con 0x55fcc8c33730 2024-06-02T22:44:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.172+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a30038040 con 0x55fcc8c33730 2024-06-02T22:44:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.173+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8a3c02d410 con 0x55fcc8c33730 2024-06-02T22:44:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.173+0000 7f8a4e61f740 10 client.25769 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:44:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.173+0000 7f8a4e61f740 10 client.25769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:44:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.173+0000 7f8a4e61f740 20 client.25769 populate_metadata read hostname 'smithi031' 2024-06-02T22:44:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.174+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8caef70 0x55fcc8cb1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:44:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.174+0000 7f8a4e61f740 4 client.25769 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:44:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.174+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcc8b98ea0 con 0x55fcc8caef70 2024-06-02T22:44:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.174+0000 7f8a48e00640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8caef70 0x55fcc8cb1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:44:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.175+0000 7f8a48e00640 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8caef70 0x55fcc8cb1390 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713429ecea8a21df server_cookie=c24107e7eddb1729 in_seq=0 out_seq=0 2024-06-02T22:44:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.175+0000 7f8a2aa00640 10 client.25769 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a2aa00640 1 -- 172.21.15.31:0/998310949 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fcc8b98ea0 con 0x55fcc8caef70 2024-06-02T22:44:58.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a2aa00640 10 client.25769 handle_command_reply: tid=0 2024-06-02T22:44:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a4e61f740 1 client.25769 shutdown 2024-06-02T22:44:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 msgr2=0x55fcc8cacd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c037720 comp rx=0 tx=0).stop 2024-06-02T22:44:58.289 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 shutdown_connections 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.288+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcc8caef70 0x55fcc8cb1390 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcc8c33730 0x55fcc8cacd90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcc8c2e5c0 0x55fcc8c3c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 --2- 172.21.15.31:0/998310949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcc8c2dbd0 0x55fcc8c3c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 >> 172.21.15.31:0/998310949 conn(0x55fcc8bf5f80 msgr2=0x55fcc8c37ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a2aa00640 0 client.25769 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 shutdown_connections 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 1 -- 172.21.15.31:0/998310949 wait complete. 2024-06-02T22:44:58.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.289+0000 7f8a4e61f740 20 client.25769 trim_cache size 0 max 16384 2024-06-02T22:44:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:44:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:44:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:44:58.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.290+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 msgr2=0x7f8a2c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.290+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 0x7f8a2c0a50f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a3002a860 tx=0x7f8a30030db0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 msgr2=0x7f8a44195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800e9c0 tx=0x7f8a3800ee80 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 shutdown_connections 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f8a2c0a2c30 0x7f8a2c0a50f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a44107760 0x7f8a4419d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a44104e30 0x7f8a44196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 --2- 172.21.15.31:0/563124144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a44102500 0x7f8a44195ad0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 >> 172.21.15.31:0/563124144 conn(0x7f8a440fbe70 msgr2=0x7f8a44101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 shutdown_connections 2024-06-02T22:44:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:44:58.291+0000 7f8a4b800640 1 -- 172.21.15.31:0/563124144 wait complete. 2024-06-02T22:44:58.514 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:58 smithi098 ceph-mon[36750]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2024-06-02T22:44:58.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:58 smithi178 ceph-mon[36614]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2024-06-02T22:44:58.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:58 smithi031 ceph-mon[31767]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 550 op/s 2024-06-02T22:44:59.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:44:59 smithi178 ceph-mon[36614]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 524 op/s 2024-06-02T22:44:59.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:44:59 smithi031 ceph-mon[31767]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 524 op/s 2024-06-02T22:44:59.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:44:59 smithi098 ceph-mon[36750]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 524 op/s 2024-06-02T22:45:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 455.0 s, 498.4 tps, lat 205.524 ms stddev 251.910 2024-06-02T22:45:01.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:01 smithi098 ceph-mon[36750]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 467 op/s 2024-06-02T22:45:02.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:01 smithi178 ceph-mon[36614]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 467 op/s 2024-06-02T22:45:02.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:01 smithi031 ceph-mon[31767]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 467 op/s 2024-06-02T22:45:03.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:03 smithi098 ceph-mon[36750]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-06-02T22:45:04.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:03 smithi178 ceph-mon[36614]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-06-02T22:45:04.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:03 smithi031 ceph-mon[31767]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 578 op/s 2024-06-02T22:45:05.224 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 460.0 s, 506.8 tps, lat 197.163 ms stddev 233.673 2024-06-02T22:45:05.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:05 smithi098 ceph-mon[36750]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 505 op/s 2024-06-02T22:45:06.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:05 smithi178 ceph-mon[36614]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 505 op/s 2024-06-02T22:45:06.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:05 smithi031 ceph-mon[31767]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.8 MiB/s wr, 505 op/s 2024-06-02T22:45:08.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:07 smithi178 ceph-mon[36614]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T22:45:08.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:07 smithi031 ceph-mon[31767]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T22:45:08.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:07 smithi098 ceph-mon[36750]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-06-02T22:45:10.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:09 smithi178 ceph-mon[36614]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 512 op/s 2024-06-02T22:45:10.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:09 smithi031 ceph-mon[31767]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 512 op/s 2024-06-02T22:45:10.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:09 smithi098 ceph-mon[36750]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 512 op/s 2024-06-02T22:45:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 465.0 s, 564.4 tps, lat 174.683 ms stddev 195.195 2024-06-02T22:45:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 -- 172.21.15.31:0/1341064342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810b310 msgr2=0x7fbba810d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1341064342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810b310 0x7fbba810d780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009900 tx=0x7fbb9402a410 comp rx=0 tx=0).stop 2024-06-02T22:45:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 -- 172.21.15.31:0/1341064342 shutdown_connections 2024-06-02T22:45:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1341064342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba810dcc0 0x7fbba810e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1341064342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810b310 0x7fbba810d780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1341064342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba81089a0 0x7fbba810add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.524+0000 7fbbafa00640 1 -- 172.21.15.31:0/1341064342 >> 172.21.15.31:0/1341064342 conn(0x7fbba806ea10 msgr2=0x7fbba8070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.525+0000 7fbbafa00640 1 -- 172.21.15.31:0/1341064342 shutdown_connections 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.525+0000 7fbbafa00640 1 -- 172.21.15.31:0/1341064342 wait complete. 2024-06-02T22:45:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.526+0000 7fbbafa00640 1 Processor -- start 2024-06-02T22:45:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.526+0000 7fbbafa00640 1 -- start start 2024-06-02T22:45:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.527+0000 7fbbafa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 0x7fbba81a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbafa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbafa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810dcc0 0x7fbba81ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbafa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbba811c4b0 con 0x7fbba810b310 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbafa00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba811c330 con 0x7fbba81089a0 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbafa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbba811c630 con 0x7fbba810dcc0 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47096/0 (socket says 172.21.15.31:47096) 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbba7e00640 1 -- 172.21.15.31:0/1476498730 learned_addr learned my addr 172.21.15.31:0/1476498730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbad000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 0x7fbba81a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.528+0000 7fbbada00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810dcc0 0x7fbba81ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 -- 172.21.15.31:0/1476498730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810dcc0 msgr2=0x7fbba81ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810dcc0 0x7fbba81ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 -- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 msgr2=0x7fbba81a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 -- 172.21.15.31:0/1476498730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba81ae6f0 con 0x7fbba81089a0 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbba7e00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:45:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.529+0000 7fbbad000640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 0x7fbba81a6ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b3f0 tx=0x7fbb9c00b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.530+0000 7fbba5600640 1 -- 172.21.15.31:0/1476498730 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c015020 con 0x7fbba81089a0 2024-06-02T22:45:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.530+0000 7fbba5600640 1 -- 172.21.15.31:0/1476498730 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb9c011d10 con 0x7fbba81089a0 2024-06-02T22:45:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.530+0000 7fbba5600640 1 -- 172.21.15.31:0/1476498730 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c010e60 con 0x7fbba81089a0 2024-06-02T22:45:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.530+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba81ae9e0 con 0x7fbba81089a0 2024-06-02T22:45:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.530+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81aeee0 con 0x7fbba81089a0 2024-06-02T22:45:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.535+0000 7fbbb2857740 1 Processor -- start 2024-06-02T22:45:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 -- start start 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac60ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac660c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562feabc4420 con 0x562feac60bd0 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562feab6bc50 con 0x562feac615c0 2024-06-02T22:45:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.536+0000 7fbbb2857740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562feabc03e0 con 0x562feac66730 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbbada00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac60ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45340/0 (socket says 172.21.15.31:45340) 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbba7e00640 1 -- 172.21.15.31:0/3034180506 learned_addr learned my addr 172.21.15.31:0/3034180506 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbba5600640 1 -- 172.21.15.31:0/1476498730 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fbb9c018020 con 0x7fbba81089a0 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.537+0000 7fbbada00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac60ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47106/0 (socket says 172.21.15.31:47106) 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 -- 172.21.15.31:0/3034180506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 msgr2=0x562feac660c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac660c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 -- 172.21.15.31:0/3034180506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 msgr2=0x562feac60ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac60ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 -- 172.21.15.31:0/3034180506 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fea8d8210 con 0x562feac66730 2024-06-02T22:45:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbba7e00640 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb940056d0 tx=0x7fbb940040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85635adbe638ea50 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbb9a000640 1 -- 172.21.15.31:0/3034180506 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9403f070 con 0x562feac66730 2024-06-02T22:45:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbb9a000640 1 -- 172.21.15.31:0/3034180506 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb940044c0 con 0x562feac66730 2024-06-02T22:45:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.538+0000 7fbb9a000640 1 -- 172.21.15.31:0/3034180506 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94035070 con 0x562feac66730 2024-06-02T22:45:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.541+0000 7fbbb2857740 1 -- 172.21.15.31:0/3034180506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 msgr2=0x562feac68bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.541+0000 7fbba5600640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 0x7fbb900a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.541+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb940056d0 tx=0x7fbb940040d0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbba5600640 1 -- 172.21.15.31:0/1476498730 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fbb9c0ceb50 con 0x7fbba81089a0 2024-06-02T22:45:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbada00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 0x7fbb900a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 -- 172.21.15.31:0/3034180506 shutdown_connections 2024-06-02T22:45:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac68bc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac660c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3034180506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac60ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 -- 172.21.15.31:0/3034180506 >> 172.21.15.31:0/3034180506 conn(0x562feac28f80 msgr2=0x562feac5c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 -- 172.21.15.31:0/3034180506 shutdown_connections 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.543+0000 7fbbb2857740 1 -- 172.21.15.31:0/3034180506 wait complete. 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.544+0000 7fbbb2857740 1 -- start start 2024-06-02T22:45:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.544+0000 7fbbada00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 0x7fbb900a52e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562feac61e20 tx=0x7fbba0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.544+0000 7fbbb2857740 1 Processor -- start 2024-06-02T22:45:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 0x562feac6b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 0x562feac72450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbad000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbad000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:38978/0 (socket says 172.21.15.31:38978) 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbad000640 1 -- 172.21.15.31:0/596926852 learned_addr learned my addr 172.21.15.31:0/596926852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562feac69680 con 0x562feac66730 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562feab7f0b0 con 0x562feac60bd0 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.545+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562feac69800 con 0x562feac615c0 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbb2857740 10 client.0 _ll_register_callbacks cb 0x562feab6af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbada00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 0x562feac72450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbba7e00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 0x562feac6b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 -- 172.21.15.31:0/596926852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 msgr2=0x562feac6b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 0x562feac6b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 -- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 msgr2=0x562feac72450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 0x562feac72450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fea9a4620 con 0x562feac60bd0 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbada00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 0x562feac72450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbba7e00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 0x562feac6b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbbad000640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c097990 tx=0x7fbb9c09a920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb8b61db09974a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.546+0000 7fbb8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.547+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c09b6c0 con 0x562feac60bd0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.547+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fbb9c097630 con 0x562feac60bd0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.547+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562feabd1b50 con 0x562feac60bd0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.548+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbb9c09afc0 con 0x562feac60bd0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.548+0000 7fbbb2857740 10 client.25778 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.548+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562feac75830 con 0x562feac60bd0 2024-06-02T22:45:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.548+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562feabd1b50 con 0x562feac60bd0 2024-06-02T22:45:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.548+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbb9c09d070 con 0x562feac60bd0 2024-06-02T22:45:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 10 client.25778 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 10 client.25778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 20 client.25778 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feac76f00 0x562feac79310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 4 client.25778 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:45:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.549+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562feabcbea0 con 0x562feac76f00 2024-06-02T22:45:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.550+0000 7fbba7e00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feac76f00 0x562feac79310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.551+0000 7fbba7e00640 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feac76f00 0x562feac79310 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c78c757e8ecfc7a server_cookie=8749a2b0c98baed5 in_seq=0 out_seq=0 2024-06-02T22:45:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.551+0000 7fbb8ea00640 10 client.25778 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.552+0000 7fbb8ea00640 1 -- 172.21.15.31:0/596926852 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562feabcbea0 con 0x562feac76f00 2024-06-02T22:45:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.552+0000 7fbb8ea00640 10 client.25778 handle_command_reply: tid=0 2024-06-02T22:45:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.553+0000 7fbbb2857740 1 client.25778 shutdown 2024-06-02T22:45:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.554+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 msgr2=0x562feac6aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.554+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c097990 tx=0x7fbb9c09a920 comp rx=0 tx=0).stop 2024-06-02T22:45:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 shutdown_connections 2024-06-02T22:45:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feac76f00 0x562feac79310 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac66730 0x562feac72450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac615c0 0x562feac6b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 --2- 172.21.15.31:0/596926852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac6aed0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 >> 172.21.15.31:0/596926852 conn(0x562feac28f80 msgr2=0x562feac5b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.556+0000 7fbb8ea00640 0 client.25778 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.557+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 shutdown_connections 2024-06-02T22:45:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.557+0000 7fbbb2857740 1 -- 172.21.15.31:0/596926852 wait complete. 2024-06-02T22:45:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.558+0000 7fbbb2857740 20 client.25778 trim_cache size 0 max 16384 2024-06-02T22:45:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.589+0000 7fbbb2857740 1 Processor -- start 2024-06-02T22:45:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 -- start start 2024-06-02T22:45:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac5fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac615c0 0x562feac792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81b9340 con 0x562feac615c0 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81bae80 con 0x562feac60bd0 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.590+0000 7fbbb2857740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81b9a10 con 0x562feac66730 2024-06-02T22:45:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45352/0 (socket says 172.21.15.31:45352) 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 -- 172.21.15.31:0/1238500203 learned_addr learned my addr 172.21.15.31:0/1238500203 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbad000640 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac5fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbba7e00640 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac615c0 0x562feac792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 -- 172.21.15.31:0/1238500203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 msgr2=0x562feac5fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac5fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 -- 172.21.15.31:0/1238500203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac615c0 msgr2=0x562feac792f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac615c0 0x562feac792f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.591+0000 7fbbada00640 1 -- 172.21.15.31:0/1238500203 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562feac5d300 con 0x562feac66730 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.592+0000 7fbbada00640 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009c40 tx=0x7fbba0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d726906ced1b35a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.592+0000 7fbb99600640 1 -- 172.21.15.31:0/1238500203 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba002d070 con 0x562feac66730 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.592+0000 7fbb99600640 1 -- 172.21.15.31:0/1238500203 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0004540 con 0x562feac66730 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.592+0000 7fbb99600640 1 -- 172.21.15.31:0/1238500203 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0028410 con 0x562feac66730 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 -- 172.21.15.31:0/1238500203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 msgr2=0x562feac72410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009c40 tx=0x7fbba0009f90 comp rx=0 tx=0).stop 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 -- 172.21.15.31:0/1238500203 shutdown_connections 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac72410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac615c0 0x562feac792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 --2- 172.21.15.31:0/1238500203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac60bd0 0x562feac5fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 -- 172.21.15.31:0/1238500203 >> 172.21.15.31:0/1238500203 conn(0x562feac28f80 msgr2=0x562feac6aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 -- 172.21.15.31:0/1238500203 shutdown_connections 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.593+0000 7fbbb2857740 1 -- 172.21.15.31:0/1238500203 wait complete. 2024-06-02T22:45:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.594+0000 7fbbb2857740 1 -- start start 2024-06-02T22:45:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.594+0000 7fbbb2857740 1 Processor -- start 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.594+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac6f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.594+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac6fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.594+0000 7fbbb2857740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac70c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbb2857740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ba7b0 con 0x562feac60bd0 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac6fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbba7e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac6fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:39000/0 (socket says 172.21.15.31:39000) 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbba7e00640 1 -- 172.21.15.31:0/3419543923 learned_addr learned my addr 172.21.15.31:0/3419543923 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac70c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbad000640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac6f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ba0e0 con 0x562feac615c0 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81b7320 con 0x562feac66730 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbb2857740 10 client.0 _ll_register_callbacks cb 0x7fbb9c010380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 -- 172.21.15.31:0/3419543923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 msgr2=0x562feac6fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac6fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 -- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 msgr2=0x562feac6f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac6f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.595+0000 7fbbada00640 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562feac71280 con 0x562feac66730 2024-06-02T22:45:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.596+0000 7fbbada00640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac70c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbba0019040 tx=0x7fbba00122f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52772f9ad3d16efe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.596+0000 7fbb8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:45:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.596+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0036060 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fbba0025040 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba0004540 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbba002d030 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 10 client.25783 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562feac72570 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0004540 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fbba0011a40 con 0x562feac66730 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 10 client.25783 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.597+0000 7fbbb2857740 20 client.25783 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.598+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feace2170 0x562feace4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.598+0000 7fbbb2857740 4 client.25783 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:45:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.598+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562feab497a0 con 0x562feace2170 2024-06-02T22:45:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.598+0000 7fbbad000640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feace2170 0x562feace4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.599+0000 7fbbad000640 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feace2170 0x562feace4590 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d367c3bd352fcf6 server_cookie=9ba1368dfb86da3a in_seq=0 out_seq=0 2024-06-02T22:45:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.599+0000 7fbb8ea00640 10 client.25783 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.946+0000 7fbb8ea00640 1 -- 172.21.15.31:0/3419543923 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562feab497a0 con 0x562feace2170 2024-06-02T22:45:11.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.946+0000 7fbb8ea00640 10 client.25783 handle_command_reply: tid=0 2024-06-02T22:45:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.946+0000 7fbbb2857740 1 client.25783 shutdown 2024-06-02T22:45:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 msgr2=0x562feac70c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac70c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbba0019040 tx=0x7fbba00122f0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 shutdown_connections 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562feace2170 0x562feace4590 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562feac66730 0x562feac70c90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562feac615c0 0x562feac6fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 --2- 172.21.15.31:0/3419543923 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562feac60bd0 0x562feac6f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 >> 172.21.15.31:0/3419543923 conn(0x562feac28f80 msgr2=0x562feac5af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.947+0000 7fbb8ea00640 0 client.25783 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.948+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 shutdown_connections 2024-06-02T22:45:11.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.948+0000 7fbbb2857740 1 -- 172.21.15.31:0/3419543923 wait complete. 2024-06-02T22:45:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.949+0000 7fbbb2857740 20 client.25783 trim_cache size 0 max 16384 2024-06-02T22:45:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:45:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:45:11.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:45:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.950+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 msgr2=0x7fbb900a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.950+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 0x7fbb900a52e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562feac61e20 tx=0x7fbba0009500 comp rx=0 tx=0).stop 2024-06-02T22:45:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 msgr2=0x7fbba81a6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:11.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 0x7fbba81a6ad0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00b3f0 tx=0x7fbb9c00b7f0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 shutdown_connections 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fbb900a2e20 0x7fbb900a52e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbba810dcc0 0x7fbba81ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbba810b310 0x7fbba81a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 --2- 172.21.15.31:0/1476498730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81089a0 0x7fbba81a6ad0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.951+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 >> 172.21.15.31:0/1476498730 conn(0x7fbba806ea10 msgr2=0x7fbba8108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.952+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 shutdown_connections 2024-06-02T22:45:11.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:11.952+0000 7fbbafa00640 1 -- 172.21.15.31:0/1476498730 wait complete. 2024-06-02T22:45:12.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:11 smithi178 ceph-mon[36614]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-06-02T22:45:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:11 smithi098 ceph-mon[36750]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-06-02T22:45:12.253 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:11 smithi031 ceph-mon[31767]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.5 MiB/s wr, 479 op/s 2024-06-02T22:45:14.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:13 smithi178 ceph-mon[36614]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-06-02T22:45:14.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:13 smithi031 ceph-mon[31767]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-06-02T22:45:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:13 smithi098 ceph-mon[36750]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-06-02T22:45:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 470.0 s, 649.8 tps, lat 156.807 ms stddev 226.677 2024-06-02T22:45:16.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:15 smithi178 ceph-mon[36614]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2024-06-02T22:45:16.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:15 smithi031 ceph-mon[31767]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2024-06-02T22:45:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:15 smithi098 ceph-mon[36750]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.1 MiB/s wr, 542 op/s 2024-06-02T22:45:18.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:17 smithi178 ceph-mon[36614]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 592 op/s 2024-06-02T22:45:18.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:17 smithi031 ceph-mon[31767]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 592 op/s 2024-06-02T22:45:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:17 smithi098 ceph-mon[36750]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 592 op/s 2024-06-02T22:45:20.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:19 smithi178 ceph-mon[36614]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-06-02T22:45:20.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:19 smithi031 ceph-mon[31767]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-06-02T22:45:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:19 smithi098 ceph-mon[36750]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.4 MiB/s wr, 592 op/s 2024-06-02T22:45:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 475.0 s, 620.4 tps, lat 162.692 ms stddev 199.950 2024-06-02T22:45:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:21 smithi178 ceph-mon[36614]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 552 op/s 2024-06-02T22:45:22.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:21 smithi031 ceph-mon[31767]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 552 op/s 2024-06-02T22:45:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:21 smithi098 ceph-mon[36750]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 552 op/s 2024-06-02T22:45:24.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:23 smithi178 ceph-mon[36614]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-06-02T22:45:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:23 smithi031 ceph-mon[31767]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-06-02T22:45:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:23 smithi098 ceph-mon[36750]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.0 MiB/s wr, 661 op/s 2024-06-02T22:45:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 480.0 s, 673.4 tps, lat 149.263 ms stddev 174.668 2024-06-02T22:45:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.754+0000 7fca45000640 1 -- 172.21.15.31:0/2001268282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40107560 msgr2=0x7fca40109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.754+0000 7fca45000640 1 --2- 172.21.15.31:0/2001268282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40107560 0x7fca40109950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fca38009ca0 tx=0x7fca3802a8e0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 -- 172.21.15.31:0/2001268282 shutdown_connections 2024-06-02T22:45:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 --2- 172.21.15.31:0/2001268282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40107560 0x7fca40109950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 --2- 172.21.15.31:0/2001268282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40104c30 0x7fca40107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 --2- 172.21.15.31:0/2001268282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca401046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 -- 172.21.15.31:0/2001268282 >> 172.21.15.31:0/2001268282 conn(0x7fca400fbc90 msgr2=0x7fca400fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 -- 172.21.15.31:0/2001268282 shutdown_connections 2024-06-02T22:45:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.758+0000 7fca45000640 1 -- 172.21.15.31:0/2001268282 wait complete. 2024-06-02T22:45:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.759+0000 7fca45000640 1 Processor -- start 2024-06-02T22:45:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 -- start start 2024-06-02T22:45:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca40199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40104c30 0x7fca4019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 0x7fca401a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca4010f700 con 0x7fca40107560 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca4010f580 con 0x7fca40104c30 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.760+0000 7fca45000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fca4010f880 con 0x7fca40102300 2024-06-02T22:45:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.761+0000 7fca3f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca40199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.761+0000 7fca3f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca40199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35370/0 (socket says 172.21.15.31:35370) 2024-06-02T22:45:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.761+0000 7fca3f400640 1 -- 172.21.15.31:0/1519671262 learned_addr learned my addr 172.21.15.31:0/1519671262 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.763+0000 7fca3fe00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 0x7fca401a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.764+0000 7fca3fe00640 1 -- 172.21.15.31:0/1519671262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 msgr2=0x7fca40199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.764+0000 7fca3fe00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca40199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.764+0000 7fca3fe00640 1 -- 172.21.15.31:0/1519671262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40104c30 msgr2=0x7fca4019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.764+0000 7fca3fe00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40104c30 0x7fca4019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.764+0000 7fca3fe00640 1 -- 172.21.15.31:0/1519671262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca401a18b0 con 0x7fca40107560 2024-06-02T22:45:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.765+0000 7fca3fe00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 0x7fca401a1210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca3802aed0 tx=0x7fca38030810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.765+0000 7fca37e00640 1 -- 172.21.15.31:0/1519671262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38030e10 con 0x7fca40107560 2024-06-02T22:45:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.766+0000 7fca37e00640 1 -- 172.21.15.31:0/1519671262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca3803b8e0 con 0x7fca40107560 2024-06-02T22:45:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.766+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca401a1b40 con 0x7fca40107560 2024-06-02T22:45:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.766+0000 7fca37e00640 1 -- 172.21.15.31:0/1519671262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3803aa60 con 0x7fca40107560 2024-06-02T22:45:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.766+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca401a20b0 con 0x7fca40107560 2024-06-02T22:45:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.771+0000 7fca49598740 1 Processor -- start 2024-06-02T22:45:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 -- start start 2024-06-02T22:45:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 0x562c864879c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 0x562c8648ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c8648f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562c863e2420 con 0x562c86487f90 2024-06-02T22:45:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c86389c50 con 0x562c864875a0 2024-06-02T22:45:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.773+0000 7fca49598740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c863de3e0 con 0x562c8648d100 2024-06-02T22:45:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.776+0000 7fca3f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 0x562c8648ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.777+0000 7fca3f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 0x562c8648ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60156/0 (socket says 172.21.15.31:60156) 2024-06-02T22:45:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.777+0000 7fca3f400640 1 -- 172.21.15.31:0/1922860373 learned_addr learned my addr 172.21.15.31:0/1922860373 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c8648f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 0x562c864879c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 -- 172.21.15.31:0/1922860373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 msgr2=0x562c8648f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c8648f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 -- 172.21.15.31:0/1922860373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 msgr2=0x562c8648ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 0x562c8648ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.779+0000 7fca3ea00640 1 -- 172.21.15.31:0/1922860373 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c860f6210 con 0x562c864875a0 2024-06-02T22:45:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.780+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 0x562c864879c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005d00 tx=0x7fca2c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f2040aee0a2aca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.783+0000 7fca34c00640 1 -- 172.21.15.31:0/1922860373 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c017070 con 0x562c864875a0 2024-06-02T22:45:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.783+0000 7fca34c00640 1 -- 172.21.15.31:0/1922860373 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca2c005500 con 0x562c864875a0 2024-06-02T22:45:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.783+0000 7fca34c00640 1 -- 172.21.15.31:0/1922860373 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c0126b0 con 0x562c864875a0 2024-06-02T22:45:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.783+0000 7fca37e00640 1 -- 172.21.15.31:0/1519671262 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fca38043020 con 0x7fca40107560 2024-06-02T22:45:25.785 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.785+0000 7fca49598740 1 -- 172.21.15.31:0/1922860373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 msgr2=0x562c864879c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.785 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.785+0000 7fca49598740 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 0x562c864879c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005d00 tx=0x7fca2c005850 comp rx=0 tx=0).stop 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.788+0000 7fca37e00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 0x7fca240a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.788+0000 7fca49598740 1 -- 172.21.15.31:0/1922860373 shutdown_connections 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca49598740 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c8648f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca49598740 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c86487f90 0x562c8648ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca49598740 1 --2- 172.21.15.31:0/1922860373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c864875a0 0x562c864879c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca49598740 1 -- 172.21.15.31:0/1922860373 >> 172.21.15.31:0/1922860373 conn(0x562c86446f80 msgr2=0x562c8647a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca37e00640 1 -- 172.21.15.31:0/1519671262 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fca380f0700 con 0x7fca40107560 2024-06-02T22:45:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca49598740 1 -- 172.21.15.31:0/1922860373 shutdown_connections 2024-06-02T22:45:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.789+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 0x7fca240a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.790+0000 7fca49598740 1 -- 172.21.15.31:0/1922860373 wait complete. 2024-06-02T22:45:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.790+0000 7fca49598740 1 -- start start 2024-06-02T22:45:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.791+0000 7fca49598740 1 Processor -- start 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86491920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 0x562c86491e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 0x562c86498ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x562c864900b0 con 0x562c864875a0 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562c8639d0b0 con 0x562c8648d100 2024-06-02T22:45:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c86490230 con 0x562c86487f90 2024-06-02T22:45:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.793+0000 7fca49598740 10 client.0 _ll_register_callbacks cb 0x562c86388f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.794+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 0x562c86491e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.794+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 0x562c86491e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35388/0 (socket says 172.21.15.31:35388) 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.794+0000 7fca3ea00640 1 -- 172.21.15.31:0/735828696 learned_addr learned my addr 172.21.15.31:0/735828696 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.794+0000 7fca3ea00640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 0x7fca240a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005940 tx=0x7fca2c004b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.794+0000 7fca3f400640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86491920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.795+0000 7fca3fe00640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 0x562c86498ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.795+0000 7fca3f400640 1 -- 172.21.15.31:0/735828696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 msgr2=0x562c86491e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.795+0000 7fca3f400640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 0x562c86491e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.795+0000 7fca3f400640 1 -- 172.21.15.31:0/735828696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 msgr2=0x562c86498ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.796+0000 7fca3f400640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 0x562c86498ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.796+0000 7fca3f400640 1 -- 172.21.15.31:0/735828696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c861c2620 con 0x562c864875a0 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.796+0000 7fca3fe00640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 0x562c86498ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.796+0000 7fca3f400640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86491920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x562c8647b6c0 tx=0x7fca30011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96196e2266b7e2fb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.796+0000 7fca29600640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:45:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.797+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3000fde0 con 0x562c864875a0 2024-06-02T22:45:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.797+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fca300193e0 con 0x562c864875a0 2024-06-02T22:45:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.797+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca2c005500 con 0x562c864875a0 2024-06-02T22:45:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.798+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca300195e0 con 0x562c864875a0 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.798+0000 7fca49598740 10 client.15537 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.798+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c864817a0 con 0x562c864875a0 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.798+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca2c005500 con 0x562c864875a0 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.798+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fca30018070 con 0x562c864875a0 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 10 client.15537 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:25.799 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 20 client.15537 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86483020 0x562c864854e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 4 client.15537 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:45:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c863efb50 con 0x562c86483020 2024-06-02T22:45:25.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.799+0000 7fca3ea00640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86483020 0x562c864854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.800+0000 7fca29600640 10 client.15537 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:25.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.801+0000 7fca3ea00640 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86483020 0x562c864854e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfec3455f91b40b server_cookie=43ebbee5c4d5eb1b in_seq=0 out_seq=0 2024-06-02T22:45:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.802+0000 7fca29600640 1 -- 172.21.15.31:0/735828696 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562c863efb50 con 0x562c86483020 2024-06-02T22:45:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.802+0000 7fca29600640 10 client.15537 handle_command_reply: tid=0 2024-06-02T22:45:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.802+0000 7fca49598740 1 client.15537 shutdown 2024-06-02T22:45:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 msgr2=0x562c86491920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86491920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x562c8647b6c0 tx=0x7fca30011c40 comp rx=0 tx=0).stop 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 shutdown_connections 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86483020 0x562c864854e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c8648d100 0x562c86498ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c86487f90 0x562c86491e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 --2- 172.21.15.31:0/735828696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86491920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca29600640 0 client.15537 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.803+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 >> 172.21.15.31:0/735828696 conn(0x562c86446f80 msgr2=0x562c86479970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.804+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 shutdown_connections 2024-06-02T22:45:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.804+0000 7fca49598740 1 -- 172.21.15.31:0/735828696 wait complete. 2024-06-02T22:45:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.804+0000 7fca49598740 20 client.15537 trim_cache size 0 max 16384 2024-06-02T22:45:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.861+0000 7fca49598740 1 Processor -- start 2024-06-02T22:45:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 -- start start 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c864892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c86489830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a8150 con 0x562c864875a0 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a9c90 con 0x562c86487f90 2024-06-02T22:45:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.862+0000 7fca49598740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a8820 con 0x562c8648d100 2024-06-02T22:45:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.863+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.863+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:42328/0 (socket says 172.21.15.31:42328) 2024-06-02T22:45:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.863+0000 7fca3ea00640 1 -- 172.21.15.31:0/3028425494 learned_addr learned my addr 172.21.15.31:0/3028425494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.863+0000 7fca3fe00640 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c86489830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3f400640 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c864892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3ea00640 1 -- 172.21.15.31:0/3028425494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 msgr2=0x562c86489830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3ea00640 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c86489830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3ea00640 1 -- 172.21.15.31:0/3028425494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 msgr2=0x562c864892f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3ea00640 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c864892f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.864+0000 7fca3ea00640 1 -- 172.21.15.31:0/3028425494 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c8648c600 con 0x562c86487f90 2024-06-02T22:45:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.865+0000 7fca3ea00640 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca2c011fd0 tx=0x7fca2c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153f68f29708c50b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.865+0000 7fca2be00640 1 -- 172.21.15.31:0/3028425494 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c03b070 con 0x562c86487f90 2024-06-02T22:45:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.870+0000 7fca2be00640 1 -- 172.21.15.31:0/3028425494 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca2c00c910 con 0x562c86487f90 2024-06-02T22:45:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.870+0000 7fca2be00640 1 -- 172.21.15.31:0/3028425494 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c017040 con 0x562c86487f90 2024-06-02T22:45:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.872+0000 7fca49598740 1 -- 172.21.15.31:0/3028425494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 msgr2=0x562c86498e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.872+0000 7fca49598740 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca2c011fd0 tx=0x7fca2c01e000 comp rx=0 tx=0).stop 2024-06-02T22:45:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.872+0000 7fca49598740 1 -- 172.21.15.31:0/3028425494 shutdown_connections 2024-06-02T22:45:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c86489830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c86498e60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 --2- 172.21.15.31:0/3028425494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c864892f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 -- 172.21.15.31:0/3028425494 >> 172.21.15.31:0/3028425494 conn(0x562c86446f80 msgr2=0x562c8647a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:25.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 -- 172.21.15.31:0/3028425494 shutdown_connections 2024-06-02T22:45:25.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 -- 172.21.15.31:0/3028425494 wait complete. 2024-06-02T22:45:25.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.873+0000 7fca49598740 1 -- start start 2024-06-02T22:45:25.874 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.874+0000 7fca49598740 1 Processor -- start 2024-06-02T22:45:25.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca49598740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86494370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca49598740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c864948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca49598740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c864978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c864948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca3f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86494370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca3fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c864978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca3fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c864978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35416/0 (socket says 172.21.15.31:35416) 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.875+0000 7fca3fe00640 1 -- 172.21.15.31:0/247178329 learned_addr learned my addr 172.21.15.31:0/247178329 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a95c0 con 0x562c864875a0 2024-06-02T22:45:25.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a8ef0 con 0x562c86487f90 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fca401a6130 con 0x562c8648d100 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca49598740 10 client.0 _ll_register_callbacks cb 0x7fca300087b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca3f400640 1 -- 172.21.15.31:0/247178329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 msgr2=0x562c864978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca3f400640 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c864978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca3f400640 1 -- 172.21.15.31:0/247178329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 msgr2=0x562c864948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca3f400640 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c864948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.876+0000 7fca3f400640 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c86497ec0 con 0x562c864875a0 2024-06-02T22:45:25.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.878+0000 7fca3f400640 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86494370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca30024cf0 tx=0x7fca300246a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be90fa5f4612853 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:25.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.878+0000 7fca29600640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:45:25.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.878+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30011030 con 0x562c864875a0 2024-06-02T22:45:25.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.878+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fca300111d0 con 0x562c864875a0 2024-06-02T22:45:25.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.879+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c863e9ea0 con 0x562c864875a0 2024-06-02T22:45:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.880+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fca30036050 con 0x562c864875a0 2024-06-02T22:45:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.880+0000 7fca49598740 10 client.15543 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.880+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562c865103e0 con 0x562c864875a0 2024-06-02T22:45:25.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.880+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562c863e9ea0 con 0x562c864875a0 2024-06-02T22:45:25.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.880+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fca3002c030 con 0x562c864875a0 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 10 client.15543 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 20 client.15543 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86510bc0 0x562c86512fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 4 client.15543 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:45:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c863677a0 con 0x562c86510bc0 2024-06-02T22:45:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.882+0000 7fca3ea00640 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86510bc0 0x562c86512fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.884+0000 7fca3ea00640 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86510bc0 0x562c86512fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2741ee1615e4bfed server_cookie=f1e72225334c97f6 in_seq=0 out_seq=0 2024-06-02T22:45:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:25.884+0000 7fca29600640 10 client.15543 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:25 smithi178 ceph-mon[36614]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:45:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.064+0000 7fca29600640 1 -- 172.21.15.31:0/247178329 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562c863677a0 con 0x562c86510bc0 2024-06-02T22:45:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.064+0000 7fca29600640 10 client.15543 handle_command_reply: tid=0 2024-06-02T22:45:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.064+0000 7fca49598740 1 client.15543 shutdown 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.064+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 msgr2=0x562c86494370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.064+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86494370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca30024cf0 tx=0x7fca300246a0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 shutdown_connections 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x562c86510bc0 0x562c86512fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c8648d100 0x562c864978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562c86487f90 0x562c864948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 --2- 172.21.15.31:0/247178329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x562c864875a0 0x562c86494370 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 >> 172.21.15.31:0/247178329 conn(0x562c86446f80 msgr2=0x562c864892f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca29600640 0 client.15543 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 shutdown_connections 2024-06-02T22:45:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.065+0000 7fca49598740 1 -- 172.21.15.31:0/247178329 wait complete. 2024-06-02T22:45:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.066+0000 7fca49598740 20 client.15543 trim_cache size 0 max 16384 2024-06-02T22:45:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:45:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:45:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 msgr2=0x7fca240a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 0x7fca240a50c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fca2c005940 tx=0x7fca2c004b70 comp rx=0 tx=0).stop 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 msgr2=0x7fca401a1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 0x7fca401a1210 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca3802aed0 tx=0x7fca38030810 comp rx=0 tx=0).stop 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 shutdown_connections 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fca240a2c00 0x7fca240a50c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca40107560 0x7fca401a1210 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca40104c30 0x7fca4019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 --2- 172.21.15.31:0/1519671262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca40102300 0x7fca40199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.067+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 >> 172.21.15.31:0/1519671262 conn(0x7fca400fbc90 msgr2=0x7fca40102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.068+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 shutdown_connections 2024-06-02T22:45:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:26.068+0000 7fca45000640 1 -- 172.21.15.31:0/1519671262 wait complete. 2024-06-02T22:45:26.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:25 smithi031 ceph-mon[31767]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:45:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:25 smithi098 ceph-mon[36750]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:45:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:27 smithi031 ceph-mon[31767]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-06-02T22:45:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:27 smithi098 ceph-mon[36750]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-06-02T22:45:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:27 smithi178 ceph-mon[36614]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-06-02T22:45:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:29 smithi031 ceph-mon[31767]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-06-02T22:45:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:29 smithi098 ceph-mon[36750]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-06-02T22:45:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 485.0 s, 619.2 tps, lat 157.909 ms stddev 186.935 2024-06-02T22:45:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:29 smithi178 ceph-mon[36614]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 565 op/s 2024-06-02T22:45:32.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:31 smithi031 ceph-mon[31767]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:45:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:31 smithi098 ceph-mon[36750]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:45:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:31 smithi178 ceph-mon[36614]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-06-02T22:45:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:33 smithi031 ceph-mon[31767]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-06-02T22:45:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:33 smithi098 ceph-mon[36750]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-06-02T22:45:34.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:33 smithi178 ceph-mon[36614]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-06-02T22:45:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 490.0 s, 684.8 tps, lat 146.867 ms stddev 167.585 2024-06-02T22:45:36.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:35 smithi031 ceph-mon[31767]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 MiB/s wr, 498 op/s 2024-06-02T22:45:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:35 smithi098 ceph-mon[36750]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 MiB/s wr, 498 op/s 2024-06-02T22:45:36.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:35 smithi178 ceph-mon[36614]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.5 MiB/s wr, 498 op/s 2024-06-02T22:45:38.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:37 smithi031 ceph-mon[31767]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 MiB/s wr, 561 op/s 2024-06-02T22:45:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:37 smithi098 ceph-mon[36750]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 MiB/s wr, 561 op/s 2024-06-02T22:45:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:37 smithi178 ceph-mon[36614]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 MiB/s wr, 561 op/s 2024-06-02T22:45:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.959+0000 7fe83f200640 1 -- 172.21.15.31:0/3964191873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 msgr2=0x7fe840110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.959+0000 7fe83f200640 1 --2- 172.21.15.31:0/3964191873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe840110280 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe838009be0 tx=0x7fe83802a6d0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.959+0000 7fe83f200640 1 -- 172.21.15.31:0/3964191873 shutdown_connections 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.960+0000 7fe83f200640 1 --2- 172.21.15.31:0/3964191873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe840110280 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.960+0000 7fe83f200640 1 --2- 172.21.15.31:0/3964191873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe840108fa0 0x7fe840109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.960+0000 7fe83f200640 1 --2- 172.21.15.31:0/3964191873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe840107e50 0x7fe840108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.960+0000 7fe83f200640 1 -- 172.21.15.31:0/3964191873 >> 172.21.15.31:0/3964191873 conn(0x7fe840076df0 msgr2=0x7fe840079230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.961+0000 7fe83f200640 1 -- 172.21.15.31:0/3964191873 shutdown_connections 2024-06-02T22:45:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.961+0000 7fe83f200640 1 -- 172.21.15.31:0/3964191873 wait complete. 2024-06-02T22:45:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.962+0000 7fe83f200640 1 Processor -- start 2024-06-02T22:45:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.963+0000 7fe83f200640 1 -- start start 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe840107e50 0x7fe84007f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe840108fa0 0x7fe84007f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe840113ad0 con 0x7fe840108fa0 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe840113950 con 0x7fe840109960 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe840113c50 con 0x7fe840107e50 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57100/0 (socket says 172.21.15.31:57100) 2024-06-02T22:45:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.964+0000 7fe83e800640 1 -- 172.21.15.31:0/2998434066 learned_addr learned my addr 172.21.15.31:0/2998434066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.965+0000 7fe83e800640 1 -- 172.21.15.31:0/2998434066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe840107e50 msgr2=0x7fe84007f1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:45:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.965+0000 7fe83e800640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe840107e50 0x7fe84007f1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.965+0000 7fe83e800640 1 -- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe840108fa0 msgr2=0x7fe84007f6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:45:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.967+0000 7fe83e800640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe840108fa0 0x7fe84007f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.967+0000 7fe83e800640 1 -- 172.21.15.31:0/2998434066 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84006f890 con 0x7fe840109960 2024-06-02T22:45:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.967+0000 7fe83e800640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe838034040 tx=0x7fe8380305b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.969+0000 7fe836a00640 1 -- 172.21.15.31:0/2998434066 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838041020 con 0x7fe840109960 2024-06-02T22:45:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.969+0000 7fe836a00640 1 -- 172.21.15.31:0/2998434066 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe838031920 con 0x7fe840109960 2024-06-02T22:45:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.969+0000 7fe836a00640 1 -- 172.21.15.31:0/2998434066 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838036040 con 0x7fe840109960 2024-06-02T22:45:39.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.969+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84006fb20 con 0x7fe840109960 2024-06-02T22:45:39.974 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.969+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84006ffc0 con 0x7fe840109960 2024-06-02T22:45:39.977 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.977+0000 7fe847819740 1 Processor -- start 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.977+0000 7fe847819740 1 -- start start 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c209280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 0x55bb2c20bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c167420 con 0x55bb2c204780 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c10ec50 con 0x55bb2c203d90 2024-06-02T22:45:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.978+0000 7fe847819740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c1633e0 con 0x55bb2c2098f0 2024-06-02T22:45:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.979+0000 7fe83d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 0x55bb2c20bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.979+0000 7fe83d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 0x55bb2c20bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35260/0 (socket says 172.21.15.31:35260) 2024-06-02T22:45:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.979+0000 7fe83d400640 1 -- 172.21.15.31:0/4146110015 learned_addr learned my addr 172.21.15.31:0/4146110015 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.980+0000 7fe83de00640 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c209280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.980+0000 7fe83d400640 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.981+0000 7fe83de00640 1 -- 172.21.15.31:0/4146110015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 msgr2=0x55bb2c20bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.981+0000 7fe83de00640 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 0x55bb2c20bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.981+0000 7fe83de00640 1 -- 172.21.15.31:0/4146110015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 msgr2=0x55bb2c2041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.981+0000 7fe83de00640 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.981+0000 7fe83de00640 1 -- 172.21.15.31:0/4146110015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2be7b210 con 0x55bb2c204780 2024-06-02T22:45:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.983+0000 7fe836a00640 1 -- 172.21.15.31:0/2998434066 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe838044020 con 0x7fe840109960 2024-06-02T22:45:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.983+0000 7fe83de00640 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c209280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe830009a00 tx=0x7fe830009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a97b509b17f845b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.985+0000 7fe836a00640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 0x7fe8240a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.985+0000 7fe836a00640 1 -- 172.21.15.31:0/2998434066 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe8380efd50 con 0x7fe840109960 2024-06-02T22:45:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.985+0000 7fe83d400640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 0x7fe8240a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.986+0000 7fe82b000640 1 -- 172.21.15.31:0/4146110015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83000ec50 con 0x55bb2c204780 2024-06-02T22:45:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.986+0000 7fe82b000640 1 -- 172.21.15.31:0/4146110015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe83000edf0 con 0x55bb2c204780 2024-06-02T22:45:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.986+0000 7fe82b000640 1 -- 172.21.15.31:0/4146110015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830004a40 con 0x55bb2c204780 2024-06-02T22:45:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 -- 172.21.15.31:0/4146110015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 msgr2=0x55bb2c209280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe83d400640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 0x7fe8240a5250 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55bb2c204fe0 tx=0x7fe82c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c209280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe830009a00 tx=0x7fe830009ec0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 -- 172.21.15.31:0/4146110015 shutdown_connections 2024-06-02T22:45:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c2098f0 0x55bb2c20bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c209280 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 --2- 172.21.15.31:0/4146110015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 -- 172.21.15.31:0/4146110015 >> 172.21.15.31:0/4146110015 conn(0x55bb2c1cbf80 msgr2=0x55bb2c1ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.987+0000 7fe847819740 1 -- 172.21.15.31:0/4146110015 shutdown_connections 2024-06-02T22:45:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.988+0000 7fe847819740 1 -- 172.21.15.31:0/4146110015 wait complete. 2024-06-02T22:45:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.988+0000 7fe847819740 1 -- start start 2024-06-02T22:45:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.989+0000 7fe847819740 1 Processor -- start 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.989+0000 7fe847819740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c20e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.989+0000 7fe847819740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c20e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.989+0000 7fe847819740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe847819740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c20c8a0 con 0x55bb2c204780 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe847819740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c1220b0 con 0x55bb2c2098f0 2024-06-02T22:45:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe847819740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bb2c20ca20 con 0x55bb2c203d90 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57116/0 (socket says 172.21.15.31:57116) 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 -- 172.21.15.31:0/1396817623 learned_addr learned my addr 172.21.15.31:0/1396817623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83d400640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c20e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe847819740 10 client.0 _ll_register_callbacks cb 0x55bb2c10df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 -- 172.21.15.31:0/1396817623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 msgr2=0x55bb2c20e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c20e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 -- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 msgr2=0x55bb2c20e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c20e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.990+0000 7fe83e800640 1 -- 172.21.15.31:0/1396817623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2bf47620 con 0x55bb2c2098f0 2024-06-02T22:45:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.991+0000 7fe81f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:45:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.991+0000 7fe83e800640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b8b90 tx=0x7fe83802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee6cb5b88c73df2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.991+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380bc1c0 con 0x55bb2c2098f0 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.991+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe838003c90 con 0x55bb2c2098f0 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.992+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe83000edf0 con 0x55bb2c2098f0 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.992+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe8380c0570 con 0x55bb2c2098f0 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.992+0000 7fe847819740 10 client.25811 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.992+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb2c218940 con 0x55bb2c2098f0 2024-06-02T22:45:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe83000edf0 con 0x55bb2c2098f0 2024-06-02T22:45:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe838004640 con 0x55bb2c2098f0 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 10 client.25811 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 20 client.25811 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c21a050 0x55bb2c21c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 4 client.25811 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:45:39.995 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.994+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb2c174b50 con 0x55bb2c21a050 2024-06-02T22:45:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:39.996+0000 7fe83de00640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c21a050 0x55bb2c21c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.000+0000 7fe83de00640 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c21a050 0x55bb2c21c510 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd18220c029f282 server_cookie=eb0a7cbc4ee00592 in_seq=0 out_seq=0 2024-06-02T22:45:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.000+0000 7fe81f400640 10 client.25811 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.004+0000 7fe81f400640 1 -- 172.21.15.31:0/1396817623 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bb2c174b50 con 0x55bb2c21a050 2024-06-02T22:45:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.004+0000 7fe81f400640 10 client.25811 handle_command_reply: tid=0 2024-06-02T22:45:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.004+0000 7fe847819740 1 client.25811 shutdown 2024-06-02T22:45:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.004+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 msgr2=0x55bb2c2155d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.004+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe8380b8b90 tx=0x7fe83802a6d0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 shutdown_connections 2024-06-02T22:45:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c21a050 0x55bb2c21c510 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c2155d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c20e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 --2- 172.21.15.31:0/1396817623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c20e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe81f400640 0 client.25811 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.005+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 >> 172.21.15.31:0/1396817623 conn(0x55bb2c1cbf80 msgr2=0x55bb2c1fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.006+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 shutdown_connections 2024-06-02T22:45:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.006+0000 7fe847819740 1 -- 172.21.15.31:0/1396817623 wait complete. 2024-06-02T22:45:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.006+0000 7fe847819740 20 client.25811 trim_cache size 0 max 16384 2024-06-02T22:45:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 Processor -- start 2024-06-02T22:45:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 -- start start 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c215590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c205f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401c1aa0 con 0x55bb2c204780 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401c35e0 con 0x55bb2c2098f0 2024-06-02T22:45:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.051+0000 7fe847819740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401c2170 con 0x55bb2c203d90 2024-06-02T22:45:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.052+0000 7fe83de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.052+0000 7fe83de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35288/0 (socket says 172.21.15.31:35288) 2024-06-02T22:45:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.052+0000 7fe83de00640 1 -- 172.21.15.31:0/1734736197 learned_addr learned my addr 172.21.15.31:0/1734736197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.052+0000 7fe83e800640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c205f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.052+0000 7fe83d400640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c215590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83e800640 1 -- 172.21.15.31:0/1734736197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 msgr2=0x55bb2c205a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83e800640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83e800640 1 -- 172.21.15.31:0/1734736197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 msgr2=0x55bb2c215590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83e800640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c215590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83e800640 1 -- 172.21.15.31:0/1734736197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2c205010 con 0x55bb2c2098f0 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83d400640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c215590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.053+0000 7fe83de00640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:45:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.054+0000 7fe83e800640 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c205f80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8380bbec0 tx=0x7fe83804afa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3cc69a8f35d818 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.054+0000 7fe82a600640 1 -- 172.21.15.31:0/1734736197 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380bc1c0 con 0x55bb2c2098f0 2024-06-02T22:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.055+0000 7fe82a600640 1 -- 172.21.15.31:0/1734736197 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8380c4e30 con 0x55bb2c2098f0 2024-06-02T22:45:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.055+0000 7fe82a600640 1 -- 172.21.15.31:0/1734736197 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380dc0d0 con 0x55bb2c2098f0 2024-06-02T22:45:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.056+0000 7fe847819740 1 -- 172.21.15.31:0/1734736197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 msgr2=0x55bb2c205f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.056+0000 7fe847819740 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c205f80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8380bbec0 tx=0x7fe83804afa0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 -- 172.21.15.31:0/1734736197 shutdown_connections 2024-06-02T22:45:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c2098f0 0x55bb2c205f80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c204780 0x55bb2c215590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 --2- 172.21.15.31:0/1734736197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c203d90 0x55bb2c205a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 -- 172.21.15.31:0/1734736197 >> 172.21.15.31:0/1734736197 conn(0x55bb2c1cbf80 msgr2=0x55bb2c20e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 -- 172.21.15.31:0/1734736197 shutdown_connections 2024-06-02T22:45:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.058+0000 7fe847819740 1 -- 172.21.15.31:0/1734736197 wait complete. 2024-06-02T22:45:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.059+0000 7fe847819740 1 -- start start 2024-06-02T22:45:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.059+0000 7fe847819740 1 Processor -- start 2024-06-02T22:45:40.063 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c204780 0x55bb2c212820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c2098f0 0x55bb2c282da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401c2f10 con 0x55bb2c2098f0 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401c2840 con 0x55bb2c203d90 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe8401bfa80 con 0x55bb2c204780 2024-06-02T22:45:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.063+0000 7fe847819740 10 client.0 _ll_register_callbacks cb 0x7fe8380b8510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.064+0000 7fe83de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.065+0000 7fe83de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57122/0 (socket says 172.21.15.31:57122) 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.065+0000 7fe83de00640 1 -- 172.21.15.31:0/1125151952 learned_addr learned my addr 172.21.15.31:0/1125151952 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.064+0000 7fe83d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c204780 0x55bb2c212820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.065+0000 7fe83de00640 1 -- 172.21.15.31:0/1125151952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c204780 msgr2=0x55bb2c212820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.065+0000 7fe83de00640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c204780 0x55bb2c212820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.065+0000 7fe83de00640 1 -- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c2098f0 msgr2=0x55bb2c282da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:45:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.066+0000 7fe83e800640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c2098f0 0x55bb2c282da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.066+0000 7fe83de00640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c2098f0 0x55bb2c282da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.066+0000 7fe83de00640 1 -- 172.21.15.31:0/1125151952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2c212ec0 con 0x55bb2c203d90 2024-06-02T22:45:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.066+0000 7fe83de00640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe83000e720 tx=0x7fe8300096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac312e9df115117d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.067+0000 7fe81f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:45:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.067+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe830031060 con 0x55bb2c203d90 2024-06-02T22:45:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.067+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe8300052c0 con 0x55bb2c203d90 2024-06-02T22:45:40.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.067+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8380c4e30 con 0x55bb2c203d90 2024-06-02T22:45:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.068+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe8300054c0 con 0x55bb2c203d90 2024-06-02T22:45:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.070+0000 7fe847819740 10 client.25817 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:40.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.070+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bb2c2843c0 con 0x55bb2c203d90 2024-06-02T22:45:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.071+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8380c4e30 con 0x55bb2c203d90 2024-06-02T22:45:40.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe830018630 con 0x55bb2c203d90 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 10 client.25817 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 10 client.25817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 20 client.25817 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c284ac0 0x55bb2c286ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 4 client.25817 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:45:40.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.072+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb2c16eea0 con 0x55bb2c284ac0 2024-06-02T22:45:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.073+0000 7fe83d400640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c284ac0 0x55bb2c286ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.074+0000 7fe83d400640 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c284ac0 0x55bb2c286ee0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83f6935b530e9a server_cookie=b7a165f52bd6e304 in_seq=0 out_seq=0 2024-06-02T22:45:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.075+0000 7fe81f400640 10 client.25817 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.094+0000 7fe81f400640 1 -- 172.21.15.31:0/1125151952 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bb2c16eea0 con 0x55bb2c284ac0 2024-06-02T22:45:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.094+0000 7fe81f400640 10 client.25817 handle_command_reply: tid=0 2024-06-02T22:45:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.094+0000 7fe847819740 1 client.25817 shutdown 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.094+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 msgr2=0x55bb2c2122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.094+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe83000e720 tx=0x7fe8300096f0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 shutdown_connections 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bb2c284ac0 0x55bb2c286ee0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bb2c2098f0 0x55bb2c282da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bb2c204780 0x55bb2c212820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 --2- 172.21.15.31:0/1125151952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bb2c203d90 0x55bb2c2122e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 >> 172.21.15.31:0/1125151952 conn(0x55bb2c1cbf80 msgr2=0x55bb2c205a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe81f400640 0 client.25817 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 shutdown_connections 2024-06-02T22:45:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 1 -- 172.21.15.31:0/1125151952 wait complete. 2024-06-02T22:45:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.095+0000 7fe847819740 20 client.25817 trim_cache size 0 max 16384 2024-06-02T22:45:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:45:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.096+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 msgr2=0x7fe8240a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.096+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 0x7fe8240a5250 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55bb2c204fe0 tx=0x7fe82c005e50 comp rx=0 tx=0).stop 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.096+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 msgr2=0x7fe84006f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.096+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe838034040 tx=0x7fe8380305b0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 shutdown_connections 2024-06-02T22:45:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe8240a2d90 0x7fe8240a5250 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe840109960 0x7fe84006f350 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe840108fa0 0x7fe84007f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 --2- 172.21.15.31:0/2998434066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe840107e50 0x7fe84007f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 >> 172.21.15.31:0/2998434066 conn(0x7fe840076df0 msgr2=0x7fe84010c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 shutdown_connections 2024-06-02T22:45:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:40.097+0000 7fe83f200640 1 -- 172.21.15.31:0/2998434066 wait complete. 2024-06-02T22:45:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:39 smithi031 ceph-mon[31767]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-06-02T22:45:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:39 smithi098 ceph-mon[36750]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-06-02T22:45:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 495.0 s, 677.4 tps, lat 149.580 ms stddev 187.973 2024-06-02T22:45:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:39 smithi178 ceph-mon[36614]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.1 MiB/s wr, 546 op/s 2024-06-02T22:45:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:41 smithi098 ceph-mon[36750]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-06-02T22:45:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:41 smithi178 ceph-mon[36614]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-06-02T22:45:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:41 smithi031 ceph-mon[31767]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-06-02T22:45:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:43 smithi098 ceph-mon[36750]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-06-02T22:45:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:43 smithi178 ceph-mon[36614]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-06-02T22:45:44.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:43 smithi031 ceph-mon[31767]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-06-02T22:45:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 500.0 s, 724.2 tps, lat 138.170 ms stddev 154.254 2024-06-02T22:45:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:45 smithi098 ceph-mon[36750]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-06-02T22:45:46.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:45 smithi178 ceph-mon[36614]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-06-02T22:45:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:45 smithi031 ceph-mon[31767]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.0 MiB/s wr, 535 op/s 2024-06-02T22:45:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:47 smithi098 ceph-mon[36750]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 680 op/s 2024-06-02T22:45:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:47 smithi178 ceph-mon[36614]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 680 op/s 2024-06-02T22:45:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:47 smithi031 ceph-mon[31767]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 680 op/s 2024-06-02T22:45:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:49 smithi098 ceph-mon[36750]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-06-02T22:45:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 505.0 s, 647.0 tps, lat 150.073 ms stddev 162.910 2024-06-02T22:45:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:49 smithi178 ceph-mon[36614]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-06-02T22:45:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:49 smithi031 ceph-mon[31767]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-06-02T22:45:51.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:45:51.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:45:51.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:45:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:51 smithi098 ceph-mon[36750]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.8 MiB/s wr, 648 op/s 2024-06-02T22:45:52.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:51 smithi178 ceph-mon[36614]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.8 MiB/s wr, 648 op/s 2024-06-02T22:45:52.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:51 smithi031 ceph-mon[31767]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.8 MiB/s wr, 648 op/s 2024-06-02T22:45:53.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:45:53.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:45:53.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:52 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:45:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f3097400640 1 -- 172.21.15.31:0/3143835018 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880319b0 con 0x7f30981089a0 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 -- 172.21.15.31:0/3143835018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30981089a0 msgr2=0x7f309810add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 --2- 172.21.15.31:0/3143835018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30981089a0 0x7f309810add0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3088009900 tx=0x7f308802a420 comp rx=0 tx=0).stop 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 -- 172.21.15.31:0/3143835018 shutdown_connections 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 --2- 172.21.15.31:0/3143835018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b790 0x7f3098114630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 --2- 172.21.15.31:0/3143835018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f309810b310 0x7f30981120e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 --2- 172.21.15.31:0/3143835018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30981089a0 0x7f309810add0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 -- 172.21.15.31:0/3143835018 >> 172.21.15.31:0/3143835018 conn(0x7f309806ea10 msgr2=0x7f3098070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 -- 172.21.15.31:0/3143835018 shutdown_connections 2024-06-02T22:45:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.270+0000 7f309f600640 1 -- 172.21.15.31:0/3143835018 wait complete. 2024-06-02T22:45:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.271+0000 7f309f600640 1 Processor -- start 2024-06-02T22:45:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.271+0000 7f309f600640 1 -- start start 2024-06-02T22:45:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b310 0x7f30981a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f309810b790 0x7f30981a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3098118140 con 0x7f309810b310 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3098117fc0 con 0x7f309810b790 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309f600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30981182c0 con 0x7f30981089a0 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37142/0 (socket says 172.21.15.31:37142) 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f309cc00640 1 -- 172.21.15.31:0/3086153302 learned_addr learned my addr 172.21.15.31:0/3086153302 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309d600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f309810b790 0x7f30981a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.272+0000 7f3097e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b310 0x7f30981a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309cc00640 1 -- 172.21.15.31:0/3086153302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f309810b790 msgr2=0x7f30981a9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309cc00640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f309810b790 0x7f30981a9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309cc00640 1 -- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b310 msgr2=0x7f30981a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309cc00640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b310 0x7f30981a2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.273+0000 7f309cc00640 1 -- 172.21.15.31:0/3086153302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30981aa320 con 0x7f30981089a0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.274+0000 7f309cc00640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3088031440 tx=0x7f3088032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.275+0000 7f3095600640 1 -- 172.21.15.31:0/3086153302 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308803f030 con 0x7f30981089a0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.275+0000 7f3095600640 1 -- 172.21.15.31:0/3086153302 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3088003ce0 con 0x7f30981089a0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.275+0000 7f3095600640 1 -- 172.21.15.31:0/3086153302 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088035070 con 0x7f30981089a0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.275+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30981aa5b0 con 0x7f30981089a0 2024-06-02T22:45:53.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.275+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981aaa10 con 0x7f30981089a0 2024-06-02T22:45:53.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.278+0000 7f3095600640 1 -- 172.21.15.31:0/3086153302 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f3088042030 con 0x7f30981089a0 2024-06-02T22:45:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 Processor -- start 2024-06-02T22:45:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 -- start start 2024-06-02T22:45:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f3095600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 0x7f30800a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f3095600640 1 -- 172.21.15.31:0/3086153302 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f30880efd20 con 0x7f30981089a0 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a90730 0x55fcb4a92bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fcb49ee420 con 0x55fcb4a90730 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4995c50 con 0x55fcb4a8abd0 2024-06-02T22:45:53.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f30a23b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fcb49ea3e0 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f309d600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 0x7f30800a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f309cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.280+0000 7f309cc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52594/0 (socket says 172.21.15.31:52594) 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 -- 172.21.15.31:0/3564410900 learned_addr learned my addr 172.21.15.31:0/3564410900 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309d600640 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a90730 0x55fcb4a92bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f3097e00640 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 -- 172.21.15.31:0/3564410900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 msgr2=0x55fcb4a900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a900c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 -- 172.21.15.31:0/3564410900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a90730 msgr2=0x55fcb4a92bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a90730 0x55fcb4a92bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 -- 172.21.15.31:0/3564410900 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb4702210 con 0x55fcb4a8abd0 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.281+0000 7f309cc00640 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f30880c48d0 tx=0x7f308803b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2790cec089a8f107 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.282+0000 7f3085c00640 1 -- 172.21.15.31:0/3564410900 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088049040 con 0x55fcb4a8abd0 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.282+0000 7f3085c00640 1 -- 172.21.15.31:0/3564410900 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30880bc190 con 0x55fcb4a8abd0 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.282+0000 7f3085c00640 1 -- 172.21.15.31:0/3564410900 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880b8800 con 0x55fcb4a8abd0 2024-06-02T22:45:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.282+0000 7f309d600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 0x7f30800a5170 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3090005fd0 tx=0x7f3090009c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.284+0000 7f30a23b7740 1 -- 172.21.15.31:0/3564410900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 msgr2=0x55fcb4a8aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.284+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f30880c48d0 tx=0x7f308803b790 comp rx=0 tx=0).stop 2024-06-02T22:45:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.286+0000 7f30a23b7740 1 -- 172.21.15.31:0/3564410900 shutdown_connections 2024-06-02T22:45:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.286+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a90730 0x55fcb4a92bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.286+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.286+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3564410900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a8aff0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.287 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.286+0000 7f30a23b7740 1 -- 172.21.15.31:0/3564410900 >> 172.21.15.31:0/3564410900 conn(0x55fcb4a52f80 msgr2=0x55fcb4a86650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.287+0000 7f30a23b7740 1 -- 172.21.15.31:0/3564410900 shutdown_connections 2024-06-02T22:45:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.288+0000 7f30a23b7740 1 -- 172.21.15.31:0/3564410900 wait complete. 2024-06-02T22:45:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.288+0000 7f30a23b7740 1 -- start start 2024-06-02T22:45:53.288 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.288+0000 7f30a23b7740 1 Processor -- start 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a9d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4aa49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4a934a0 con 0x55fcb4a8abd0 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fcb49a90b0 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55fcb4a93620 con 0x55fcb4a90730 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f30a23b7740 10 client.0 _ll_register_callbacks cb 0x55fcb4994f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f3097e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.290 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f3097e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52604/0 (socket says 172.21.15.31:52604) 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.289+0000 7f3097e00640 1 -- 172.21.15.31:0/3093027587 learned_addr learned my addr 172.21.15.31:0/3093027587 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f309cc00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a9d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 -- 172.21.15.31:0/3093027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 msgr2=0x55fcb4aa49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4aa49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 -- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 msgr2=0x55fcb4a9d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a9d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 -- 172.21.15.31:0/3093027587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb47ce620 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f3097e00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3098073280 tx=0x7f308c00f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a29a74540a3fb9d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f307a000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c018020 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.290+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f308c014660 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.291+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30880bc190 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.291+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f308c023050 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.292+0000 7f30a23b7740 10 client.25829 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.292+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcb4aa7d80 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.292+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30880bc190 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f308c013af0 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 10 client.25829 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 10 client.25829 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 20 client.25829 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4aa99d0 0x55fcb4aabe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 4 client.25829 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:45:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb49fbb50 con 0x55fcb4aa99d0 2024-06-02T22:45:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.293+0000 7f309cc00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4aa99d0 0x55fcb4aabe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.295+0000 7f309cc00640 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4aa99d0 0x55fcb4aabe90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1258b834b8dbd server_cookie=986e1facea0d16e8 in_seq=0 out_seq=0 2024-06-02T22:45:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.295+0000 7f307a000640 10 client.25829 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.295+0000 7f307a000640 1 -- 172.21.15.31:0/3093027587 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fcb49fbb50 con 0x55fcb4aa99d0 2024-06-02T22:45:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.295+0000 7f307a000640 10 client.25829 handle_command_reply: tid=0 2024-06-02T22:45:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 client.25829 shutdown 2024-06-02T22:45:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 msgr2=0x55fcb4a9d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3098073280 tx=0x7f308c00f5b0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 shutdown_connections 2024-06-02T22:45:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4aa99d0 0x55fcb4aabe90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4aa49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4a9d960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 --2- 172.21.15.31:0/3093027587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a9d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 >> 172.21.15.31:0/3093027587 conn(0x55fcb4a52f80 msgr2=0x55fcb4a85810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f307a000640 0 client.25829 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 shutdown_connections 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.296+0000 7f30a23b7740 1 -- 172.21.15.31:0/3093027587 wait complete. 2024-06-02T22:45:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.297+0000 7f30a23b7740 20 client.25829 trim_cache size 0 max 16384 2024-06-02T22:45:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:45:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:45:53.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:52 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:45:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.318+0000 7f30a23b7740 1 Processor -- start 2024-06-02T22:45:53.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.319+0000 7f30a23b7740 1 -- start start 2024-06-02T22:45:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a89510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a90730 0x55fcb4a89a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30981b0bd0 con 0x55fcb4a8abd0 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30981b2710 con 0x55fcb4a90730 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.320+0000 7f30a23b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30981b12a0 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.321+0000 7f3097e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.321+0000 7f3097e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37176/0 (socket says 172.21.15.31:37176) 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.321+0000 7f3097e00640 1 -- 172.21.15.31:0/1931939069 learned_addr learned my addr 172.21.15.31:0/1931939069 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.321+0000 7f309cc00640 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a89510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.322 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.321+0000 7f3097e00640 1 -- 172.21.15.31:0/1931939069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a90730 msgr2=0x55fcb4a89a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:45:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.322+0000 7f3097e00640 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a90730 0x55fcb4a89a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.322+0000 7f3097e00640 1 -- 172.21.15.31:0/1931939069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 msgr2=0x55fcb4a89510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.322+0000 7f3097e00640 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a89510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.323 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.322+0000 7f3097e00640 1 -- 172.21.15.31:0/1931939069 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb4a87300 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.324+0000 7f3097e00640 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f308c013ee0 tx=0x7f308c00bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb11281fda80c653 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.330+0000 7f3085200640 1 -- 172.21.15.31:0/1931939069 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c018040 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.330+0000 7f3085200640 1 -- 172.21.15.31:0/1931939069 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f308c02c070 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.330+0000 7f3085200640 1 -- 172.21.15.31:0/1931939069 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c013970 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.331+0000 7f30a23b7740 1 -- 172.21.15.31:0/1931939069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 msgr2=0x55fcb4aa4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.331+0000 7f30a23b7740 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f308c013ee0 tx=0x7f308c00bb40 comp rx=0 tx=0).stop 2024-06-02T22:45:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 -- 172.21.15.31:0/1931939069 shutdown_connections 2024-06-02T22:45:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a90730 0x55fcb4a89a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa4960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 --2- 172.21.15.31:0/1931939069 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4a89510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 -- 172.21.15.31:0/1931939069 >> 172.21.15.31:0/1931939069 conn(0x55fcb4a52f80 msgr2=0x55fcb4a8c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.333+0000 7f30a23b7740 1 -- 172.21.15.31:0/1931939069 shutdown_connections 2024-06-02T22:45:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.335+0000 7f30a23b7740 1 -- 172.21.15.31:0/1931939069 wait complete. 2024-06-02T22:45:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.336+0000 7f30a23b7740 1 -- start start 2024-06-02T22:45:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.336+0000 7f30a23b7740 1 Processor -- start 2024-06-02T22:45:53.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.337+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4aa1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4b12500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30981b2040 con 0x55fcb4a8abd0 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f30981b1970 con 0x55fcb4a8b5c0 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30981aebb0 con 0x55fcb4a90730 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f3097e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f3097e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52630/0 (socket says 172.21.15.31:52630) 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f3097e00640 1 -- 172.21.15.31:0/915046148 learned_addr learned my addr 172.21.15.31:0/915046148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:45:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.340+0000 7f30a23b7740 10 client.0 _ll_register_callbacks cb 0x7f308c00b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:45:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309cc00640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4aa1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4b12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 -- 172.21.15.31:0/915046148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 msgr2=0x55fcb4aa1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 -- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 msgr2=0x55fcb4aa1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:45:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4aa1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309d600640 1 -- 172.21.15.31:0/915046148 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb4b12a40 con 0x55fcb4a90730 2024-06-02T22:45:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.342+0000 7f309cc00640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4aa1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:45:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.343+0000 7f309d600640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4b12500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f30900099a0 tx=0x7f3090009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137a6765444c302 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:45:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.343+0000 7f307a000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:45:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.343+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309000fcf0 con 0x55fcb4a90730 2024-06-02T22:45:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.343+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f308c02c070 con 0x55fcb4a90730 2024-06-02T22:45:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.344+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3090004510 con 0x55fcb4a90730 2024-06-02T22:45:53.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.344+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f309000fe90 con 0x55fcb4a90730 2024-06-02T22:45:53.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.344+0000 7f30a23b7740 10 client.25819 fetch_fsmap learned FSMap version 30 2024-06-02T22:45:53.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.344+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fcb4b13da0 con 0x55fcb4a90730 2024-06-02T22:45:53.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.345+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f308c02c070 con 0x55fcb4a90730 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.345+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f309001c070 con 0x55fcb4a90730 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.345+0000 7f30a23b7740 10 client.25819 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.346+0000 7f30a23b7740 10 client.25819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.346+0000 7f30a23b7740 20 client.25819 populate_metadata read hostname 'smithi031' 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.346+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4b147b0 0x55fcb4b16bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.346+0000 7f30a23b7740 4 client.25819 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:45:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.346+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcb49f5ea0 con 0x55fcb4b147b0 2024-06-02T22:45:53.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.348+0000 7f309cc00640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4b147b0 0x55fcb4b16bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:45:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.352+0000 7f309cc00640 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4b147b0 0x55fcb4b16bd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce68998cb0d2ac53 server_cookie=3cfc45a7b891dc6b in_seq=0 out_seq=0 2024-06-02T22:45:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.353+0000 7f307a000640 10 client.25819 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:45:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:45:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:52 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:45:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.635+0000 7f307a000640 1 -- 172.21.15.31:0/915046148 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fcb49f5ea0 con 0x55fcb4b147b0 2024-06-02T22:45:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.635+0000 7f307a000640 10 client.25819 handle_command_reply: tid=0 2024-06-02T22:45:53.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.635+0000 7f30a23b7740 1 client.25819 shutdown 2024-06-02T22:45:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.635+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 msgr2=0x55fcb4b12500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.635+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4b12500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f30900099a0 tx=0x7f3090009f30 comp rx=0 tx=0).stop 2024-06-02T22:45:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 shutdown_connections 2024-06-02T22:45:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55fcb4b147b0 0x55fcb4b16bd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fcb4a90730 0x55fcb4b12500 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fcb4a8b5c0 0x55fcb4aa1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 --2- 172.21.15.31:0/915046148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55fcb4a8abd0 0x55fcb4aa1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f307a000640 0 client.25819 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 >> 172.21.15.31:0/915046148 conn(0x55fcb4a52f80 msgr2=0x55fcb4a89510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 shutdown_connections 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.636+0000 7f30a23b7740 1 -- 172.21.15.31:0/915046148 wait complete. 2024-06-02T22:45:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.637+0000 7f30a23b7740 20 client.25819 trim_cache size 0 max 16384 2024-06-02T22:45:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:45:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:45:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.638+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 msgr2=0x7f30800a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.638+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 0x7f30800a5170 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3090005fd0 tx=0x7f3090009c10 comp rx=0 tx=0).stop 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.638+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 msgr2=0x7f30981a2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.638+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3088031440 tx=0x7f3088032ce0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 shutdown_connections 2024-06-02T22:45:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f30800a2cb0 0x7f30800a5170 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f309810b790 0x7f30981a9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f309810b310 0x7f30981a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 --2- 172.21.15.31:0/3086153302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30981089a0 0x7f30981a2700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:45:53.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.639+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 >> 172.21.15.31:0/3086153302 conn(0x7f309806ea10 msgr2=0x7f3098070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:45:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.640+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 shutdown_connections 2024-06-02T22:45:53.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:45:53.640+0000 7f309f600640 1 -- 172.21.15.31:0/3086153302 wait complete. 2024-06-02T22:45:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:53 smithi098 ceph-mon[36750]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 798 op/s 2024-06-02T22:45:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:53 smithi178 ceph-mon[36614]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 798 op/s 2024-06-02T22:45:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:53 smithi031 ceph-mon[31767]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 798 op/s 2024-06-02T22:45:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 510.0 s, 548.8 tps, lat 189.492 ms stddev 202.136 2024-06-02T22:45:56.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:55 smithi098 ceph-mon[36750]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 708 op/s 2024-06-02T22:45:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:55 smithi178 ceph-mon[36614]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 708 op/s 2024-06-02T22:45:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:55 smithi031 ceph-mon[31767]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 708 op/s 2024-06-02T22:45:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:57 smithi098 ceph-mon[36750]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 792 op/s 2024-06-02T22:45:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:57 smithi178 ceph-mon[36614]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 792 op/s 2024-06-02T22:45:58.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:57 smithi031 ceph-mon[31767]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 792 op/s 2024-06-02T22:46:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 515.0 s, 581.4 tps, lat 167.941 ms stddev 177.934 2024-06-02T22:46:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:45:59 smithi178 ceph-mon[36614]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-06-02T22:46:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:45:59 smithi031 ceph-mon[31767]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-06-02T22:46:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:45:59 smithi098 ceph-mon[36750]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 642 op/s 2024-06-02T22:46:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:01 smithi178 ceph-mon[36614]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-06-02T22:46:02.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:01 smithi031 ceph-mon[31767]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-06-02T22:46:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:01 smithi098 ceph-mon[36750]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 MiB/s wr, 561 op/s 2024-06-02T22:46:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:03 smithi178 ceph-mon[36614]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2024-06-02T22:46:04.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:03 smithi031 ceph-mon[31767]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2024-06-02T22:46:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:03 smithi098 ceph-mon[36750]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.6 MiB/s wr, 625 op/s 2024-06-02T22:46:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 520.0 s, 498.8 tps, lat 198.585 ms stddev 205.188 2024-06-02T22:46:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:05 smithi178 ceph-mon[36614]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:46:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:05 smithi031 ceph-mon[31767]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:46:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:05 smithi098 ceph-mon[36750]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.4 MiB/s wr, 513 op/s 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 -- 172.21.15.31:0/3648202184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 msgr2=0x7f896c109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 --2- 172.21.15.31:0/3648202184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c109b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8958009860 tx=0x7f895802a340 comp rx=0 tx=0).stop 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 -- 172.21.15.31:0/3648202184 shutdown_connections 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 --2- 172.21.15.31:0/3648202184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c109b30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 --2- 172.21.15.31:0/3648202184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c104db0 0x7f896c1071a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 --2- 172.21.15.31:0/3648202184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c102480 0x7f896c104870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 -- 172.21.15.31:0/3648202184 >> 172.21.15.31:0/3648202184 conn(0x7f896c0fbe70 msgr2=0x7f896c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 -- 172.21.15.31:0/3648202184 shutdown_connections 2024-06-02T22:46:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.861+0000 7f8973400640 1 -- 172.21.15.31:0/3648202184 wait complete. 2024-06-02T22:46:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.864+0000 7f8973400640 1 Processor -- start 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.864+0000 7f8973400640 1 -- start start 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 0x7f896c101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c104db0 0x7f896c100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f896c10d680 con 0x7f896c104db0 2024-06-02T22:46:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f896c10d500 con 0x7f896c1076e0 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8973400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f896c10d800 con 0x7f896c102480 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8970a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 0x7f896c101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8970a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 0x7f896c101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40922/0 (socket says 172.21.15.31:40922) 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8970a00640 1 -- 172.21.15.31:0/1302835439 learned_addr learned my addr 172.21.15.31:0/1302835439 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.865+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f896be00640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c104db0 0x7f896c100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f8971400640 1 -- 172.21.15.31:0/1302835439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 msgr2=0x7f896c101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 0x7f896c101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f8971400640 1 -- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c104db0 msgr2=0x7f896c100430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c104db0 0x7f896c100430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.866+0000 7f8971400640 1 -- 172.21.15.31:0/1302835439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896c101140 con 0x7f896c1076e0 2024-06-02T22:46:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.867+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c100970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f895802a860 tx=0x7f8958033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.867+0000 7f8969600640 1 -- 172.21.15.31:0/1302835439 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958037040 con 0x7f896c1076e0 2024-06-02T22:46:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.868+0000 7f8969600640 1 -- 172.21.15.31:0/1302835439 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8958004050 con 0x7f896c1076e0 2024-06-02T22:46:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.868+0000 7f8969600640 1 -- 172.21.15.31:0/1302835439 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958003b50 con 0x7f896c1076e0 2024-06-02T22:46:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.868+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896c1a1d50 con 0x7f896c1076e0 2024-06-02T22:46:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.868+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f896c1a2160 con 0x7f896c1076e0 2024-06-02T22:46:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.875+0000 7f8969600640 1 -- 172.21.15.31:0/1302835439 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f8958042020 con 0x7f896c1076e0 2024-06-02T22:46:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.876+0000 7f8976216740 1 Processor -- start 2024-06-02T22:46:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.877+0000 7f8976216740 1 -- start start 2024-06-02T22:46:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd05c0 0x55582afd50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd5730 0x55582afd7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55582af33420 con 0x55582afd05c0 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55582aedac50 con 0x55582afd5730 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8976216740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55582af2f3e0 con 0x55582afcfbd0 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f8969600640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 0x7f89500a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40928/0 (socket says 172.21.15.31:40928) 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.879+0000 7f896be00640 1 -- 172.21.15.31:0/2928045858 learned_addr learned my addr 172.21.15.31:0/2928045858 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.880+0000 7f896be00640 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd5730 0x55582afd7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.880+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 0x7f89500a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.880+0000 7f8969600640 1 -- 172.21.15.31:0/1302835439 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f89580eeac0 con 0x7f896c1076e0 2024-06-02T22:46:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.881+0000 7f8970a00640 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd05c0 0x55582afd50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 -- 172.21.15.31:0/2928045858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd5730 msgr2=0x55582afd7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd5730 0x55582afd7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 -- 172.21.15.31:0/2928045858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd05c0 msgr2=0x55582afd50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd05c0 0x55582afd50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 -- 172.21.15.31:0/2928045858 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582ac47210 con 0x55582afcfbd0 2024-06-02T22:46:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f8971400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 0x7f89500a5170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89580b7390 tx=0x7f895802a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f896be00640 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8964013b30 tx=0x7f8964009990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857ce9160163f6d4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f8961c00640 1 -- 172.21.15.31:0/2928045858 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964013120 con 0x55582afcfbd0 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f8961c00640 1 -- 172.21.15.31:0/2928045858 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8964003e50 con 0x55582afcfbd0 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.882+0000 7f8961c00640 1 -- 172.21.15.31:0/2928045858 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89640042b0 con 0x55582afcfbd0 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.883+0000 7f8976216740 1 -- 172.21.15.31:0/2928045858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 msgr2=0x55582afcfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.883+0000 7f8976216740 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8964013b30 tx=0x7f8964009990 comp rx=0 tx=0).stop 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 -- 172.21.15.31:0/2928045858 shutdown_connections 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd5730 0x55582afd7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd05c0 0x55582afd50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 --2- 172.21.15.31:0/2928045858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afcfff0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 -- 172.21.15.31:0/2928045858 >> 172.21.15.31:0/2928045858 conn(0x55582af97f80 msgr2=0x55582afcb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 -- 172.21.15.31:0/2928045858 shutdown_connections 2024-06-02T22:46:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.884+0000 7f8976216740 1 -- 172.21.15.31:0/2928045858 wait complete. 2024-06-02T22:46:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.885+0000 7f8976216740 1 -- start start 2024-06-02T22:46:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.885+0000 7f8976216740 1 Processor -- start 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd5730 0x55582afe9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55582afd8680 con 0x55582afd5730 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55582aeee0b0 con 0x55582afd05c0 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55582afd8800 con 0x55582afcfbd0 2024-06-02T22:46:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.886+0000 7f8976216740 10 client.0 _ll_register_callbacks cb 0x55582aed9f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.887+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.887+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40936/0 (socket says 172.21.15.31:40936) 2024-06-02T22:46:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.887+0000 7f896be00640 1 -- 172.21.15.31:0/1961728942 learned_addr learned my addr 172.21.15.31:0/1961728942 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.887+0000 7f8970a00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd5730 0x55582afe9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 -- 172.21.15.31:0/1961728942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 msgr2=0x55582afe2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 -- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd5730 msgr2=0x55582afe9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd5730 0x55582afe9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.888+0000 7f896be00640 1 -- 172.21.15.31:0/1961728942 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582ad13620 con 0x55582afcfbd0 2024-06-02T22:46:06.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.889+0000 7f896be00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f896401d040 tx=0x7f8964018040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973ecfa8dc6fb42 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.889+0000 7f8956000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.889+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964004a40 con 0x55582afcfbd0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.889+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8964004be0 con 0x55582afcfbd0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.889+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8964003e50 con 0x55582afcfbd0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.890+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8964004de0 con 0x55582afcfbd0 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.890+0000 7f8976216740 10 client.25831 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.890+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55582afda5b0 con 0x55582afcfbd0 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.890+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8964003e50 con 0x55582afcfbd0 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8964005580 con 0x55582afcfbd0 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 10 client.25831 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 20 client.25831 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afdba70 0x55582afddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 4 client.25831 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:46:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.891+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55582af40b50 con 0x55582afdba70 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.892+0000 7f8970a00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afdba70 0x55582afddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.893+0000 7f8970a00640 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afdba70 0x55582afddeb0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c025ca87e1933740 server_cookie=8a884f81cc189993 in_seq=0 out_seq=0 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.893+0000 7f8956000640 10 client.25831 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.894+0000 7f8956000640 1 -- 172.21.15.31:0/1961728942 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55582af40b50 con 0x55582afdba70 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.894+0000 7f8956000640 10 client.25831 handle_command_reply: tid=0 2024-06-02T22:46:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.894+0000 7f8976216740 1 client.25831 shutdown 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.895+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 msgr2=0x55582afe2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.895+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f896401d040 tx=0x7f8964018040 comp rx=0 tx=0).stop 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 shutdown_connections 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afdba70 0x55582afddeb0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afd5730 0x55582afe9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 --2- 172.21.15.31:0/1961728942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afcfbd0 0x55582afe2780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 >> 172.21.15.31:0/1961728942 conn(0x55582af97f80 msgr2=0x55582afca810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8956000640 0 client.25831 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 shutdown_connections 2024-06-02T22:46:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.896+0000 7f8976216740 1 -- 172.21.15.31:0/1961728942 wait complete. 2024-06-02T22:46:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.898+0000 7f8976216740 20 client.25831 trim_cache size 0 max 16384 2024-06-02T22:46:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 Processor -- start 2024-06-02T22:46:06.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 -- start start 2024-06-02T22:46:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afcfbd0 0x55582afe9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a8330 con 0x55582afcfbd0 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a9e70 con 0x55582afd05c0 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.937+0000 7f8976216740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a8a00 con 0x55582af97f80 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.938+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.938+0000 7f896be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40946/0 (socket says 172.21.15.31:40946) 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.938+0000 7f896be00640 1 -- 172.21.15.31:0/3700497500 learned_addr learned my addr 172.21.15.31:0/3700497500 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.938+0000 7f896be00640 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.939+0000 7f896be00640 1 -- 172.21.15.31:0/3700497500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 msgr2=0x55582afe2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.939+0000 7f896be00640 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.939+0000 7f896be00640 1 -- 172.21.15.31:0/3700497500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afcfbd0 msgr2=0x55582afe9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.939+0000 7f896be00640 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afcfbd0 0x55582afe9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.939+0000 7f896be00640 1 -- 172.21.15.31:0/3700497500 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55582afcc300 con 0x55582af97f80 2024-06-02T22:46:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.940+0000 7f896be00640 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8964020880 tx=0x7f8964015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddbbc8eab01bc8dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.941+0000 7f8961200640 1 -- 172.21.15.31:0/3700497500 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964009e00 con 0x55582af97f80 2024-06-02T22:46:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.941+0000 7f8961200640 1 -- 172.21.15.31:0/3700497500 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8964003db0 con 0x55582af97f80 2024-06-02T22:46:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.941+0000 7f8961200640 1 -- 172.21.15.31:0/3700497500 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964004f80 con 0x55582af97f80 2024-06-02T22:46:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.942+0000 7f8976216740 1 -- 172.21.15.31:0/3700497500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 msgr2=0x55582afcedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.942+0000 7f8976216740 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8964020880 tx=0x7f8964015040 comp rx=0 tx=0).stop 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 -- 172.21.15.31:0/3700497500 shutdown_connections 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afd05c0 0x55582afe2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582afcfbd0 0x55582afe9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 --2- 172.21.15.31:0/3700497500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582af97f80 0x55582afcedd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 -- 172.21.15.31:0/3700497500 >> 172.21.15.31:0/3700497500 conn(0x55582afd52e0 msgr2=0x55582afe2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:06.944 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 -- 172.21.15.31:0/3700497500 shutdown_connections 2024-06-02T22:46:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.945+0000 7f8976216740 1 -- 172.21.15.31:0/3700497500 wait complete. 2024-06-02T22:46:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.946+0000 7f8976216740 1 -- start start 2024-06-02T22:46:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.946+0000 7f8976216740 1 Processor -- start 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 0x55582afe57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 0x55582afe5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afd05c0 0x55582afe8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a97a0 con 0x55582af97f80 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a90d0 con 0x55582afcfbd0 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f896c1a6310 con 0x55582afd05c0 2024-06-02T22:46:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.948+0000 7f8976216740 10 client.0 _ll_register_callbacks cb 0x7f895c0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.949+0000 7f8970a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 0x55582afe5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.949+0000 7f8970a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 0x55582afe5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:38806/0 (socket says 172.21.15.31:38806) 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.949+0000 7f8970a00640 1 -- 172.21.15.31:0/1604156727 learned_addr learned my addr 172.21.15.31:0/1604156727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.949+0000 7f896be00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 0x55582afe57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.949+0000 7f896be00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afd05c0 0x55582afe8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.950+0000 7f896be00640 1 -- 172.21.15.31:0/1604156727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afd05c0 msgr2=0x55582afe8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.950+0000 7f896be00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afd05c0 0x55582afe8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.950+0000 7f896be00640 1 -- 172.21.15.31:0/1604156727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 msgr2=0x55582afe5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.950+0000 7f896be00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 0x55582afe5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.950+0000 7f896be00640 1 -- 172.21.15.31:0/1604156727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55582afe92f0 con 0x55582af97f80 2024-06-02T22:46:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.951+0000 7f896be00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 0x55582afe57a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8964013b30 tx=0x7f896400fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7479162da15b715e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.951+0000 7f8956000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.951+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896400fb70 con 0x55582af97f80 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.951+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f8964005190 con 0x55582af97f80 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.951+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8964003db0 con 0x55582af97f80 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.952+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8964005390 con 0x55582af97f80 2024-06-02T22:46:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.952+0000 7f8976216740 10 client.15579 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.952+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55582b060af0 con 0x55582af97f80 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.952+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8964003db0 con 0x55582af97f80 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.952+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f89640048b0 con 0x55582af97f80 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 10 client.15579 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 20 client.15579 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afd5730 0x55582b0633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 4 client.15579 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:46:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55582af3aea0 con 0x55582afd5730 2024-06-02T22:46:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.953+0000 7f8970a00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afd5730 0x55582b0633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.954+0000 7f8970a00640 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afd5730 0x55582b0633c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535f7142708d20d7 server_cookie=e3b8c94e6270d644 in_seq=0 out_seq=0 2024-06-02T22:46:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:06.954+0000 7f8956000640 10 client.15579 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8956000640 1 -- 172.21.15.31:0/1604156727 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55582af3aea0 con 0x55582afd5730 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8956000640 10 client.15579 handle_command_reply: tid=0 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 client.15579 shutdown 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 msgr2=0x55582afe57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 0x55582afe57a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8964013b30 tx=0x7f896400fa90 comp rx=0 tx=0).stop 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 shutdown_connections 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55582afd5730 0x55582b0633c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55582afd05c0 0x55582afe8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55582afcfbd0 0x55582afe5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 --2- 172.21.15.31:0/1604156727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55582af97f80 0x55582afe57a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 >> 172.21.15.31:0/1604156727 conn(0x55582afd52e0 msgr2=0x55582afe07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8956000640 0 client.15579 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 shutdown_connections 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.018+0000 7f8976216740 1 -- 172.21.15.31:0/1604156727 wait complete. 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.019+0000 7f8976216740 20 client.15579 trim_cache size 0 max 16384 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:46:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.019+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 msgr2=0x7f89500a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.019+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 0x7f89500a5170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89580b7390 tx=0x7f895802a340 comp rx=0 tx=0).stop 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.019+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 msgr2=0x7f896c100970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.019+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c100970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f895802a860 tx=0x7f8958033d10 comp rx=0 tx=0).stop 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 shutdown_connections 2024-06-02T22:46:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f89500a2cb0 0x7f89500a5170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f896c1076e0 0x7f896c100970 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f896c104db0 0x7f896c100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 --2- 172.21.15.31:0/1302835439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896c102480 0x7f896c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 >> 172.21.15.31:0/1302835439 conn(0x7f896c0fbe70 msgr2=0x7f896c102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 shutdown_connections 2024-06-02T22:46:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:07.020+0000 7f8973400640 1 -- 172.21.15.31:0/1302835439 wait complete. 2024-06-02T22:46:08.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:08 smithi178 ceph-mon[36614]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 565 op/s 2024-06-02T22:46:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:08 smithi031 ceph-mon[31767]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 565 op/s 2024-06-02T22:46:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:08 smithi098 ceph-mon[36750]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 MiB/s wr, 565 op/s 2024-06-02T22:46:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 525.0 s, 465.8 tps, lat 211.733 ms stddev 261.247 2024-06-02T22:46:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:10 smithi178 ceph-mon[36614]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 MiB/s wr, 485 op/s 2024-06-02T22:46:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:10 smithi031 ceph-mon[31767]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 MiB/s wr, 485 op/s 2024-06-02T22:46:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:10 smithi098 ceph-mon[36750]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.1 MiB/s wr, 485 op/s 2024-06-02T22:46:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:12 smithi178 ceph-mon[36614]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-06-02T22:46:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:12 smithi031 ceph-mon[31767]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-06-02T22:46:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:12 smithi098 ceph-mon[36750]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-06-02T22:46:14.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:14 smithi178 ceph-mon[36614]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 532 op/s 2024-06-02T22:46:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:14 smithi031 ceph-mon[31767]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 532 op/s 2024-06-02T22:46:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:14 smithi098 ceph-mon[36750]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 MiB/s wr, 532 op/s 2024-06-02T22:46:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 530.0 s, 529.0 tps, lat 190.037 ms stddev 236.282 2024-06-02T22:46:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:16 smithi178 ceph-mon[36614]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:46:16.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:16 smithi031 ceph-mon[31767]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:46:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:16 smithi098 ceph-mon[36750]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:46:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:18 smithi178 ceph-mon[36614]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2024-06-02T22:46:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:18 smithi031 ceph-mon[31767]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2024-06-02T22:46:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:18 smithi098 ceph-mon[36750]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.7 MiB/s wr, 545 op/s 2024-06-02T22:46:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 535.0 s, 484.2 tps, lat 209.183 ms stddev 227.636 2024-06-02T22:46:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.252+0000 7f2759200640 1 -- 172.21.15.31:0/1324338310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27541035c0 msgr2=0x7f2754109e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.252+0000 7f2759200640 1 --2- 172.21.15.31:0/1324338310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27541035c0 0x7f2754109e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f274c009ca0 tx=0x7f274c02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.253+0000 7f2759200640 1 -- 172.21.15.31:0/1324338310 shutdown_connections 2024-06-02T22:46:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.253+0000 7f2759200640 1 --2- 172.21.15.31:0/1324338310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27541035c0 0x7f2754109e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.253+0000 7f2759200640 1 --2- 172.21.15.31:0/1324338310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2754102c00 0x7f2754103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.253+0000 7f2759200640 1 --2- 172.21.15.31:0/1324338310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754101a10 0x7f2754101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.253+0000 7f2759200640 1 -- 172.21.15.31:0/1324338310 >> 172.21.15.31:0/1324338310 conn(0x7f27540fcf60 msgr2=0x7f27540ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.255+0000 7f2759200640 1 -- 172.21.15.31:0/1324338310 shutdown_connections 2024-06-02T22:46:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.255+0000 7f2759200640 1 -- 172.21.15.31:0/1324338310 wait complete. 2024-06-02T22:46:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.257+0000 7f2759200640 1 Processor -- start 2024-06-02T22:46:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.258+0000 7f2759200640 1 -- start start 2024-06-02T22:46:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.258+0000 7f2759200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 0x7f2754199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2759200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 0x7f275419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2759200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27541035c0 0x7f27541a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2759200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f275410d690 con 0x7f2754102c00 2024-06-02T22:46:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2759200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f275410d510 con 0x7f27541035c0 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2759200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f275410d810 con 0x7f2754101a10 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2751e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 0x7f2754199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2751e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 0x7f2754199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43386/0 (socket says 172.21.15.31:43386) 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.259+0000 7f2751e00640 1 -- 172.21.15.31:0/1774449415 learned_addr learned my addr 172.21.15.31:0/1774449415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.260+0000 7f2751400640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 0x7f275419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.261+0000 7f2751400640 1 -- 172.21.15.31:0/1774449415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 msgr2=0x7f2754199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.261+0000 7f2751400640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 0x7f2754199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.261+0000 7f2751400640 1 -- 172.21.15.31:0/1774449415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27541035c0 msgr2=0x7f27541a13b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.261+0000 7f2751400640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27541035c0 0x7f27541a13b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.261+0000 7f2751400640 1 -- 172.21.15.31:0/1774449415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2754103ea0 con 0x7f2754102c00 2024-06-02T22:46:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.262+0000 7f2751400640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 0x7f275419a340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f274401e6e0 tx=0x7f274401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.264+0000 7f274aa00640 1 -- 172.21.15.31:0/1774449415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2744028070 con 0x7f2754102c00 2024-06-02T22:46:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.264+0000 7f274aa00640 1 -- 172.21.15.31:0/1774449415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2744005500 con 0x7f2754102c00 2024-06-02T22:46:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.264+0000 7f274aa00640 1 -- 172.21.15.31:0/1774449415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2744004a00 con 0x7f2754102c00 2024-06-02T22:46:20.263 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.264+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2754104190 con 0x7f2754102c00 2024-06-02T22:46:20.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.264+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541046e0 con 0x7f2754102c00 2024-06-02T22:46:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 Processor -- start 2024-06-02T22:46:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 -- start start 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d9e7643420 con 0x55d9e76e05c0 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.269+0000 7f275bfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d9e75eac50 con 0x55d9e76e5730 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.270+0000 7f275bfce740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d9e763f3e0 con 0x55d9e76dfbd0 2024-06-02T22:46:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.270+0000 7f2752800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.270+0000 7f2752800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43400/0 (socket says 172.21.15.31:43400) 2024-06-02T22:46:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.270+0000 7f2752800640 1 -- 172.21.15.31:0/3997651076 learned_addr learned my addr 172.21.15.31:0/3997651076 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.271+0000 7f2751e00640 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f274aa00640 1 -- 172.21.15.31:0/1774449415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f2744004ba0 con 0x7f2754102c00 2024-06-02T22:46:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 -- 172.21.15.31:0/3997651076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 msgr2=0x55d9e76e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 -- 172.21.15.31:0/3997651076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 msgr2=0x55d9e76e50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 -- 172.21.15.31:0/3997651076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e7357210 con 0x55d9e76dfbd0 2024-06-02T22:46:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.273+0000 7f2752800640 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f274c005e30 tx=0x7f274c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cc7f492042ded3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.274+0000 7f273f400640 1 -- 172.21.15.31:0/3997651076 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c03f070 con 0x55d9e76dfbd0 2024-06-02T22:46:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.275+0000 7f273f400640 1 -- 172.21.15.31:0/3997651076 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f274c036040 con 0x55d9e76dfbd0 2024-06-02T22:46:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.275+0000 7f273f400640 1 -- 172.21.15.31:0/3997651076 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c003e60 con 0x55d9e76dfbd0 2024-06-02T22:46:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.275+0000 7f274aa00640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 0x7f27380a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.275+0000 7f274aa00640 1 -- 172.21.15.31:0/1774449415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27440e0040 con 0x7f2754102c00 2024-06-02T22:46:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.275+0000 7f2751e00640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 0x7f27380a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 -- 172.21.15.31:0/3997651076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 msgr2=0x55d9e76dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f274c005e30 tx=0x7f274c009360 comp rx=0 tx=0).stop 2024-06-02T22:46:20.275 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 -- 172.21.15.31:0/3997651076 shutdown_connections 2024-06-02T22:46:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76e50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 --2- 172.21.15.31:0/3997651076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76dfff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.276 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.276+0000 7f275bfce740 1 -- 172.21.15.31:0/3997651076 >> 172.21.15.31:0/3997651076 conn(0x55d9e76a7f80 msgr2=0x55d9e76db650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.277+0000 7f275bfce740 1 -- 172.21.15.31:0/3997651076 shutdown_connections 2024-06-02T22:46:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.277+0000 7f275bfce740 1 -- 172.21.15.31:0/3997651076 wait complete. 2024-06-02T22:46:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.278+0000 7f275bfce740 1 -- start start 2024-06-02T22:46:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.278+0000 7f2751e00640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 0x7f27380a5170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55d9e76dc500 tx=0x7f274000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.278+0000 7f275bfce740 1 Processor -- start 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 0x55d9e76ea560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f2751400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 0x55d9e76ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f2752800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f2751400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 0x55d9e76ea560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43406/0 (socket says 172.21.15.31:43406) 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f2751400640 1 -- 172.21.15.31:0/2656517593 learned_addr learned my addr 172.21.15.31:0/2656517593 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d9e76e8680 con 0x55d9e76dfbd0 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d9e75fe0b0 con 0x55d9e76e5730 2024-06-02T22:46:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.279+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d9e76e8800 con 0x55d9e76e05c0 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f275bfce740 10 client.0 _ll_register_callbacks cb 0x55d9e75e9f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2751e00640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 -- 172.21.15.31:0/2656517593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 msgr2=0x55d9e76ea560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 0x55d9e76ea560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 -- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 msgr2=0x55d9e76ea020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ea020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e7423620 con 0x55d9e76e5730 2024-06-02T22:46:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2751e00640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:46:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.280+0000 7f2752800640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76f15a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f274c009ca0 tx=0x7f274c003aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c13fed5994c23 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.281+0000 7f2733e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:46:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.281+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c03f070 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.281+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f274c004250 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.281+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f274c036040 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.282+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f274c004b40 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.282+0000 7f275bfce740 10 client.25856 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.282+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9e76e8680 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.282+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f274c036040 con 0x55d9e76e5730 2024-06-02T22:46:20.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.283+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f274c02f910 con 0x55d9e76e5730 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.283+0000 7f275bfce740 10 client.25856 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.284+0000 7f275bfce740 10 client.25856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.284+0000 7f275bfce740 20 client.25856 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.284+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e76f5b50 0x55d9e76f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.284+0000 7f275bfce740 4 client.25856 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:46:20.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.284+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e7650b50 con 0x55d9e76f5b50 2024-06-02T22:46:20.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.287+0000 7f2751e00640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e76f5b50 0x55d9e76f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.294+0000 7f2733e00640 10 client.25856 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:20.294 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.294+0000 7f2751e00640 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e76f5b50 0x55d9e76f7f40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6f0448854ce33 server_cookie=95a89e750bd611e0 in_seq=0 out_seq=0 2024-06-02T22:46:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.296+0000 7f2733e00640 1 -- 172.21.15.31:0/2656517593 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d9e7650b50 con 0x55d9e76f5b50 2024-06-02T22:46:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.296+0000 7f2733e00640 10 client.25856 handle_command_reply: tid=0 2024-06-02T22:46:20.295 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.296+0000 7f275bfce740 1 client.25856 shutdown 2024-06-02T22:46:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 msgr2=0x55d9e76f15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76f15a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f274c009ca0 tx=0x7f274c003aa0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 shutdown_connections 2024-06-02T22:46:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e76f5b50 0x55d9e76f7f40 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e5730 0x55d9e76f15a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.301 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e05c0 0x55d9e76ea560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 --2- 172.21.15.31:0/2656517593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f2733e00640 0 client.25856 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.300+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 >> 172.21.15.31:0/2656517593 conn(0x55d9e76a7f80 msgr2=0x55d9e76da810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.301+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 shutdown_connections 2024-06-02T22:46:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.303+0000 7f275bfce740 1 -- 172.21.15.31:0/2656517593 wait complete. 2024-06-02T22:46:20.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.303+0000 7f275bfce740 20 client.25856 trim_cache size 0 max 16384 2024-06-02T22:46:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:20 smithi178 ceph-mon[36614]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-06-02T22:46:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.338+0000 7f275bfce740 1 Processor -- start 2024-06-02T22:46:20.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 -- start start 2024-06-02T22:46:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76daf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e5730 0x55d9e76db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2754071d60 con 0x55d9e76e5730 2024-06-02T22:46:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27540738a0 con 0x55d9e76e05c0 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.339+0000 7f275bfce740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2754072430 con 0x55d9e76dfbd0 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48578/0 (socket says 172.21.15.31:48578) 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 -- 172.21.15.31:0/423193090 learned_addr learned my addr 172.21.15.31:0/423193090 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 -- 172.21.15.31:0/423193090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 msgr2=0x55d9e76daf90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:46:20.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76daf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.340+0000 7f2751400640 1 -- 172.21.15.31:0/423193090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e5730 msgr2=0x55d9e76db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.341+0000 7f2751400640 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e5730 0x55d9e76db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.341+0000 7f2751400640 1 -- 172.21.15.31:0/423193090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e76dc300 con 0x55d9e76e05c0 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.341+0000 7f2751400640 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f27440dd800 tx=0x7f2744004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdab66c9a9283633 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.341+0000 7f273ea00640 1 -- 172.21.15.31:0/423193090 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440c4020 con 0x55d9e76e05c0 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.342+0000 7f273ea00640 1 -- 172.21.15.31:0/423193090 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27440acc10 con 0x55d9e76e05c0 2024-06-02T22:46:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.342+0000 7f273ea00640 1 -- 172.21.15.31:0/423193090 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440aa810 con 0x55d9e76e05c0 2024-06-02T22:46:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 -- 172.21.15.31:0/423193090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 msgr2=0x55d9e76f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f27440dd800 tx=0x7f2744004f90 comp rx=0 tx=0).stop 2024-06-02T22:46:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 -- 172.21.15.31:0/423193090 shutdown_connections 2024-06-02T22:46:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e5730 0x55d9e76db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76e05c0 0x55d9e76f1560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 --2- 172.21.15.31:0/423193090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76dfbd0 0x55d9e76daf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.343+0000 7f275bfce740 1 -- 172.21.15.31:0/423193090 >> 172.21.15.31:0/423193090 conn(0x55d9e76a7f80 msgr2=0x55d9e76e19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.344+0000 7f275bfce740 1 -- 172.21.15.31:0/423193090 shutdown_connections 2024-06-02T22:46:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.344+0000 7f275bfce740 1 -- 172.21.15.31:0/423193090 wait complete. 2024-06-02T22:46:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.345+0000 7f275bfce740 1 -- start start 2024-06-02T22:46:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.345+0000 7f275bfce740 1 Processor -- start 2024-06-02T22:46:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.346+0000 7f275bfce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ee650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.346+0000 7f275bfce740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.346+0000 7f275bfce740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f2752800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f2752800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:43428/0 (socket says 172.21.15.31:43428) 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f2752800640 1 -- 172.21.15.31:0/3358897368 learned_addr learned my addr 172.21.15.31:0/3358897368 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27540731d0 con 0x55d9e76e05c0 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2754072b00 con 0x55d9e76dfbd0 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f2751e00640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f275406fd40 con 0x55d9e76e5730 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.347+0000 7f275bfce740 10 client.0 _ll_register_callbacks cb 0x7f274c004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751400640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751e00640 1 -- 172.21.15.31:0/3358897368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 msgr2=0x55d9e76efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751e00640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751e00640 1 -- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 msgr2=0x55d9e76eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751e00640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.348+0000 7f2751e00640 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e76f0120 con 0x55d9e76dfbd0 2024-06-02T22:46:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.349+0000 7f2752800640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:46:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.349+0000 7f2751400640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:46:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.351+0000 7f2751e00640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ee650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55d9e76e9610 tx=0x7f27400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98b12c16ccfcfa8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.351+0000 7f2733e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:46:20.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.351+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740003e50 con 0x55d9e76dfbd0 2024-06-02T22:46:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.351+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2740012450 con 0x55d9e76dfbd0 2024-06-02T22:46:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.352+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27440acc10 con 0x55d9e76dfbd0 2024-06-02T22:46:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.353+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2740046050 con 0x55d9e76dfbd0 2024-06-02T22:46:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.353+0000 7f275bfce740 10 client.25862 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.353+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d9e76f14a0 con 0x55d9e76dfbd0 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.354+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27440acc10 con 0x55d9e76dfbd0 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.354+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f2740031720 con 0x55d9e76dfbd0 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 10 client.25862 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 10 client.25862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 20 client.25862 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e7760b80 0x55d9e7762fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 4 client.25862 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:46:20.354 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d9e764aea0 con 0x55d9e7760b80 2024-06-02T22:46:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.355+0000 7f2751400640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e7760b80 0x55d9e7762fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.356+0000 7f2751400640 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e7760b80 0x55d9e7762fa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c86210e81b02f918 server_cookie=cfa00223e55c6fde in_seq=0 out_seq=0 2024-06-02T22:46:20.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.356+0000 7f2733e00640 10 client.25862 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:20.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:20 smithi031 ceph-mon[31767]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-06-02T22:46:20.414 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.414+0000 7f2733e00640 1 -- 172.21.15.31:0/3358897368 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d9e764aea0 con 0x55d9e7760b80 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.414+0000 7f2733e00640 10 client.25862 handle_command_reply: tid=0 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.414+0000 7f275bfce740 1 client.25862 shutdown 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 msgr2=0x55d9e76ee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ee650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55d9e76e9610 tx=0x7f27400046c0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 shutdown_connections 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d9e7760b80 0x55d9e7762fa0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d9e76e5730 0x55d9e76efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d9e76e05c0 0x55d9e76eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 --2- 172.21.15.31:0/3358897368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d9e76dfbd0 0x55d9e76ee650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 >> 172.21.15.31:0/3358897368 conn(0x55d9e76a7f80 msgr2=0x55d9e76de590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.415+0000 7f2733e00640 0 client.25862 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.416+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 shutdown_connections 2024-06-02T22:46:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.416+0000 7f275bfce740 1 -- 172.21.15.31:0/3358897368 wait complete. 2024-06-02T22:46:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.417+0000 7f275bfce740 20 client.25862 trim_cache size 0 max 16384 2024-06-02T22:46:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:46:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:46:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:46:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 msgr2=0x7f27380a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 0x7f27380a5170 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55d9e76dc500 tx=0x7f274000a380 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 msgr2=0x7f275419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 0x7f275419a340 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f274401e6e0 tx=0x7f274401eba0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 shutdown_connections 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27380a2cb0 0x7f27380a5170 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27541035c0 0x7f27541a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2754102c00 0x7f275419a340 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 --2- 172.21.15.31:0/1774449415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2754101a10 0x7f2754199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 >> 172.21.15.31:0/1774449415 conn(0x7f27540fcf60 msgr2=0x7f2754073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 shutdown_connections 2024-06-02T22:46:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:20.418+0000 7f2759200640 1 -- 172.21.15.31:0/1774449415 wait complete. 2024-06-02T22:46:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:20 smithi098 ceph-mon[36750]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-06-02T22:46:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:22 smithi178 ceph-mon[36614]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2024-06-02T22:46:22.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:22 smithi031 ceph-mon[31767]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2024-06-02T22:46:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:22 smithi098 ceph-mon[36750]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.1 MiB/s wr, 478 op/s 2024-06-02T22:46:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:24 smithi178 ceph-mon[36614]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2024-06-02T22:46:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:24 smithi031 ceph-mon[31767]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2024-06-02T22:46:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:24 smithi098 ceph-mon[36750]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 552 op/s 2024-06-02T22:46:25.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 540.0 s, 512.0 tps, lat 199.445 ms stddev 236.159 2024-06-02T22:46:26.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:26 smithi031 ceph-mon[31767]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 535 op/s 2024-06-02T22:46:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:26 smithi098 ceph-mon[36750]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 535 op/s 2024-06-02T22:46:26.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:26 smithi178 ceph-mon[36614]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 535 op/s 2024-06-02T22:46:28.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:28 smithi031 ceph-mon[31767]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:46:28.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:28 smithi098 ceph-mon[36750]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:46:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:28 smithi178 ceph-mon[36614]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-06-02T22:46:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 545.0 s, 530.4 tps, lat 187.849 ms stddev 218.725 2024-06-02T22:46:30.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:30 smithi031 ceph-mon[31767]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-06-02T22:46:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:30 smithi098 ceph-mon[36750]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-06-02T22:46:30.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:30 smithi178 ceph-mon[36614]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-06-02T22:46:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:32 smithi031 ceph-mon[31767]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:46:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:32 smithi098 ceph-mon[36750]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:46:32.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:32 smithi178 ceph-mon[36614]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:46:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.628+0000 7fee5f200640 1 -- 172.21.15.31:0/4124358565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee601053b0 msgr2=0x7fee60105830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.628+0000 7fee5f200640 1 --2- 172.21.15.31:0/4124358565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee601053b0 0x7fee60105830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009900 tx=0x7fee4c02a400 comp rx=0 tx=0).stop 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 -- 172.21.15.31:0/4124358565 shutdown_connections 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 --2- 172.21.15.31:0/4124358565 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee601053b0 0x7fee60105830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 --2- 172.21.15.31:0/4124358565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60102a00 0x7fee60104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 --2- 172.21.15.31:0/4124358565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee60100090 0x7fee601024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 -- 172.21.15.31:0/4124358565 >> 172.21.15.31:0/4124358565 conn(0x7fee600fbc90 msgr2=0x7fee600fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 -- 172.21.15.31:0/4124358565 shutdown_connections 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.631+0000 7fee5f200640 1 -- 172.21.15.31:0/4124358565 wait complete. 2024-06-02T22:46:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.632+0000 7fee5f200640 1 Processor -- start 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.632+0000 7fee5f200640 1 -- start start 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60100090 0x7fee6019e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee60102a00 0x7fee6019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee60113a70 con 0x7fee60100090 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee601138f0 con 0x7fee60102a00 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fee60113bf0 con 0x7fee601053b0 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50388/0 (socket says 172.21.15.31:50388) 2024-06-02T22:46:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5e800640 1 -- 172.21.15.31:0/2812832743 learned_addr learned my addr 172.21.15.31:0/2812832743 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5de00640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60100090 0x7fee6019e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.633+0000 7fee5d400640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee60102a00 0x7fee6019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.634+0000 7fee5e800640 1 -- 172.21.15.31:0/2812832743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee60102a00 msgr2=0x7fee6019e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.634+0000 7fee5e800640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee60102a00 0x7fee6019e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.634+0000 7fee5e800640 1 -- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60100090 msgr2=0x7fee6019e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.634+0000 7fee5e800640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60100090 0x7fee6019e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.634+0000 7fee5e800640 1 -- 172.21.15.31:0/2812832743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6006b4f0 con 0x7fee601053b0 2024-06-02T22:46:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.637+0000 7fee5e800640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0314e0 tx=0x7fee4c031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.637+0000 7fee56a00640 1 -- 172.21.15.31:0/2812832743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c03f030 con 0x7fee601053b0 2024-06-02T22:46:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.637+0000 7fee56a00640 1 -- 172.21.15.31:0/2812832743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee4c003ad0 con 0x7fee601053b0 2024-06-02T22:46:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.638+0000 7fee56a00640 1 -- 172.21.15.31:0/2812832743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c035070 con 0x7fee601053b0 2024-06-02T22:46:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.638+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6006b780 con 0x7fee601053b0 2024-06-02T22:46:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.638+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6006bc20 con 0x7fee601053b0 2024-06-02T22:46:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.643+0000 7fee56a00640 1 -- 172.21.15.31:0/2812832743 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fee4c042030 con 0x7fee601053b0 2024-06-02T22:46:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.644+0000 7fee67f96740 1 Processor -- start 2024-06-02T22:46:33.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.645+0000 7fee67f96740 1 -- start start 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbbd90 0x55b386cbc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386cc1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b386c1f420 con 0x55b386cbc780 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b386bc6c50 con 0x55b386cc18f0 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee67f96740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b386c1b3e0 con 0x55b386cbbd90 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.646+0000 7fee5d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.647+0000 7fee5d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52476/0 (socket says 172.21.15.31:52476) 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.647+0000 7fee5d400640 1 -- 172.21.15.31:0/2319591501 learned_addr learned my addr 172.21.15.31:0/2319591501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.647+0000 7fee5de00640 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386cc1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.647+0000 7fee56a00640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 0x7fee440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee5d400640 1 -- 172.21.15.31:0/2319591501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbbd90 msgr2=0x55b386cbc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee5d400640 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbbd90 0x55b386cbc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee5d400640 1 -- 172.21.15.31:0/2319591501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 msgr2=0x55b386cc1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee5d400640 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386cc1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee5d400640 1 -- 172.21.15.31:0/2319591501 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b386933210 con 0x55b386cc18f0 2024-06-02T22:46:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.649+0000 7fee5de00640 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386cc1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:46:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.648+0000 7fee56a00640 1 -- 172.21.15.31:0/2812832743 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fee4c0efaa0 con 0x7fee601053b0 2024-06-02T22:46:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.649+0000 7fee5d400640 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ec50 tx=0x7fee500107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d5533dd142bb645 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.650+0000 7fee5e800640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 0x7fee440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.651+0000 7fee5e800640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 0x7fee440a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0bbc70 tx=0x7fee4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.653+0000 7fee4b400640 1 -- 172.21.15.31:0/2319591501 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50005220 con 0x55b386cc18f0 2024-06-02T22:46:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.654+0000 7fee4b400640 1 -- 172.21.15.31:0/2319591501 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee50015070 con 0x55b386cc18f0 2024-06-02T22:46:33.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.654+0000 7fee4b400640 1 -- 172.21.15.31:0/2319591501 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50011810 con 0x55b386cc18f0 2024-06-02T22:46:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 -- 172.21.15.31:0/2319591501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 msgr2=0x55b386cc3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fee5000ec50 tx=0x7fee500107a0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 -- 172.21.15.31:0/2319591501 shutdown_connections 2024-06-02T22:46:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386cc3d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386cc1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 --2- 172.21.15.31:0/2319591501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbbd90 0x55b386cbc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.655+0000 7fee67f96740 1 -- 172.21.15.31:0/2319591501 >> 172.21.15.31:0/2319591501 conn(0x55b386c83f80 msgr2=0x55b386cb7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.656+0000 7fee67f96740 1 -- 172.21.15.31:0/2319591501 shutdown_connections 2024-06-02T22:46:33.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.656+0000 7fee67f96740 1 -- 172.21.15.31:0/2319591501 wait complete. 2024-06-02T22:46:33.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.657+0000 7fee67f96740 1 -- start start 2024-06-02T22:46:33.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.657+0000 7fee67f96740 1 Processor -- start 2024-06-02T22:46:33.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386ccd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b386cc48a0 con 0x55b386cbbd90 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b386bda0b0 con 0x55b386cc18f0 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b386cc4a20 con 0x55b386cbc780 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.658+0000 7fee67f96740 10 client.0 _ll_register_callbacks cb 0x55b386bc5f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.659+0000 7fee5de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.659+0000 7fee5de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50400/0 (socket says 172.21.15.31:50400) 2024-06-02T22:46:33.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.659+0000 7fee5d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.660+0000 7fee5d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45228/0 (socket says 172.21.15.31:45228) 2024-06-02T22:46:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.661+0000 7fee5d400640 1 -- 172.21.15.31:0/1923052781 learned_addr learned my addr 172.21.15.31:0/1923052781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:33.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.661+0000 7fee5d400640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386ccd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.662+0000 7fee5de00640 1 -- 172.21.15.31:0/1923052781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 msgr2=0x55b386ccd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.662+0000 7fee5de00640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386ccd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.662+0000 7fee5de00640 1 -- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 msgr2=0x55b386cc61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.664+0000 7fee5de00640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.664+0000 7fee5de00640 1 -- 172.21.15.31:0/1923052781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3869ff620 con 0x55b386cbc780 2024-06-02T22:46:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.664+0000 7fee5d400640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:46:33.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.665+0000 7fee5de00640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b386cbcb80 tx=0x7fee58023f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3215901c02fab2c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.667+0000 7fee3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:46:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.667+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58021cb0 con 0x55b386cbc780 2024-06-02T22:46:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.667+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fee5802d420 con 0x55b386cbc780 2024-06-02T22:46:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.667+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee50015070 con 0x55b386cbc780 2024-06-02T22:46:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.668+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee58021e50 con 0x55b386cbc780 2024-06-02T22:46:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.668+0000 7fee67f96740 10 client.25861 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.668+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b386cd0b40 con 0x55b386cbc780 2024-06-02T22:46:33.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.669+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee50015070 con 0x55b386cbc780 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee580368c0 con 0x55b386cbc780 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 10 client.25861 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 10 client.25861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 20 client.25861 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386cd4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 4 client.25861 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b386c2cb50 con 0x55b386cd2210 2024-06-02T22:46:33.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.670+0000 7fee5d400640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386cd4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.672+0000 7fee5d400640 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386cd4620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5bc6e87d513bf8 server_cookie=c846517c6009a169 in_seq=0 out_seq=0 2024-06-02T22:46:33.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.672+0000 7fee3fe00640 10 client.25861 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:33.674 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee3fe00640 1 -- 172.21.15.31:0/1923052781 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b386c2cb50 con 0x55b386cd2210 2024-06-02T22:46:33.674 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee3fe00640 10 client.25861 handle_command_reply: tid=0 2024-06-02T22:46:33.674 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee67f96740 1 client.25861 shutdown 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 msgr2=0x55b386cc6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55b386cbcb80 tx=0x7fee58023f00 comp rx=0 tx=0).stop 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 shutdown_connections 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.674+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386cd4620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cc18f0 0x55b386ccd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee3fe00640 0 client.25861 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cbc780 0x55b386cc6730 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.675 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee67f96740 1 --2- 172.21.15.31:0/1923052781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386cc61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 >> 172.21.15.31:0/1923052781 conn(0x55b386c83f80 msgr2=0x55b386cb6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.675+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 shutdown_connections 2024-06-02T22:46:33.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.676+0000 7fee67f96740 1 -- 172.21.15.31:0/1923052781 wait complete. 2024-06-02T22:46:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.677+0000 7fee67f96740 20 client.25861 trim_cache size 0 max 16384 2024-06-02T22:46:33.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.712+0000 7fee67f96740 1 Processor -- start 2024-06-02T22:46:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.712+0000 7fee67f96740 1 -- start start 2024-06-02T22:46:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbbd90 0x55b386cc4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386ccd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cbdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee60108ee0 con 0x55b386cbc780 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010aa20 con 0x55b386cbbd90 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.713+0000 7fee67f96740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fee601095b0 con 0x55b386cc18f0 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.714+0000 7fee5d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cbdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.714+0000 7fee5d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cbdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50406/0 (socket says 172.21.15.31:50406) 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.714+0000 7fee5d400640 1 -- 172.21.15.31:0/1303705471 learned_addr learned my addr 172.21.15.31:0/1303705471 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:33.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.714+0000 7fee5de00640 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386ccd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.714+0000 7fee5d400640 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbbd90 0x55b386cc4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.715+0000 7fee5de00640 1 -- 172.21.15.31:0/1303705471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 msgr2=0x55b386cbdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.715+0000 7fee5de00640 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cbdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.715+0000 7fee5de00640 1 -- 172.21.15.31:0/1303705471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbbd90 msgr2=0x55b386cc4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.715+0000 7fee5de00640 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbbd90 0x55b386cc4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.715+0000 7fee5de00640 1 -- 172.21.15.31:0/1303705471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b386cc0ea0 con 0x55b386cbc780 2024-06-02T22:46:33.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.716+0000 7fee5de00640 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386ccd6c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee58036d30 tx=0x7fee58009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ff606c982abe8b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.717+0000 7fee4aa00640 1 -- 172.21.15.31:0/1303705471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58021ab0 con 0x55b386cbc780 2024-06-02T22:46:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.718+0000 7fee4aa00640 1 -- 172.21.15.31:0/1303705471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58021c50 con 0x55b386cbc780 2024-06-02T22:46:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.718+0000 7fee4aa00640 1 -- 172.21.15.31:0/1303705471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee580364a0 con 0x55b386cbc780 2024-06-02T22:46:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 -- 172.21.15.31:0/1303705471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 msgr2=0x55b386ccd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386ccd6c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fee58036d30 tx=0x7fee58009af0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 -- 172.21.15.31:0/1303705471 shutdown_connections 2024-06-02T22:46:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cbdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbc780 0x55b386ccd6c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 --2- 172.21.15.31:0/1303705471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbbd90 0x55b386cc4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.719+0000 7fee67f96740 1 -- 172.21.15.31:0/1303705471 >> 172.21.15.31:0/1303705471 conn(0x55b386c83f80 msgr2=0x55b386cc61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.720+0000 7fee67f96740 1 -- 172.21.15.31:0/1303705471 shutdown_connections 2024-06-02T22:46:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.720+0000 7fee67f96740 1 -- 172.21.15.31:0/1303705471 wait complete. 2024-06-02T22:46:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.721+0000 7fee67f96740 1 -- start start 2024-06-02T22:46:33.722 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.721+0000 7fee67f96740 1 Processor -- start 2024-06-02T22:46:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386ccd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010a350 con 0x55b386cbbd90 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee60109c80 con 0x55b386cbc780 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fee60106ec0 con 0x55b386cc18f0 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee67f96740 10 client.0 _ll_register_callbacks cb 0x7fee58009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee5de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee5de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52518/0 (socket says 172.21.15.31:52518) 2024-06-02T22:46:33.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.723+0000 7fee5de00640 1 -- 172.21.15.31:0/2560428292 learned_addr learned my addr 172.21.15.31:0/2560428292 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5d400640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5d400640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386ccd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5de00640 1 -- 172.21.15.31:0/2560428292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 msgr2=0x55b386cca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5de00640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5de00640 1 -- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 msgr2=0x55b386ccd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:33.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5de00640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386ccd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.724+0000 7fee5de00640 1 -- 172.21.15.31:0/2560428292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b386d3aef0 con 0x55b386cbc780 2024-06-02T22:46:33.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.725+0000 7fee5de00640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fee58036e50 tx=0x7fee58003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f4a2cf500abef3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.725+0000 7fee3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58003c90 con 0x55b386cbc780 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fee58036650 con 0x55b386cbc780 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee58021c50 con 0x55b386cbc780 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fee58036850 con 0x55b386cbc780 2024-06-02T22:46:33.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee67f96740 10 client.25880 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b386d3c180 con 0x55b386cbc780 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.726+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58021c50 con 0x55b386cbc780 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fee5800e580 con 0x55b386cbc780 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 10 client.25880 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 10 client.25880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 20 client.25880 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386d3eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 4 client.25880 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:46:33.728 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b386c26ea0 con 0x55b386cd2210 2024-06-02T22:46:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.727+0000 7fee5d400640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386d3eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.728+0000 7fee3fe00640 10 client.25880 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:33.729 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.729+0000 7fee5d400640 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386d3eb40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a613e2e1aedbb13a server_cookie=6d44b8df407945c9 in_seq=0 out_seq=0 2024-06-02T22:46:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.793+0000 7fee3fe00640 1 -- 172.21.15.31:0/2560428292 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b386c26ea0 con 0x55b386cd2210 2024-06-02T22:46:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.793+0000 7fee3fe00640 10 client.25880 handle_command_reply: tid=0 2024-06-02T22:46:33.794 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.793+0000 7fee67f96740 1 client.25880 shutdown 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 msgr2=0x55b386cca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fee58036e50 tx=0x7fee58003ba0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 shutdown_connections 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b386cd2210 0x55b386d3eb40 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b386cc18f0 0x55b386cca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b386cbc780 0x55b386cca090 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 --2- 172.21.15.31:0/2560428292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b386cbbd90 0x55b386ccd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 >> 172.21.15.31:0/2560428292 conn(0x55b386c83f80 msgr2=0x55b386cc61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee3fe00640 0 client.25880 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 shutdown_connections 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 1 -- 172.21.15.31:0/2560428292 wait complete. 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.794+0000 7fee67f96740 20 client.25880 trim_cache size 0 max 16384 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:46:33.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 msgr2=0x7fee440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 0x7fee440a5040 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0bbc70 tx=0x7fee4c009260 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 msgr2=0x7fee601a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0314e0 tx=0x7fee4c031b60 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 shutdown_connections 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fee440a2b80 0x7fee440a5040 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee601053b0 0x7fee601a5690 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee60102a00 0x7fee6019e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 --2- 172.21.15.31:0/2812832743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee60100090 0x7fee6019e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:33.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 >> 172.21.15.31:0/2812832743 conn(0x7fee600fbc90 msgr2=0x7fee60100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 shutdown_connections 2024-06-02T22:46:33.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:33.795+0000 7fee5f200640 1 -- 172.21.15.31:0/2812832743 wait complete. 2024-06-02T22:46:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:34 smithi031 ceph-mon[31767]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:46:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:34 smithi098 ceph-mon[36750]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:46:34.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:34 smithi178 ceph-mon[36614]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.0 MiB/s wr, 546 op/s 2024-06-02T22:46:35.226 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 550.0 s, 466.2 tps, lat 209.342 ms stddev 249.866 2024-06-02T22:46:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:36 smithi031 ceph-mon[31767]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-06-02T22:46:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:36 smithi098 ceph-mon[36750]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-06-02T22:46:36.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:36 smithi178 ceph-mon[36614]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-06-02T22:46:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:38 smithi098 ceph-mon[36750]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 530 op/s 2024-06-02T22:46:38.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:38 smithi178 ceph-mon[36614]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 530 op/s 2024-06-02T22:46:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:38 smithi031 ceph-mon[31767]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.9 MiB/s wr, 530 op/s 2024-06-02T22:46:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 555.0 s, 470.8 tps, lat 215.662 ms stddev 247.841 2024-06-02T22:46:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:40 smithi098 ceph-mon[36750]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 MiB/s wr, 465 op/s 2024-06-02T22:46:40.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:40 smithi178 ceph-mon[36614]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 MiB/s wr, 465 op/s 2024-06-02T22:46:40.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:40 smithi031 ceph-mon[31767]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.9 MiB/s wr, 465 op/s 2024-06-02T22:46:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:42 smithi098 ceph-mon[36750]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-06-02T22:46:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:42 smithi178 ceph-mon[36614]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-06-02T22:46:42.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:42 smithi031 ceph-mon[31767]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-06-02T22:46:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:44 smithi098 ceph-mon[36750]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-06-02T22:46:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:44 smithi178 ceph-mon[36614]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-06-02T22:46:44.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:44 smithi031 ceph-mon[31767]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-06-02T22:46:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 560.0 s, 479.4 tps, lat 209.639 ms stddev 244.156 2024-06-02T22:46:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:46 smithi098 ceph-mon[36750]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 467 op/s 2024-06-02T22:46:46.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:46 smithi178 ceph-mon[36614]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 467 op/s 2024-06-02T22:46:46.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:46 smithi031 ceph-mon[31767]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.0 MiB/s wr, 467 op/s 2024-06-02T22:46:47.011 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 -- 172.21.15.31:0/3414895062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c06a7d0 msgr2=0x7f014c10b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 --2- 172.21.15.31:0/3414895062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c06a7d0 0x7f014c10b4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ca0 tx=0x7f013c02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 -- 172.21.15.31:0/3414895062 shutdown_connections 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 --2- 172.21.15.31:0/3414895062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 0x7f014c1109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 --2- 172.21.15.31:0/3414895062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c10ba80 0x7f014c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 --2- 172.21.15.31:0/3414895062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c06a7d0 0x7f014c10b4b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 -- 172.21.15.31:0/3414895062 >> 172.21.15.31:0/3414895062 conn(0x7f014c06ebd0 msgr2=0x7f014c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 -- 172.21.15.31:0/3414895062 shutdown_connections 2024-06-02T22:46:47.012 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.011+0000 7f0151800640 1 -- 172.21.15.31:0/3414895062 wait complete. 2024-06-02T22:46:47.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.013+0000 7f0151800640 1 Processor -- start 2024-06-02T22:46:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.013+0000 7f0151800640 1 -- start start 2024-06-02T22:46:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.013+0000 7f0151800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.013+0000 7f0151800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c10ba80 0x7f014c19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f0151800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 0x7f014c1ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f0151800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f014c115f10 con 0x7f014c10e500 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f0151800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f014c115d90 con 0x7f014c10ba80 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f0151800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f014c116090 con 0x7f014c06a7d0 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45438/0 (socket says 172.21.15.31:45438) 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014aa00640 1 -- 172.21.15.31:0/634582963 learned_addr learned my addr 172.21.15.31:0/634582963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f0142000640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c10ba80 0x7f014c19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014b400640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 0x7f014c1ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014aa00640 1 -- 172.21.15.31:0/634582963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c10ba80 msgr2=0x7f014c19e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.014+0000 7f014aa00640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c10ba80 0x7f014c19e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f014aa00640 1 -- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 msgr2=0x7f014c1ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f014aa00640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 0x7f014c1ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f014aa00640 1 -- 172.21.15.31:0/634582963 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c1ae780 con 0x7f014c06a7d0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f014aa00640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f013c000f80 tx=0x7f013c0319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f0143e00640 1 -- 172.21.15.31:0/634582963 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c003bf0 con 0x7f014c06a7d0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f0143e00640 1 -- 172.21.15.31:0/634582963 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c003d90 con 0x7f014c06a7d0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.015+0000 7f0143e00640 1 -- 172.21.15.31:0/634582963 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c02fd30 con 0x7f014c06a7d0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.016+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c1aea10 con 0x7f014c06a7d0 2024-06-02T22:46:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.016+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1aeee0 con 0x7f014c06a7d0 2024-06-02T22:46:47.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.019+0000 7f0143e00640 1 -- 172.21.15.31:0/634582963 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f013c004040 con 0x7f014c06a7d0 2024-06-02T22:46:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.020+0000 7f01541fd740 1 Processor -- start 2024-06-02T22:46:47.021 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.021+0000 7f01541fd740 1 -- start start 2024-06-02T22:46:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e4bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e53bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4daf420 con 0x55d0b4e51730 2024-06-02T22:46:47.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4d56c50 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f01541fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4dab3e0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f0143e00640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 0x7f01300a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55006/0 (socket says 172.21.15.31:55006) 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014aa00640 1 -- 172.21.15.31:0/2821763794 learned_addr learned my addr 172.21.15.31:0/2821763794 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014b400640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e4bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014b400640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 0x7f01300a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f0142000640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e53bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f0143e00640 1 -- 172.21.15.31:0/634582963 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f013c0f0880 con 0x7f014c06a7d0 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014aa00640 1 -- 172.21.15.31:0/2821763794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4bbd0 msgr2=0x55d0b4e4bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.022+0000 7f014aa00640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e4bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f014aa00640 1 -- 172.21.15.31:0/2821763794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 msgr2=0x55d0b4e53bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f014aa00640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e53bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f014aa00640 1 -- 172.21.15.31:0/2821763794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0b4ac3210 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f0142000640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e53bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f014aa00640 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f013c08ff30 tx=0x7f013c08ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f39a81f27b4304b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f013be00640 1 -- 172.21.15.31:0/2821763794 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0bc6e0 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f013be00640 1 -- 172.21.15.31:0/2821763794 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c036070 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.023+0000 7f013be00640 1 -- 172.21.15.31:0/2821763794 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0c5960 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 -- 172.21.15.31:0/2821763794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 msgr2=0x55d0b4e510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f013c08ff30 tx=0x7f013c08ff60 comp rx=0 tx=0).stop 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f014b400640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 0x7f01300a5170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55d0b4e4ce20 tx=0x7f01440046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 -- 172.21.15.31:0/2821763794 shutdown_connections 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e53bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e510c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 --2- 172.21.15.31:0/2821763794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e4bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 -- 172.21.15.31:0/2821763794 >> 172.21.15.31:0/2821763794 conn(0x55d0b4e13f80 msgr2=0x55d0b4e47650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 -- 172.21.15.31:0/2821763794 shutdown_connections 2024-06-02T22:46:47.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.024+0000 7f01541fd740 1 -- 172.21.15.31:0/2821763794 wait complete. 2024-06-02T22:46:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.025+0000 7f01541fd740 1 -- start start 2024-06-02T22:46:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.025+0000 7f01541fd740 1 Processor -- start 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e56050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e5d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4d56c50 con 0x55d0b4e51730 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4d6a0b0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d0b4e544a0 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f01541fd740 10 client.0 _ll_register_callbacks cb 0x55d0b4d55f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.026+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55008/0 (socket says 172.21.15.31:55008) 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 -- 172.21.15.31:0/932892915 learned_addr learned my addr 172.21.15.31:0/932892915 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f0142000640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e56050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 -- 172.21.15.31:0/932892915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 msgr2=0x55d0b4e56050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e56050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 -- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 msgr2=0x55d0b4e5d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014b400640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e5d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e5d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 -- 172.21.15.31:0/932892915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0b4b8f620 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f0142000640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e56050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014b400640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f014aa00640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b91e0 tx=0x7f013c0bc6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4974182da42636c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.027+0000 7f0138c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.028+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0c5960 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.028+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f013c0b93f0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.028+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013c036070 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.029+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f013c0da050 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.030+0000 7f01541fd740 10 client.25892 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:47.030 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.030+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0b4e60300 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c036070 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f013c0d4030 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 10 client.25892 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 10 client.25892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 20 client.25892 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4e61690 0x55d0b4e63a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 4 client.25892 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.031+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0b4dbcb50 con 0x55d0b4e61690 2024-06-02T22:46:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.032+0000 7f0142000640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4e61690 0x55d0b4e63a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.033+0000 7f0138c00640 10 client.25892 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.033+0000 7f0142000640 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4e61690 0x55d0b4e63a80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76f71789d47a2e2a server_cookie=973b0f98700ff240 in_seq=0 out_seq=0 2024-06-02T22:46:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.036+0000 7f0138c00640 1 -- 172.21.15.31:0/932892915 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d0b4dbcb50 con 0x55d0b4e61690 2024-06-02T22:46:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.036+0000 7f0138c00640 10 client.25892 handle_command_reply: tid=0 2024-06-02T22:46:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.037+0000 7f01541fd740 1 client.25892 shutdown 2024-06-02T22:46:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.037+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 msgr2=0x55d0b4e55b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.037+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b91e0 tx=0x7f013c0bc6e0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 shutdown_connections 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4e61690 0x55d0b4e63a80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e51730 0x55d0b4e5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e56050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 --2- 172.21.15.31:0/932892915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e55b10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 >> 172.21.15.31:0/932892915 conn(0x55d0b4e13f80 msgr2=0x55d0b4e46810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f0138c00640 0 client.25892 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 shutdown_connections 2024-06-02T22:46:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.038+0000 7f01541fd740 1 -- 172.21.15.31:0/932892915 wait complete. 2024-06-02T22:46:47.039 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.039+0000 7f01541fd740 20 client.25892 trim_cache size 0 max 16384 2024-06-02T22:46:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 Processor -- start 2024-06-02T22:46:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 -- start start 2024-06-02T22:46:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e51730 0x55d0b4e55720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1b9500 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1bb040 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f01541fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1b9bd0 con 0x55d0b4e51730 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f014aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55016/0 (socket says 172.21.15.31:55016) 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f014aa00640 1 -- 172.21.15.31:0/3890361720 learned_addr learned my addr 172.21.15.31:0/3890361720 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.070+0000 7f014b400640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e51730 0x55d0b4e55720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f0142000640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 -- 172.21.15.31:0/3890361720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e51730 msgr2=0x55d0b4e55720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e51730 0x55d0b4e55720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 -- 172.21.15.31:0/3890361720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 msgr2=0x55d0b4e5cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 -- 172.21.15.31:0/3890361720 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0b4e640e0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f0142000640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.071+0000 7f014aa00640 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f013c003fd0 tx=0x7f013c003f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb57b03206c2dd7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.072+0000 7f013b400640 1 -- 172.21.15.31:0/3890361720 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0b93f0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.072+0000 7f013b400640 1 -- 172.21.15.31:0/3890361720 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c036070 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.072+0000 7f013b400640 1 -- 172.21.15.31:0/3890361720 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0b93f0 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 -- 172.21.15.31:0/3890361720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 msgr2=0x55d0b4e477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f013c003fd0 tx=0x7f013c003f40 comp rx=0 tx=0).stop 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 -- 172.21.15.31:0/3890361720 shutdown_connections 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e51730 0x55d0b4e55720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 --2- 172.21.15.31:0/3890361720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e477e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 -- 172.21.15.31:0/3890361720 >> 172.21.15.31:0/3890361720 conn(0x55d0b4e13f80 msgr2=0x55d0b4e470d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.073+0000 7f01541fd740 1 -- 172.21.15.31:0/3890361720 shutdown_connections 2024-06-02T22:46:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.074+0000 7f01541fd740 1 -- 172.21.15.31:0/3890361720 wait complete. 2024-06-02T22:46:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.074+0000 7f01541fd740 1 -- start start 2024-06-02T22:46:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.074+0000 7f01541fd740 1 Processor -- start 2024-06-02T22:46:47.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e59cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 0x55d0b4eca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ba970 con 0x55d0b4e4bbd0 2024-06-02T22:46:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1ba2a0 con 0x55d0b4e51730 2024-06-02T22:46:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1b74e0 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f01541fd740 10 client.0 _ll_register_callbacks cb 0x7f013c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f0142000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f0142000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:45476/0 (socket says 172.21.15.31:45476) 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f0142000640 1 -- 172.21.15.31:0/1350783700 learned_addr learned my addr 172.21.15.31:0/1350783700 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.075+0000 7f014b400640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 0x55d0b4eca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f014aa00640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e59cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 -- 172.21.15.31:0/1350783700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 msgr2=0x55d0b4eca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 0x55d0b4eca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 -- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4bbd0 msgr2=0x55d0b4e59cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e59cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 -- 172.21.15.31:0/1350783700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0b4e5a870 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f014b400640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 0x55d0b4eca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:46:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0142000640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0134004700 tx=0x7f0134009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06f76d1ea083ed0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.076+0000 7f0138c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134004460 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013c036070 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f01340035f0 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f013402d050 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f01541fd740 10 client.25885 fetch_fsmap learned FSMap version 30 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0b4ecb9d0 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f013c036070 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.077+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f013401ea60 con 0x55d0b4e4c5c0 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 10 client.25885 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 10 client.25885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 20 client.25885 populate_metadata read hostname 'smithi031' 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4ecc3b0 0x55d0b4ece7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 4 client.25885 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0b4db6ea0 con 0x55d0b4ecc3b0 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.078+0000 7f014aa00640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4ecc3b0 0x55d0b4ece7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.079+0000 7f014aa00640 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4ecc3b0 0x55d0b4ece7d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1fa4409c352a81 server_cookie=ba5659948ccfaec0 in_seq=0 out_seq=0 2024-06-02T22:46:47.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.079+0000 7f0138c00640 10 client.25885 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f0138c00640 1 -- 172.21.15.31:0/1350783700 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d0b4db6ea0 con 0x55d0b4ecc3b0 2024-06-02T22:46:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f0138c00640 10 client.25885 handle_command_reply: tid=0 2024-06-02T22:46:47.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 client.25885 shutdown 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 msgr2=0x55d0b4e5a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0134004700 tx=0x7f0134009b40 comp rx=0 tx=0).stop 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 shutdown_connections 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d0b4ecc3b0 0x55d0b4ece7d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0b4e51730 0x55d0b4eca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d0b4e4c5c0 0x55d0b4e5a200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 --2- 172.21.15.31:0/1350783700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d0b4e4bbd0 0x55d0b4e59cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 >> 172.21.15.31:0/1350783700 conn(0x55d0b4e13f80 msgr2=0x55d0b4e55690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.687+0000 7f0138c00640 0 client.25885 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:46:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.688+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 shutdown_connections 2024-06-02T22:46:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.688+0000 7f01541fd740 1 -- 172.21.15.31:0/1350783700 wait complete. 2024-06-02T22:46:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.689+0000 7f01541fd740 20 client.25885 trim_cache size 0 max 16384 2024-06-02T22:46:47.689 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:46:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:46:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:46:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.690+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 msgr2=0x7f01300a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.690 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.690+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 0x7f01300a5170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55d0b4e4ce20 tx=0x7f01440046c0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 msgr2=0x7f014c19e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:46:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f013c000f80 tx=0x7f013c0319f0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 shutdown_connections 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f01300a2cb0 0x7f01300a5170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c10e500 0x7f014c1ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f014c10ba80 0x7f014c19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 --2- 172.21.15.31:0/634582963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f014c06a7d0 0x7f014c19e310 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.691+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 >> 172.21.15.31:0/634582963 conn(0x7f014c06ebd0 msgr2=0x7f014c113c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.692+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 shutdown_connections 2024-06-02T22:46:47.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:46:47.692+0000 7f0151800640 1 -- 172.21.15.31:0/634582963 wait complete. 2024-06-02T22:46:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:48 smithi098 ceph-mon[36750]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 510 op/s 2024-06-02T22:46:48.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:48 smithi178 ceph-mon[36614]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 510 op/s 2024-06-02T22:46:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:48 smithi031 ceph-mon[31767]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.3 MiB/s wr, 510 op/s 2024-06-02T22:46:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 565.0 s, 579.2 tps, lat 174.958 ms stddev 206.770 2024-06-02T22:46:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:50 smithi098 ceph-mon[36750]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 469 op/s 2024-06-02T22:46:50.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:50 smithi178 ceph-mon[36614]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 469 op/s 2024-06-02T22:46:50.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:50 smithi031 ceph-mon[31767]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.1 MiB/s wr, 469 op/s 2024-06-02T22:46:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:52 smithi098 ceph-mon[36750]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-06-02T22:46:52.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:52 smithi178 ceph-mon[36614]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-06-02T22:46:52.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:52 smithi031 ceph-mon[31767]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 456 op/s 2024-06-02T22:46:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:53 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:46:53.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:53 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:46:53.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:53 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:46:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:54 smithi098 ceph-mon[36750]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-06-02T22:46:54.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:54 smithi178 ceph-mon[36614]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-06-02T22:46:54.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:54 smithi031 ceph-mon[31767]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-06-02T22:46:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 570.0 s, 561.4 tps, lat 172.651 ms stddev 209.615 2024-06-02T22:46:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:56 smithi098 ceph-mon[36750]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.6 MiB/s wr, 520 op/s 2024-06-02T22:46:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:46:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:46:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:46:56.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:56 smithi178 ceph-mon[36614]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.6 MiB/s wr, 520 op/s 2024-06-02T22:46:56.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:46:56.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:46:56.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:46:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:56 smithi031 ceph-mon[31767]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.6 MiB/s wr, 520 op/s 2024-06-02T22:46:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:46:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:46:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:46:58.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:46:58 smithi098 ceph-mon[36750]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2024-06-02T22:46:58.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:46:58 smithi178 ceph-mon[36614]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2024-06-02T22:46:58.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:46:58 smithi031 ceph-mon[31767]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.0 MiB/s wr, 581 op/s 2024-06-02T22:47:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 575.0 s, 573.8 tps, lat 175.474 ms stddev 206.545 2024-06-02T22:47:00.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:00 smithi178 ceph-mon[36614]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2024-06-02T22:47:00.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:00 smithi031 ceph-mon[31767]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2024-06-02T22:47:00.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:00 smithi098 ceph-mon[36750]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 539 op/s 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 -- 172.21.15.31:0/1327736270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 msgr2=0x7fd074073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 --2- 172.21.15.31:0/1327736270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd074073dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd070009ca0 tx=0x7fd07002a950 comp rx=0 tx=0).stop 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 -- 172.21.15.31:0/1327736270 shutdown_connections 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 --2- 172.21.15.31:0/1327736270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0741098c0 0x7fd07410bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 --2- 172.21.15.31:0/1327736270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0740743a0 0x7fd074074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 --2- 172.21.15.31:0/1327736270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd074073dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 -- 172.21.15.31:0/1327736270 >> 172.21.15.31:0/1327736270 conn(0x7fd0740fcfc0 msgr2=0x7fd0740ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.913+0000 7fd07c800640 1 -- 172.21.15.31:0/1327736270 shutdown_connections 2024-06-02T22:47:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.914+0000 7fd07c800640 1 -- 172.21.15.31:0/1327736270 wait complete. 2024-06-02T22:47:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 Processor -- start 2024-06-02T22:47:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 -- start start 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd07419e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0741098c0 0x7fd0741a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741027a0 con 0x7fd0741098c0 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd074102620 con 0x7fd074075980 2024-06-02T22:47:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.915+0000 7fd07c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd074102920 con 0x7fd0740743a0 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.916+0000 7fd079e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.916+0000 7fd079e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:56656/0 (socket says 172.21.15.31:56656) 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.916+0000 7fd079e00640 1 -- 172.21.15.31:0/1228727847 learned_addr learned my addr 172.21.15.31:0/1228727847 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.916+0000 7fd079400640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd07419e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.916+0000 7fd07a800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0741098c0 0x7fd0741a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 -- 172.21.15.31:0/1228727847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 msgr2=0x7fd07419e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd07419e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 -- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0741098c0 msgr2=0x7fd0741a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0741098c0 0x7fd0741a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 -- 172.21.15.31:0/1228727847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0741a5e00 con 0x7fd0740743a0 2024-06-02T22:47:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.917+0000 7fd079e00640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd07002f870 tx=0x7fd070031eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.918+0000 7fd06ea00640 1 -- 172.21.15.31:0/1228727847 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070034040 con 0x7fd0740743a0 2024-06-02T22:47:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.919+0000 7fd06ea00640 1 -- 172.21.15.31:0/1228727847 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd070003e00 con 0x7fd0740743a0 2024-06-02T22:47:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.919+0000 7fd06ea00640 1 -- 172.21.15.31:0/1228727847 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070045480 con 0x7fd0740743a0 2024-06-02T22:47:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.919+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0741a6090 con 0x7fd0740743a0 2024-06-02T22:47:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.919+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0741a6530 con 0x7fd0740743a0 2024-06-02T22:47:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.923+0000 7fd06ea00640 1 -- 172.21.15.31:0/1228727847 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fd070037020 con 0x7fd0740743a0 2024-06-02T22:47:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.924+0000 7fd07f5be740 1 Processor -- start 2024-06-02T22:47:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 -- start start 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe657420 con 0x55b1fe6f9730 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe5fec50 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.926 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.925+0000 7fd07f5be740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe6533e0 con 0x55b1fe6f45c0 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd079e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd07a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd07a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:51338/0 (socket says 172.21.15.31:51338) 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd07a800640 1 -- 172.21.15.31:0/2956034759 learned_addr learned my addr 172.21.15.31:0/2956034759 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd079400640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.926+0000 7fd06ea00640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 0x7fd05c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd079400640 1 -- 172.21.15.31:0/2956034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 msgr2=0x55b1fe6f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd079400640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd079400640 1 -- 172.21.15.31:0/2956034759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 msgr2=0x55b1fe6f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd079400640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd079400640 1 -- 172.21.15.31:0/2956034759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fe36b210 con 0x55b1fe6f9730 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.927+0000 7fd07a800640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.928+0000 7fd079e00640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.928+0000 7fd06ea00640 1 -- 172.21.15.31:0/1228727847 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd0700f13d0 con 0x7fd0740743a0 2024-06-02T22:47:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.928+0000 7fd07a800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 0x7fd05c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.928+0000 7fd079400640 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fbbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd068005d00 tx=0x7fd0680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39db21fb5bbc43d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.929+0000 7fd063000640 1 -- 172.21.15.31:0/2956034759 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068004220 con 0x55b1fe6f9730 2024-06-02T22:47:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.929+0000 7fd063000640 1 -- 172.21.15.31:0/2956034759 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd06800be20 con 0x55b1fe6f9730 2024-06-02T22:47:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.929+0000 7fd063000640 1 -- 172.21.15.31:0/2956034759 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068011840 con 0x55b1fe6f9730 2024-06-02T22:47:00.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 -- 172.21.15.31:0/2956034759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 msgr2=0x55b1fe6fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fbbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd068005d00 tx=0x7fd0680107a0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07a800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 0x7fd05c0a5260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55b1fe6f4e20 tx=0x7fd064004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 -- 172.21.15.31:0/2956034759 shutdown_connections 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fbbc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2956034759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 -- 172.21.15.31:0/2956034759 >> 172.21.15.31:0/2956034759 conn(0x55b1fe6bbf80 msgr2=0x55b1fe6ef650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 -- 172.21.15.31:0/2956034759 shutdown_connections 2024-06-02T22:47:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.930+0000 7fd07f5be740 1 -- 172.21.15.31:0/2956034759 wait complete. 2024-06-02T22:47:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.931+0000 7fd07f5be740 1 -- start start 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.931+0000 7fd07f5be740 1 Processor -- start 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.931+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6fe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe705480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe6fc6e0 con 0x55b1fe6f9730 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe6120b0 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b1fe6fc860 con 0x55b1fe6f45c0 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07f5be740 10 client.0 _ll_register_callbacks cb 0x55b1fe5fdf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:51348/0 (socket says 172.21.15.31:51348) 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 -- 172.21.15.31:0/2635169520 learned_addr learned my addr 172.21.15.31:0/2635169520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079400640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6fe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd07a800640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe705480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 -- 172.21.15.31:0/2635169520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 msgr2=0x55b1fe6fe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6fe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 -- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 msgr2=0x55b1fe705480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe705480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.932+0000 7fd079e00640 1 -- 172.21.15.31:0/2635169520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fe437620 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.933+0000 7fd079e00640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0700eeb60 tx=0x7fd07003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a536eecae0a69e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.933+0000 7fd057400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.933+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700c1d00 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.933+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd0700c4070 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.933+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd06800be20 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.934+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd0700c6530 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.934+0000 7fd07f5be740 10 client.25910 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.934+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1fe708760 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.934+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd06800be20 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd0700a80e0 con 0x55b1fe6f3bd0 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 10 client.25910 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 10 client.25910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 20 client.25910 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe709e90 0x55b1fe70c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 4 client.25910 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:47:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.935+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1fe664b50 con 0x55b1fe709e90 2024-06-02T22:47:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.936+0000 7fd079400640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe709e90 0x55b1fe70c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.937+0000 7fd079400640 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe709e90 0x55b1fe70c320 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aec7073b5e3e4a2b server_cookie=340e8bb27dd8af in_seq=0 out_seq=0 2024-06-02T22:47:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.937+0000 7fd057400640 10 client.25910 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.941+0000 7fd057400640 1 -- 172.21.15.31:0/2635169520 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b1fe664b50 con 0x55b1fe709e90 2024-06-02T22:47:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.941+0000 7fd057400640 10 client.25910 handle_command_reply: tid=0 2024-06-02T22:47:00.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.942+0000 7fd07f5be740 1 client.25910 shutdown 2024-06-02T22:47:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.945+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 msgr2=0x55b1fe6fdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:00.945 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.945+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0700eeb60 tx=0x7fd07003f000 comp rx=0 tx=0).stop 2024-06-02T22:47:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 shutdown_connections 2024-06-02T22:47:00.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe709e90 0x55b1fe70c320 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f9730 0x55b1fe705480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f45c0 0x55b1fe6fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 --2- 172.21.15.31:0/2635169520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6fdf00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:00.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd057400640 0 client.25910 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:00.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.948+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 >> 172.21.15.31:0/2635169520 conn(0x55b1fe6bbf80 msgr2=0x55b1fe6ee810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.950+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 shutdown_connections 2024-06-02T22:47:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.950+0000 7fd07f5be740 1 -- 172.21.15.31:0/2635169520 wait complete. 2024-06-02T22:47:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:00.950+0000 7fd07f5be740 20 client.25910 trim_cache size 0 max 16384 2024-06-02T22:47:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.008+0000 7fd07f5be740 1 Processor -- start 2024-06-02T22:47:01.009 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.008+0000 7fd07f5be740 1 -- start start 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe705440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741b0980 con 0x55b1fe6f45c0 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741b24c0 con 0x55b1fe6f9730 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07f5be740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741b1050 con 0x55b1fe6f3bd0 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd079400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe705440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd07a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.010 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd079400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe705440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41498/0 (socket says 172.21.15.31:41498) 2024-06-02T22:47:01.013 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd079400640 1 -- 172.21.15.31:0/1999983935 learned_addr learned my addr 172.21.15.31:0/1999983935 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:01.014 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.009+0000 7fd079e00640 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.010+0000 7fd07a800640 1 -- 172.21.15.31:0/1999983935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 msgr2=0x55b1fe6f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.010+0000 7fd07a800640 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.010+0000 7fd07a800640 1 -- 172.21.15.31:0/1999983935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 msgr2=0x55b1fe705440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.010+0000 7fd07a800640 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe705440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.010+0000 7fd07a800640 1 -- 172.21.15.31:0/1999983935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fe6f0300 con 0x55b1fe6f9730 2024-06-02T22:47:01.015 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.012+0000 7fd079e00640 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:01.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.013+0000 7fd07a800640 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fdb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd064005940 tx=0x7fd06400c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb1ec69f76a4c61 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:01.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.015+0000 7fd062600640 1 -- 172.21.15.31:0/1999983935 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064008e20 con 0x55b1fe6f9730 2024-06-02T22:47:01.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.015+0000 7fd062600640 1 -- 172.21.15.31:0/1999983935 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd064005500 con 0x55b1fe6f9730 2024-06-02T22:47:01.016 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.015+0000 7fd062600640 1 -- 172.21.15.31:0/1999983935 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0640035f0 con 0x55b1fe6f9730 2024-06-02T22:47:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.017+0000 7fd07f5be740 1 -- 172.21.15.31:0/1999983935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 msgr2=0x55b1fe6fdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.017+0000 7fd07f5be740 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fdb10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd064005940 tx=0x7fd06400c970 comp rx=0 tx=0).stop 2024-06-02T22:47:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.018+0000 7fd07f5be740 1 -- 172.21.15.31:0/1999983935 shutdown_connections 2024-06-02T22:47:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.018+0000 7fd07f5be740 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe6fdb10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.018+0000 7fd07f5be740 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe705440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.018+0000 7fd07f5be740 1 --2- 172.21.15.31:0/1999983935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe6f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.018+0000 7fd07f5be740 1 -- 172.21.15.31:0/1999983935 >> 172.21.15.31:0/1999983935 conn(0x55b1fe6bbf80 msgr2=0x55b1fe6f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.019+0000 7fd07f5be740 1 -- 172.21.15.31:0/1999983935 shutdown_connections 2024-06-02T22:47:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.019+0000 7fd07f5be740 1 -- 172.21.15.31:0/1999983935 wait complete. 2024-06-02T22:47:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.019+0000 7fd07f5be740 1 -- start start 2024-06-02T22:47:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.020+0000 7fd07f5be740 1 Processor -- start 2024-06-02T22:47:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.023+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe702b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.023+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.023+0000 7fd07f5be740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe703fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.024 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.023+0000 7fd079400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07f5be740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741b1df0 con 0x55b1fe6f45c0 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07f5be740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741b1720 con 0x55b1fe6f9730 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07f5be740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741ae960 con 0x55b1fe6f3bd0 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07f5be740 10 client.0 _ll_register_callbacks cb 0x7fd070009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd079e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe702b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.025 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe703fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd079400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41512/0 (socket says 172.21.15.31:41512) 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd079400640 1 -- 172.21.15.31:0/598947906 learned_addr learned my addr 172.21.15.31:0/598947906 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07a800640 1 -- 172.21.15.31:0/598947906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 msgr2=0x55b1fe702b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.024+0000 7fd07a800640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe702b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd07a800640 1 -- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 msgr2=0x55b1fe703070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd07a800640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd07a800640 1 -- 172.21.15.31:0/598947906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fe7045d0 con 0x55b1fe6f9730 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd079400640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd079e00640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe702b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:47:01.026 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd07a800640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe703fe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd064027000 tx=0x7fd06400cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeacd794704b1562 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.025+0000 7fd057400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.026+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0640051f0 con 0x55b1fe6f9730 2024-06-02T22:47:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.026+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd064005500 con 0x55b1fe6f9730 2024-06-02T22:47:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.026+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fd064004ff0 con 0x55b1fe6f9730 2024-06-02T22:47:01.027 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.027+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd0640051f0 con 0x55b1fe6f9730 2024-06-02T22:47:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.027+0000 7fd07f5be740 10 client.25916 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.027+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b1fe785c10 con 0x55b1fe6f9730 2024-06-02T22:47:01.028 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd064005500 con 0x55b1fe6f9730 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd064003c60 con 0x55b1fe6f9730 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 10 client.25916 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 20 client.25916 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe786590 0x55b1fe7889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 4 client.25916 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.028+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b1fe65eea0 con 0x55b1fe786590 2024-06-02T22:47:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.030+0000 7fd079e00640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe786590 0x55b1fe7889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:01.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.031+0000 7fd079e00640 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe786590 0x55b1fe7889b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abbdeab05400e5e0 server_cookie=8c21ba43c412bd4b in_seq=0 out_seq=0 2024-06-02T22:47:01.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.031+0000 7fd057400640 10 client.25916 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.248+0000 7fd057400640 1 -- 172.21.15.31:0/598947906 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b1fe65eea0 con 0x55b1fe786590 2024-06-02T22:47:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.248+0000 7fd057400640 10 client.25916 handle_command_reply: tid=0 2024-06-02T22:47:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.248+0000 7fd07f5be740 1 client.25916 shutdown 2024-06-02T22:47:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.248+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 msgr2=0x55b1fe703fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.248+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe703fe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd064027000 tx=0x7fd06400cac0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 shutdown_connections 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b1fe786590 0x55b1fe7889b0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b1fe6f9730 0x55b1fe703fe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b1fe6f45c0 0x55b1fe703070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 --2- 172.21.15.31:0/598947906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b1fe6f3bd0 0x55b1fe702b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.249+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 >> 172.21.15.31:0/598947906 conn(0x55b1fe6bbf80 msgr2=0x55b1fe6fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:01.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.250+0000 7fd057400640 0 client.25916 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:01.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.250+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 shutdown_connections 2024-06-02T22:47:01.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.250+0000 7fd07f5be740 1 -- 172.21.15.31:0/598947906 wait complete. 2024-06-02T22:47:01.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.250+0000 7fd07f5be740 20 client.25916 trim_cache size 0 max 16384 2024-06-02T22:47:01.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:47:01.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:47:01.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:47:01.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.251+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 msgr2=0x7fd05c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:01.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.251+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 0x7fd05c0a5260 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55b1fe6f4e20 tx=0x7fd064004730 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.251+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 msgr2=0x7fd07419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.251+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd07002f870 tx=0x7fd070031eb0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 shutdown_connections 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fd05c0a2da0 0x7fd05c0a5260 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0741098c0 0x7fd0741a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd074075980 0x7fd07419e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 --2- 172.21.15.31:0/1228727847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0740743a0 0x7fd07419e1e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 >> 172.21.15.31:0/1228727847 conn(0x7fd0740fcfc0 msgr2=0x7fd074103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:01.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 shutdown_connections 2024-06-02T22:47:01.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:01.252+0000 7fd07c800640 1 -- 172.21.15.31:0/1228727847 wait complete. 2024-06-02T22:47:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:02 smithi178 ceph-mon[36614]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 517 op/s 2024-06-02T22:47:02.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:02 smithi031 ceph-mon[31767]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 517 op/s 2024-06-02T22:47:02.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:02 smithi098 ceph-mon[36750]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.5 MiB/s wr, 517 op/s 2024-06-02T22:47:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:04 smithi178 ceph-mon[36614]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.8 MiB/s wr, 558 op/s 2024-06-02T22:47:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:04 smithi031 ceph-mon[31767]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.8 MiB/s wr, 558 op/s 2024-06-02T22:47:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:04 smithi098 ceph-mon[36750]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.8 MiB/s wr, 558 op/s 2024-06-02T22:47:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 580.0 s, 580.6 tps, lat 169.425 ms stddev 214.358 2024-06-02T22:47:06.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:06 smithi178 ceph-mon[36614]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 512 op/s 2024-06-02T22:47:06.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:06 smithi031 ceph-mon[31767]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 512 op/s 2024-06-02T22:47:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:06 smithi098 ceph-mon[36750]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.3 MiB/s wr, 512 op/s 2024-06-02T22:47:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:08 smithi178 ceph-mon[36614]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-06-02T22:47:08.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:08 smithi031 ceph-mon[31767]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-06-02T22:47:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:08 smithi098 ceph-mon[36750]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.8 MiB/s wr, 564 op/s 2024-06-02T22:47:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 585.0 s, 557.4 tps, lat 184.310 ms stddev 207.942 2024-06-02T22:47:10.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:10 smithi178 ceph-mon[36614]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:47:10.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:10 smithi031 ceph-mon[31767]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:47:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:10 smithi098 ceph-mon[36750]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:47:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:12 smithi178 ceph-mon[36614]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-06-02T22:47:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:12 smithi031 ceph-mon[31767]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-06-02T22:47:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:12 smithi098 ceph-mon[36750]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-06-02T22:47:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.496+0000 7f7e4a200640 1 -- 172.21.15.31:0/2304751549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 msgr2=0x7f7e4410c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.496+0000 7f7e4a200640 1 --2- 172.21.15.31:0/2304751549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e4410c070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009ca0 tx=0x7f7e3c02a8c0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 -- 172.21.15.31:0/2304751549 shutdown_connections 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 --2- 172.21.15.31:0/2304751549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e4410c070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 --2- 172.21.15.31:0/2304751549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e441052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 --2- 172.21.15.31:0/2304751549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e44103c30 0x7f7e44104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 -- 172.21.15.31:0/2304751549 >> 172.21.15.31:0/2304751549 conn(0x7f7e440ff1c0 msgr2=0x7f7e441015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 -- 172.21.15.31:0/2304751549 shutdown_connections 2024-06-02T22:47:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.497+0000 7f7e4a200640 1 -- 172.21.15.31:0/2304751549 wait complete. 2024-06-02T22:47:14.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.499+0000 7f7e4a200640 1 Processor -- start 2024-06-02T22:47:14.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 -- start start 2024-06-02T22:47:14.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e44103c30 0x7f7e44199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f890 con 0x7f7e44103c30 2024-06-02T22:47:14.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410f710 con 0x7f7e44104e20 2024-06-02T22:47:14.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.502+0000 7f7e4a200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4410fa10 con 0x7f7e441057e0 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50152/0 (socket says 172.21.15.31:50152) 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 -- 172.21.15.31:0/1062641362 learned_addr learned my addr 172.21.15.31:0/1062641362 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55928/0 (socket says 172.21.15.31:55928) 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 -- 172.21.15.31:0/1062641362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 msgr2=0x7f7e4419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 -- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e44103c30 msgr2=0x7f7e44199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e44103c30 0x7f7e44199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e43e00640 1 -- 172.21.15.31:0/1062641362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e441a1a00 con 0x7f7e441057e0 2024-06-02T22:47:14.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.503+0000 7f7e42a00640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:47:14.504 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.504+0000 7f7e43e00640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0319f0 tx=0x7f7e3c02f450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.505 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.506+0000 7f7e3be00640 1 -- 172.21.15.31:0/1062641362 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c003b70 con 0x7f7e441057e0 2024-06-02T22:47:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.506+0000 7f7e3be00640 1 -- 172.21.15.31:0/1062641362 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c003d10 con 0x7f7e441057e0 2024-06-02T22:47:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.506+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e441a1c90 con 0x7f7e441057e0 2024-06-02T22:47:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.506+0000 7f7e3be00640 1 -- 172.21.15.31:0/1062641362 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c02fc50 con 0x7f7e441057e0 2024-06-02T22:47:14.506 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.506+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441a21d0 con 0x7f7e441057e0 2024-06-02T22:47:14.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.511+0000 7f7e4d17c740 1 Processor -- start 2024-06-02T22:47:14.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.512+0000 7f7e3be00640 1 -- 172.21.15.31:0/1062641362 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f7e3c004040 con 0x7f7e441057e0 2024-06-02T22:47:14.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.512+0000 7f7e4d17c740 1 -- start start 2024-06-02T22:47:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d337fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337fd730 0x561d337ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561d3375b420 con 0x561d337f85c0 2024-06-02T22:47:14.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d33702c50 con 0x561d337fd730 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d337573e0 con 0x561d337f7bd0 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50154/0 (socket says 172.21.15.31:50154) 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.514+0000 7f7e42a00640 1 -- 172.21.15.31:0/259698737 learned_addr learned my addr 172.21.15.31:0/259698737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.515+0000 7f7e42a00640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337fd730 0x561d337ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.515+0000 7f7e43400640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d337fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e42a00640 1 -- 172.21.15.31:0/259698737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337fd730 msgr2=0x561d337ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e42a00640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337fd730 0x561d337ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e42a00640 1 -- 172.21.15.31:0/259698737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 msgr2=0x561d337fd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e42a00640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d337fd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e42a00640 1 -- 172.21.15.31:0/259698737 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3346f210 con 0x561d337f7bd0 2024-06-02T22:47:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e43400640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d337fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:47:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e3be00640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 0x7f7e280a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.516+0000 7f7e3be00640 1 -- 172.21.15.31:0/1062641362 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7e3c0f0a30 con 0x7f7e441057e0 2024-06-02T22:47:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.517+0000 7f7e43400640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 0x7f7e280a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.518+0000 7f7e42a00640 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e30011be0 tx=0x7f7e30009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc098083378ba7d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.519+0000 7f7e2fe00640 1 -- 172.21.15.31:0/259698737 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000fc50 con 0x561d337f7bd0 2024-06-02T22:47:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.519+0000 7f7e2fe00640 1 -- 172.21.15.31:0/259698737 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3000fdf0 con 0x561d337f7bd0 2024-06-02T22:47:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.519+0000 7f7e2fe00640 1 -- 172.21.15.31:0/259698737 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000e6a0 con 0x561d337f7bd0 2024-06-02T22:47:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.520+0000 7f7e4d17c740 1 -- 172.21.15.31:0/259698737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 msgr2=0x561d337f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.520+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e30011be0 tx=0x7f7e30009ba0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.520+0000 7f7e43400640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 0x7f7e280a51c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x561d337f89c0 tx=0x7f7e34005f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 -- 172.21.15.31:0/259698737 shutdown_connections 2024-06-02T22:47:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337fd730 0x561d337ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d337fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/259698737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f7bd0 0x561d337f7ff0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 -- 172.21.15.31:0/259698737 >> 172.21.15.31:0/259698737 conn(0x561d337bff80 msgr2=0x561d337f3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 -- 172.21.15.31:0/259698737 shutdown_connections 2024-06-02T22:47:14.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.522+0000 7f7e4d17c740 1 -- 172.21.15.31:0/259698737 wait complete. 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.523+0000 7f7e4d17c740 1 -- start start 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.523+0000 7f7e4d17c740 1 Processor -- start 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f7bd0 0x561d33801060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d338085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561d338006e0 con 0x561d337f7bd0 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561d337160b0 con 0x561d337f85c0 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d33800860 con 0x561d337fd730 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e4d17c740 10 client.0 _ll_register_callbacks cb 0x561d33701f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55956/0 (socket says 172.21.15.31:55956) 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 -- 172.21.15.31:0/2338444076 learned_addr learned my addr 172.21.15.31:0/2338444076 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:14.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e43e00640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d338085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 -- 172.21.15.31:0/2338444076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 msgr2=0x561d338085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d338085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 -- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f7bd0 msgr2=0x561d33801060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f7bd0 0x561d33801060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.524+0000 7f7e42a00640 1 -- 172.21.15.31:0/2338444076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3353b620 con 0x561d337f85c0 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.526+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7e300053e0 tx=0x7f7e30005410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22fda07be6a8667 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.526+0000 7f7e2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.526+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30025050 con 0x561d337f85c0 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.526+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7e30005630 con 0x561d337f85c0 2024-06-02T22:47:14.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.527+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e3000fdf0 con 0x561d337f85c0 2024-06-02T22:47:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.527+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e3000fc20 con 0x561d337f85c0 2024-06-02T22:47:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.528+0000 7f7e4d17c740 10 client.25928 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.528+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d3381d910 con 0x561d337f85c0 2024-06-02T22:47:14.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.529+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3000fdf0 con 0x561d337f85c0 2024-06-02T22:47:14.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7e3001d020 con 0x561d337f85c0 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 10 client.25928 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 10 client.25928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 20 client.25928 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3381ecc0 0x561d338210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 4 client.25928 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.530+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d33768b50 con 0x561d3381ecc0 2024-06-02T22:47:14.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.531+0000 7f7e43400640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3381ecc0 0x561d338210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.532+0000 7f7e43400640 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3381ecc0 0x561d338210b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c645c16f05e73 server_cookie=2461fb5727f0d4c4 in_seq=0 out_seq=0 2024-06-02T22:47:14.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.532+0000 7f7e2cc00640 10 client.25928 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.535+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2338444076 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561d33768b50 con 0x561d3381ecc0 2024-06-02T22:47:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.535+0000 7f7e2cc00640 10 client.25928 handle_command_reply: tid=0 2024-06-02T22:47:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.535+0000 7f7e4d17c740 1 client.25928 shutdown 2024-06-02T22:47:14.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.535+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 msgr2=0x561d338015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.535+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7e300053e0 tx=0x7f7e30005410 comp rx=0 tx=0).stop 2024-06-02T22:47:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 shutdown_connections 2024-06-02T22:47:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3381ecc0 0x561d338210b0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d338085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f85c0 0x561d338015a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2338444076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f7bd0 0x561d33801060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 >> 172.21.15.31:0/2338444076 conn(0x561d337bff80 msgr2=0x561d337f2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e2cc00640 0 client.25928 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 shutdown_connections 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2338444076 wait complete. 2024-06-02T22:47:14.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.536+0000 7f7e4d17c740 20 client.25928 trim_cache size 0 max 16384 2024-06-02T22:47:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:14 smithi178 ceph-mon[36614]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.583+0000 7f7e4d17c740 1 Processor -- start 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.583+0000 7f7e4d17c740 1 -- start start 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d338085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d337f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a8420 con 0x561d337f85c0 2024-06-02T22:47:14.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a9f60 con 0x561d337f7bd0 2024-06-02T22:47:14.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a8af0 con 0x561d337fd730 2024-06-02T22:47:14.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e43400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d338085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e43400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55960/0 (socket says 172.21.15.31:55960) 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.584+0000 7f7e43400640 1 -- 172.21.15.31:0/1986408526 learned_addr learned my addr 172.21.15.31:0/1986408526 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 -- 172.21.15.31:0/1986408526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 msgr2=0x561d337f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d337f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 -- 172.21.15.31:0/1986408526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 msgr2=0x561d338085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d338085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 -- 172.21.15.31:0/1986408526 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d337f8e20 con 0x561d337f7bd0 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e42a00640 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d338085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:47:14.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.585+0000 7f7e43400640 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e44104c80 tx=0x7f7e34014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dac7a553677386f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.586+0000 7f7e2f400640 1 -- 172.21.15.31:0/1986408526 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004020 con 0x561d337f7bd0 2024-06-02T22:47:14.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.586+0000 7f7e2f400640 1 -- 172.21.15.31:0/1986408526 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561d33768b50 con 0x561d337f7bd0 2024-06-02T22:47:14.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.587+0000 7f7e2f400640 1 -- 172.21.15.31:0/1986408526 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3401d420 con 0x561d337f7bd0 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 -- 172.21.15.31:0/1986408526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 msgr2=0x561d337f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7e44104c80 tx=0x7f7e34014000 comp rx=0 tx=0).stop 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 -- 172.21.15.31:0/1986408526 shutdown_connections 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337fd730 0x561d337f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337f85c0 0x561d338085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/1986408526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d337f6510 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 -- 172.21.15.31:0/1986408526 >> 172.21.15.31:0/1986408526 conn(0x561d337bff80 msgr2=0x561d337f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 -- 172.21.15.31:0/1986408526 shutdown_connections 2024-06-02T22:47:14.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.588+0000 7f7e4d17c740 1 -- 172.21.15.31:0/1986408526 wait complete. 2024-06-02T22:47:14.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.589+0000 7f7e4d17c740 1 -- start start 2024-06-02T22:47:14.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 Processor -- start 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d338054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337fd730 0x561d33887980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a9890 con 0x561d337fd730 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a91c0 con 0x561d337f7bd0 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.590+0000 7f7e4d17c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441a6400 con 0x561d337f85c0 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.591+0000 7f7e4d17c740 10 client.0 _ll_register_callbacks cb 0x7f7e300116b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:14.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e43400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d338054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e43400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d338054d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:55974/0 (socket says 172.21.15.31:55974) 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50176/0 (socket says 172.21.15.31:50176) 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 -- 172.21.15.31:0/2072560543 learned_addr learned my addr 172.21.15.31:0/2072560543 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 -- 172.21.15.31:0/2072560543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 msgr2=0x561d338054d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d338054d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 -- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337fd730 msgr2=0x561d33887980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337fd730 0x561d33887980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.592+0000 7f7e42a00640 1 -- 172.21.15.31:0/2072560543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d33898f00 con 0x561d337f85c0 2024-06-02T22:47:14.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.593+0000 7f7e42a00640 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561d337f44d0 tx=0x7f7e3001f6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b6525584d5a89d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.594+0000 7f7e2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:47:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.594+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30005740 con 0x561d337f85c0 2024-06-02T22:47:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.595+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7e30011030 con 0x561d337f85c0 2024-06-02T22:47:14.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.595+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d33768b50 con 0x561d337f85c0 2024-06-02T22:47:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.595+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7e30041050 con 0x561d337f85c0 2024-06-02T22:47:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.595+0000 7f7e4d17c740 10 client.25909 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.595+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561d3389a1f0 con 0x561d337f85c0 2024-06-02T22:47:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.596+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x561d33768b50 con 0x561d337f85c0 2024-06-02T22:47:14.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.596+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7e3001d040 con 0x561d337f85c0 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 10 client.25909 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 20 client.25909 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3389ab20 0x561d3389cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 4 client.25909 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:47:14.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d33762ea0 con 0x561d3389ab20 2024-06-02T22:47:14.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.597+0000 7f7e43400640 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3389ab20 0x561d3389cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.599+0000 7f7e43400640 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3389ab20 0x561d3389cf40 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc6641e409810b4 server_cookie=7352df4d3e3af371 in_seq=0 out_seq=0 2024-06-02T22:47:14.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.599+0000 7f7e2cc00640 10 client.25909 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:14 smithi031 ceph-mon[31767]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-06-02T22:47:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:14 smithi098 ceph-mon[36750]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-06-02T22:47:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.839+0000 7f7e2cc00640 1 -- 172.21.15.31:0/2072560543 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561d33762ea0 con 0x561d3389ab20 2024-06-02T22:47:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.839+0000 7f7e2cc00640 10 client.25909 handle_command_reply: tid=0 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.839+0000 7f7e4d17c740 1 client.25909 shutdown 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 msgr2=0x561d33805a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561d337f44d0 tx=0x7f7e3001f6f0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 shutdown_connections 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561d3389ab20 0x561d3389cf40 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561d337fd730 0x561d33887980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d337f85c0 0x561d33805a10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 --2- 172.21.15.31:0/2072560543 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561d337f7bd0 0x561d338054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e2cc00640 0 client.25909 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 >> 172.21.15.31:0/2072560543 conn(0x561d337bff80 msgr2=0x561d337f6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 shutdown_connections 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 1 -- 172.21.15.31:0/2072560543 wait complete. 2024-06-02T22:47:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.840+0000 7f7e4d17c740 20 client.25909 trim_cache size 0 max 16384 2024-06-02T22:47:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:47:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:47:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 msgr2=0x7f7e280a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 0x7f7e280a51c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x561d337f89c0 tx=0x7f7e34005f10 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 msgr2=0x7f7e441a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0319f0 tx=0x7f7e3c02f450 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 shutdown_connections 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f7e280a2d00 0x7f7e280a51c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e441057e0 0x7f7e441a1390 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e44104e20 0x7f7e4419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 --2- 172.21.15.31:0/1062641362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e44103c30 0x7f7e44199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 >> 172.21.15.31:0/1062641362 conn(0x7f7e440ff1c0 msgr2=0x7f7e441080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 shutdown_connections 2024-06-02T22:47:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:14.841+0000 7f7e4a200640 1 -- 172.21.15.31:0/1062641362 wait complete. 2024-06-02T22:47:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 590.0 s, 482.0 tps, lat 198.644 ms stddev 269.543 2024-06-02T22:47:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:16 smithi178 ceph-mon[36614]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 541 op/s 2024-06-02T22:47:16.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:16 smithi031 ceph-mon[31767]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 541 op/s 2024-06-02T22:47:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:16 smithi098 ceph-mon[36750]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.9 MiB/s wr, 541 op/s 2024-06-02T22:47:18.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:18 smithi178 ceph-mon[36614]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 591 op/s 2024-06-02T22:47:18.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:18 smithi031 ceph-mon[31767]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 591 op/s 2024-06-02T22:47:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:18 smithi098 ceph-mon[36750]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 591 op/s 2024-06-02T22:47:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 595.0 s, 528.6 tps, lat 196.293 ms stddev 222.031 2024-06-02T22:47:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:20 smithi178 ceph-mon[36614]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 558 op/s 2024-06-02T22:47:20.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:20 smithi031 ceph-mon[31767]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 558 op/s 2024-06-02T22:47:20.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:20 smithi098 ceph-mon[36750]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 558 op/s 2024-06-02T22:47:21.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:21 smithi031 ceph-mon[31767]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-06-02T22:47:21.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:21 smithi098 ceph-mon[36750]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-06-02T22:47:21.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:21 smithi178 ceph-mon[36614]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.2 MiB/s wr, 574 op/s 2024-06-02T22:47:24.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:23 smithi178 ceph-mon[36614]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 620 op/s 2024-06-02T22:47:24.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:23 smithi031 ceph-mon[31767]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 620 op/s 2024-06-02T22:47:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:23 smithi098 ceph-mon[36750]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 620 op/s 2024-06-02T22:47:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 600.0 s, 575.4 tps, lat 173.812 ms stddev 213.119 2024-06-02T22:47:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:25 smithi178 ceph-mon[36614]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 582 op/s 2024-06-02T22:47:26.123 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:25 smithi031 ceph-mon[31767]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 582 op/s 2024-06-02T22:47:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:25 smithi098 ceph-mon[36750]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 582 op/s 2024-06-02T22:47:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:27 smithi178 ceph-mon[36614]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 624 op/s 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 -- 172.21.15.31:0/3152307620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7304075980 msgr2=0x7f7304073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 --2- 172.21.15.31:0/3152307620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7304075980 0x7f7304073dd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009900 tx=0x7f72f402a480 comp rx=0 tx=0).stop 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 -- 172.21.15.31:0/3152307620 shutdown_connections 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 --2- 172.21.15.31:0/3152307620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 0x7f730410bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 --2- 172.21.15.31:0/3152307620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73040743a0 0x7f7304074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 --2- 172.21.15.31:0/3152307620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7304075980 0x7f7304073dd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 -- 172.21.15.31:0/3152307620 >> 172.21.15.31:0/3152307620 conn(0x7f73040fcf70 msgr2=0x7f73040ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 -- 172.21.15.31:0/3152307620 shutdown_connections 2024-06-02T22:47:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.068+0000 7f7308a00640 1 -- 172.21.15.31:0/3152307620 wait complete. 2024-06-02T22:47:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 Processor -- start 2024-06-02T22:47:28.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 -- start start 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 0x7f7304199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 0x7f730419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 0x7f73041a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f730410f8a0 con 0x7f7304109890 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f730410f720 con 0x7f73040743a0 2024-06-02T22:47:28.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.070+0000 7f7308a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f730410fa20 con 0x7f7304075980 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 0x7f7304199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 0x7f730419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 0x7f7304199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47680/0 (socket says 172.21.15.31:47680) 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301e00640 1 -- 172.21.15.31:0/621661863 learned_addr learned my addr 172.21.15.31:0/621661863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7302800640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 0x7f73041a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 -- 172.21.15.31:0/621661863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 msgr2=0x7f7304199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 0x7f7304199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 -- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 msgr2=0x7f73041a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 0x7f73041a13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.071+0000 7f7301400640 1 -- 172.21.15.31:0/621661863 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73041a1a40 con 0x7f7304075980 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f7301400640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 0x7f730419a360 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f72f000e9f0 tx=0x7f72f000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f72faa00640 1 -- 172.21.15.31:0/621661863 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f000ccc0 con 0x7f7304075980 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f72faa00640 1 -- 172.21.15.31:0/621661863 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f0010910 con 0x7f7304075980 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f72faa00640 1 -- 172.21.15.31:0/621661863 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0018960 con 0x7f7304075980 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73041a1d30 con 0x7f7304075980 2024-06-02T22:47:28.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.072+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73041a21d0 con 0x7f7304075980 2024-06-02T22:47:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.082+0000 7f72faa00640 1 -- 172.21.15.31:0/621661863 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f72f0010ac0 con 0x7f7304075980 2024-06-02T22:47:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.083+0000 7f730b7f9740 1 Processor -- start 2024-06-02T22:47:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.083+0000 7f730b7f9740 1 -- start start 2024-06-02T22:47:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.083+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb3908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb3933d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f730b7f9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634bb2e6420 con 0x5634bb38bdd0 2024-06-02T22:47:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f730b7f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5634bb28dc50 con 0x5634bb390f40 2024-06-02T22:47:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f730b7f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634bb2e23e0 con 0x5634bb38b3e0 2024-06-02T22:47:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f7302800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f7302800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:34772/0 (socket says 172.21.15.31:34772) 2024-06-02T22:47:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f7302800640 1 -- 172.21.15.31:0/1605764972 learned_addr learned my addr 172.21.15.31:0/1605764972 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f7301400640 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb3933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.084+0000 7f7302800640 1 -- 172.21.15.31:0/1605764972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 msgr2=0x5634bb3933d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7302800640 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb3933d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7302800640 1 -- 172.21.15.31:0/1605764972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 msgr2=0x5634bb3908d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7302800640 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb3908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7302800640 1 -- 172.21.15.31:0/1605764972 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634baffa210 con 0x5634bb38b3e0 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7302800640 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009df0 tx=0x7f72fc00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346d56fb1b1e4ea1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f7301400640 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb3933d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f72ef000640 1 -- 172.21.15.31:0/1605764972 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc003970 con 0x5634bb38b3e0 2024-06-02T22:47:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.085+0000 7f72ef000640 1 -- 172.21.15.31:0/1605764972 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72fc004030 con 0x5634bb38b3e0 2024-06-02T22:47:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.086+0000 7f72faa00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 0x7f72e80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.086+0000 7f72ef000640 1 -- 172.21.15.31:0/1605764972 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc011980 con 0x5634bb38b3e0 2024-06-02T22:47:28.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.086+0000 7f72faa00640 1 -- 172.21.15.31:0/621661863 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f72f00cf7f0 con 0x7f7304075980 2024-06-02T22:47:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.086+0000 7f7301e00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 0x7f72e80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.087+0000 7f730b7f9740 1 -- 172.21.15.31:0/1605764972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 msgr2=0x5634bb38b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.087+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009df0 tx=0x7f72fc00f730 comp rx=0 tx=0).stop 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f730b7f9740 1 -- 172.21.15.31:0/1605764972 shutdown_connections 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb3933d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb3908d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1605764972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb38b800 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f730b7f9740 1 -- 172.21.15.31:0/1605764972 >> 172.21.15.31:0/1605764972 conn(0x5634bb34af80 msgr2=0x5634bb386e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.088+0000 7f7301e00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 0x7f72e80a50f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5634bb38c840 tx=0x7f72f4005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.089+0000 7f730b7f9740 1 -- 172.21.15.31:0/1605764972 shutdown_connections 2024-06-02T22:47:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.091+0000 7f730b7f9740 1 -- 172.21.15.31:0/1605764972 wait complete. 2024-06-02T22:47:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.092+0000 7f730b7f9740 1 -- start start 2024-06-02T22:47:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.092+0000 7f730b7f9740 1 Processor -- start 2024-06-02T22:47:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb395780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb395cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5634bb393f90 con 0x5634bb38bdd0 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5634bb2a10b0 con 0x5634bb390f40 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634bb394110 con 0x5634bb38b3e0 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f7302800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f7302800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47698/0 (socket says 172.21.15.31:47698) 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f7302800640 1 -- 172.21.15.31:0/3010413604 learned_addr learned my addr 172.21.15.31:0/3010413604 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f730b7f9740 10 client.0 _ll_register_callbacks cb 0x5634bb28cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.093+0000 7f7301e00640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb395780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7302800640 1 -- 172.21.15.31:0/3010413604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 msgr2=0x5634bb395780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7302800640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb395780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7302800640 1 -- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 msgr2=0x5634bb395cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7301400640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb395cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7302800640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb395cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.094+0000 7f7302800640 1 -- 172.21.15.31:0/3010413604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bb0c6620 con 0x5634bb390f40 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f7302800640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8afee7e89e90a69 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f72e3400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc029060 con 0x5634bb390f40 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72fc004030 con 0x5634bb390f40 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f72fc0041e0 con 0x5634bb390f40 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.095+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f72fc030050 con 0x5634bb390f40 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 10 client.25943 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5634bb39ffc0 con 0x5634bb390f40 2024-06-02T22:47:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72fc004030 con 0x5634bb390f40 2024-06-02T22:47:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f72fc011c00 con 0x5634bb390f40 2024-06-02T22:47:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 10 client.25943 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 20 client.25943 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb3a1370 0x5634bb3a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 4 client.25943 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.096+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634bb2f3b50 con 0x5634bb3a1370 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.097+0000 7f7301e00640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb3a1370 0x5634bb3a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.098+0000 7f7301e00640 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb3a1370 0x5634bb3a3760 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc594d1ca44dcf2 server_cookie=689cae7f6a9762e8 in_seq=0 out_seq=0 2024-06-02T22:47:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.098+0000 7f72e3400640 10 client.25943 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f72e3400640 1 -- 172.21.15.31:0/3010413604 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5634bb2f3b50 con 0x5634bb3a1370 2024-06-02T22:47:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f72e3400640 10 client.25943 handle_command_reply: tid=0 2024-06-02T22:47:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 client.25943 shutdown 2024-06-02T22:47:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 msgr2=0x5634bb39cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72fc006010 tx=0x7f72fc004c70 comp rx=0 tx=0).stop 2024-06-02T22:47:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 shutdown_connections 2024-06-02T22:47:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb3a1370 0x5634bb3a3760 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39cd00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb395cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3010413604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb395780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.099+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 >> 172.21.15.31:0/3010413604 conn(0x5634bb34af80 msgr2=0x5634bb37d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.100+0000 7f72e3400640 0 client.25943 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.100+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 shutdown_connections 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.100+0000 7f730b7f9740 1 -- 172.21.15.31:0/3010413604 wait complete. 2024-06-02T22:47:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.100+0000 7f730b7f9740 20 client.25943 trim_cache size 0 max 16384 2024-06-02T22:47:28.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:27 smithi031 ceph-mon[31767]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 624 op/s 2024-06-02T22:47:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.134+0000 7f730b7f9740 1 Processor -- start 2024-06-02T22:47:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.135+0000 7f730b7f9740 1 -- start start 2024-06-02T22:47:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.135+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 0x5634bb386ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.135+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 0x5634bb39ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.135+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 0x5634bb389da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7301400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 0x5634bb39ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7301400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 0x5634bb39ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47704/0 (socket says 172.21.15.31:47704) 2024-06-02T22:47:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f730b7f9740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a8450 con 0x5634bb38b3e0 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f730b7f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a9f90 con 0x5634bb38bdd0 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f730b7f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a8b20 con 0x5634bb390f40 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7302800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 0x5634bb389da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7302800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 0x5634bb389da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:34788/0 (socket says 172.21.15.31:34788) 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7302800640 1 -- 172.21.15.31:0/3606742871 learned_addr learned my addr 172.21.15.31:0/3606742871 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.136+0000 7f7301e00640 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 0x5634bb386ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.137+0000 7f7301e00640 1 -- 172.21.15.31:0/3606742871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 msgr2=0x5634bb389da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.137+0000 7f7301e00640 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 0x5634bb389da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.137+0000 7f7301e00640 1 -- 172.21.15.31:0/3606742871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 msgr2=0x5634bb39ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.137+0000 7f7301e00640 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 0x5634bb39ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.137+0000 7f7301e00640 1 -- 172.21.15.31:0/3606742871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634bb387b10 con 0x5634bb38b3e0 2024-06-02T22:47:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.138+0000 7f7301e00640 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 0x5634bb386ff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f72f4006010 tx=0x7f72f4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfb71908bcd2b3e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.142+0000 7f72ee600640 1 -- 172.21.15.31:0/3606742871 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4057070 con 0x5634bb38b3e0 2024-06-02T22:47:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.142+0000 7f72ee600640 1 -- 172.21.15.31:0/3606742871 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f4031c80 con 0x5634bb38b3e0 2024-06-02T22:47:28.141 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.142+0000 7f72ee600640 1 -- 172.21.15.31:0/3606742871 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4035040 con 0x5634bb38b3e0 2024-06-02T22:47:28.142 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 -- 172.21.15.31:0/3606742871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 msgr2=0x5634bb386ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.142 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 0x5634bb386ff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f72f4006010 tx=0x7f72f4040000 comp rx=0 tx=0).stop 2024-06-02T22:47:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 -- 172.21.15.31:0/3606742871 shutdown_connections 2024-06-02T22:47:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb390f40 0x5634bb389da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb38bdd0 0x5634bb39ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 --2- 172.21.15.31:0/3606742871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38b3e0 0x5634bb386ff0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.143+0000 7f730b7f9740 1 -- 172.21.15.31:0/3606742871 >> 172.21.15.31:0/3606742871 conn(0x5634bb34af80 msgr2=0x5634bb3868e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.144+0000 7f730b7f9740 1 -- 172.21.15.31:0/3606742871 shutdown_connections 2024-06-02T22:47:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.145+0000 7f730b7f9740 1 -- 172.21.15.31:0/3606742871 wait complete. 2024-06-02T22:47:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.145+0000 7f730b7f9740 1 -- start start 2024-06-02T22:47:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.146+0000 7f730b7f9740 1 Processor -- start 2024-06-02T22:47:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.147+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb39a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.147+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb39a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.147+0000 7f730b7f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f7302800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f7302800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:47710/0 (socket says 172.21.15.31:47710) 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f7302800640 1 -- 172.21.15.31:0/1728586095 learned_addr learned my addr 172.21.15.31:0/1728586095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a98c0 con 0x5634bb38bdd0 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a91f0 con 0x5634bb390f40 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.148+0000 7f7301e00640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb39a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a6430 con 0x5634bb38b3e0 2024-06-02T22:47:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f7301400640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb39a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f730b7f9740 10 client.0 _ll_register_callbacks cb 0x7f72fc009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f7302800640 1 -- 172.21.15.31:0/1728586095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 msgr2=0x5634bb39a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f7302800640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb39a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.149+0000 7f7302800640 1 -- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 msgr2=0x5634bb39a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.150+0000 7f7302800640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb39a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.150+0000 7f7302800640 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634bb39be40 con 0x5634bb390f40 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.151+0000 7f7302800640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72fc005200 tx=0x7f72fc00ff10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=754083a968078c03 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.151+0000 7f72e3400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.151+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc029050 con 0x5634bb390f40 2024-06-02T22:47:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.151+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f72fc021040 con 0x5634bb390f40 2024-06-02T22:47:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.151+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f4031c80 con 0x5634bb390f40 2024-06-02T22:47:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.152+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f72fc005490 con 0x5634bb390f40 2024-06-02T22:47:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.152+0000 7f730b7f9740 10 client.25949 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.152+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5634bb40bfb0 con 0x5634bb390f40 2024-06-02T22:47:28.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72fc0045f0 con 0x5634bb390f40 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f72fc004010 con 0x5634bb390f40 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 10 client.25949 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 10 client.25949 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 20 client.25949 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb40c810 0x5634bb40ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 4 client.25949 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f72f4031c80 con 0x5634bb40c810 2024-06-02T22:47:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.153+0000 7f7301e00640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb40c810 0x5634bb40ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.156+0000 7f7301e00640 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb40c810 0x5634bb40ec30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76d3563c7e61230 server_cookie=8e4590f6bce6a in_seq=0 out_seq=0 2024-06-02T22:47:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.156+0000 7f72e3400640 10 client.25949 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:27 smithi098 ceph-mon[36750]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 624 op/s 2024-06-02T22:47:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.331+0000 7f72e3400640 1 -- 172.21.15.31:0/1728586095 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f72f4031c80 con 0x5634bb40c810 2024-06-02T22:47:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.332+0000 7f72e3400640 10 client.25949 handle_command_reply: tid=0 2024-06-02T22:47:28.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.332+0000 7f730b7f9740 1 client.25949 shutdown 2024-06-02T22:47:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.332+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 msgr2=0x5634bb39b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.332+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72fc005200 tx=0x7f72fc00ff10 comp rx=0 tx=0).stop 2024-06-02T22:47:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 shutdown_connections 2024-06-02T22:47:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5634bb40c810 0x5634bb40ec30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5634bb390f40 0x5634bb39b850 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f72e3400640 0 client.25949 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5634bb38bdd0 0x5634bb39a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 --2- 172.21.15.31:0/1728586095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634bb38b3e0 0x5634bb39a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 >> 172.21.15.31:0/1728586095 conn(0x5634bb34af80 msgr2=0x5634bb389da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 shutdown_connections 2024-06-02T22:47:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.333+0000 7f730b7f9740 1 -- 172.21.15.31:0/1728586095 wait complete. 2024-06-02T22:47:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.334+0000 7f730b7f9740 20 client.25949 trim_cache size 0 max 16384 2024-06-02T22:47:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:47:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:47:28.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 msgr2=0x7f72e80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 0x7f72e80a50f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5634bb38c840 tx=0x7f72f4005e50 comp rx=0 tx=0).stop 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 msgr2=0x7f730419a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 0x7f730419a360 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f72f000e9f0 tx=0x7f72f000eeb0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 shutdown_connections 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f72e80a2c30 0x7f72e80a50f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.335+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7304109890 0x7f73041a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.336+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7304075980 0x7f730419a360 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.336+0000 7f7308a00640 1 --2- 172.21.15.31:0/621661863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73040743a0 0x7f7304199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.336+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 >> 172.21.15.31:0/621661863 conn(0x7f73040fcf70 msgr2=0x7f7304105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.336+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 shutdown_connections 2024-06-02T22:47:28.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:28.336+0000 7f7308a00640 1 -- 172.21.15.31:0/621661863 wait complete. 2024-06-02T22:47:30.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:29 smithi178 ceph-mon[36614]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 546 op/s 2024-06-02T22:47:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:29 smithi031 ceph-mon[31767]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 546 op/s 2024-06-02T22:47:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:29 smithi098 ceph-mon[36750]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 546 op/s 2024-06-02T22:47:30.224 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 605.0 s, 507.0 tps, lat 192.744 ms stddev 228.155 2024-06-02T22:47:32.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:31 smithi178 ceph-mon[36614]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 473 op/s 2024-06-02T22:47:32.124 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:31 smithi031 ceph-mon[31767]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 473 op/s 2024-06-02T22:47:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:31 smithi098 ceph-mon[36750]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 473 op/s 2024-06-02T22:47:34.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:33 smithi178 ceph-mon[36614]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-06-02T22:47:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:33 smithi031 ceph-mon[31767]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-06-02T22:47:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:33 smithi098 ceph-mon[36750]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.6 MiB/s wr, 528 op/s 2024-06-02T22:47:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 610.0 s, 541.8 tps, lat 189.564 ms stddev 240.835 2024-06-02T22:47:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:35 smithi031 ceph-mon[31767]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.3 MiB/s wr, 485 op/s 2024-06-02T22:47:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:35 smithi098 ceph-mon[36750]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.3 MiB/s wr, 485 op/s 2024-06-02T22:47:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:35 smithi178 ceph-mon[36614]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.3 MiB/s wr, 485 op/s 2024-06-02T22:47:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:37 smithi031 ceph-mon[31767]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-06-02T22:47:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:37 smithi098 ceph-mon[36750]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-06-02T22:47:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:37 smithi178 ceph-mon[36614]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-06-02T22:47:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:39 smithi031 ceph-mon[31767]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 487 op/s 2024-06-02T22:47:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:39 smithi098 ceph-mon[36750]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 487 op/s 2024-06-02T22:47:40.225 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 615.0 s, 596.8 tps, lat 165.529 ms stddev 210.515 2024-06-02T22:47:40.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:39 smithi178 ceph-mon[36614]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 487 op/s 2024-06-02T22:47:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.566+0000 7fb954c00640 1 -- 172.21.15.31:0/634702642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb950109890 msgr2=0x7fb95010bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.567 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.566+0000 7fb954c00640 1 --2- 172.21.15.31:0/634702642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb950109890 0x7fb95010bd30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb948009be0 tx=0x7fb94802a750 comp rx=0 tx=0).stop 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 -- 172.21.15.31:0/634702642 shutdown_connections 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 --2- 172.21.15.31:0/634702642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb950109890 0x7fb95010bd30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 --2- 172.21.15.31:0/634702642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9500743a0 0x7fb950074800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 --2- 172.21.15.31:0/634702642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 0x7fb950073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 -- 172.21.15.31:0/634702642 >> 172.21.15.31:0/634702642 conn(0x7fb9500fcf90 msgr2=0x7fb9500ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.569 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 -- 172.21.15.31:0/634702642 shutdown_connections 2024-06-02T22:47:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.569+0000 7fb954c00640 1 -- 172.21.15.31:0/634702642 wait complete. 2024-06-02T22:47:41.570 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.570+0000 7fb954c00640 1 Processor -- start 2024-06-02T22:47:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.570+0000 7fb954c00640 1 -- start start 2024-06-02T22:47:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb954c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb954c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 0x7fb950073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.571 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb954c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 0x7fb950071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb94de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb94de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50792/0 (socket says 172.21.15.31:50792) 2024-06-02T22:47:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb94de00640 1 -- 172.21.15.31:0/4283779531 learned_addr learned my addr 172.21.15.31:0/4283779531 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:41.572 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.571+0000 7fb94d400640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 0x7fb950073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.572+0000 7fb94e800640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 0x7fb950071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.572+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb95006be10 con 0x7fb950075980 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.572+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb95006bc90 con 0x7fb950109890 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.572+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb95006bf90 con 0x7fb9500743a0 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 -- 172.21.15.31:0/4283779531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 msgr2=0x7fb950071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.573 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 0x7fb950071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 -- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 msgr2=0x7fb950073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 0x7fb950073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950071ca0 con 0x7fb9500743a0 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94e800640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 0x7fb950071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb94de00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c890 tx=0x7fb94000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.573+0000 7fb946a00640 1 -- 172.21.15.31:0/4283779531 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940004220 con 0x7fb9500743a0 2024-06-02T22:47:41.574 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.574+0000 7fb946a00640 1 -- 172.21.15.31:0/4283779531 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9400043c0 con 0x7fb9500743a0 2024-06-02T22:47:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.574+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb950071f90 con 0x7fb9500743a0 2024-06-02T22:47:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.574+0000 7fb946a00640 1 -- 172.21.15.31:0/4283779531 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb940004a00 con 0x7fb9500743a0 2024-06-02T22:47:41.575 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.574+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9501aab60 con 0x7fb9500743a0 2024-06-02T22:47:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.580+0000 7fb957a0d740 1 Processor -- start 2024-06-02T22:47:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 -- start start 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c62800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee25bbd420 con 0x55ee25c623e0 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ee25b64c50 con 0x55ee25c62dd0 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.581+0000 7fb957a0d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ee25bb93e0 con 0x55ee25c67f40 2024-06-02T22:47:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.582+0000 7fb946a00640 1 -- 172.21.15.31:0/4283779531 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fb9400079b0 con 0x7fb9500743a0 2024-06-02T22:47:41.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.584+0000 7fb946a00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 0x7fb9340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb946a00640 1 -- 172.21.15.31:0/4283779531 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fb9400cf0e0 con 0x7fb9500743a0 2024-06-02T22:47:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50798/0 (socket says 172.21.15.31:50798) 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 -- 172.21.15.31:0/1887696266 learned_addr learned my addr 172.21.15.31:0/1887696266 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94e800640 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c62800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 -- 172.21.15.31:0/1887696266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 msgr2=0x55ee25c678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 -- 172.21.15.31:0/1887696266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 msgr2=0x55ee25c62800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c62800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.585+0000 7fb94d400640 1 -- 172.21.15.31:0/1887696266 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee258d1210 con 0x55ee25c67f40 2024-06-02T22:47:41.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.586+0000 7fb94d400640 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009cf0 tx=0x7fb93c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41db44d8bd9dfa3b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.586+0000 7fb94e800640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 0x7fb9340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.590+0000 7fb94e800640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 0x7fb9340a51c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb948006010 tx=0x7fb948009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.591+0000 7fb93b000640 1 -- 172.21.15.31:0/1887696266 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012450 con 0x55ee25c67f40 2024-06-02T22:47:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.591+0000 7fb93b000640 1 -- 172.21.15.31:0/1887696266 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb93c012ad0 con 0x55ee25c67f40 2024-06-02T22:47:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.591+0000 7fb93b000640 1 -- 172.21.15.31:0/1887696266 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c00fc60 con 0x55ee25c67f40 2024-06-02T22:47:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.592+0000 7fb957a0d740 1 -- 172.21.15.31:0/1887696266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 msgr2=0x55ee25c6a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.592+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009cf0 tx=0x7fb93c0117b0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 -- 172.21.15.31:0/1887696266 shutdown_connections 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c6a3d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1887696266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c62800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 -- 172.21.15.31:0/1887696266 >> 172.21.15.31:0/1887696266 conn(0x55ee25c21f80 msgr2=0x55ee25c5de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 -- 172.21.15.31:0/1887696266 shutdown_connections 2024-06-02T22:47:41.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.593+0000 7fb957a0d740 1 -- 172.21.15.31:0/1887696266 wait complete. 2024-06-02T22:47:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.595+0000 7fb957a0d740 1 -- start start 2024-06-02T22:47:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.595+0000 7fb957a0d740 1 Processor -- start 2024-06-02T22:47:41.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.596+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.596+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c62dd0 0x55ee25c558d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.596+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c5c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb957a0d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55ee25c6aef0 con 0x55ee25c62dd0 2024-06-02T22:47:41.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52804/0 (socket says 172.21.15.31:52804) 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 -- 172.21.15.31:0/4269313233 learned_addr learned my addr 172.21.15.31:0/4269313233 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ee25b780b0 con 0x55ee25c623e0 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55ee25c6b070 con 0x55ee25c67f40 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb957a0d740 10 client.0 _ll_register_callbacks cb 0x55ee25b63f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94e800640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c5c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 -- 172.21.15.31:0/4269313233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 msgr2=0x55ee25c5c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c5c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 -- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c62dd0 msgr2=0x55ee25c558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c62dd0 0x55ee25c558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.597+0000 7fb94de00640 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2599d620 con 0x55ee25c623e0 2024-06-02T22:47:41.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.598+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb93c012ad0 con 0x55ee25c623e0 2024-06-02T22:47:41.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.598+0000 7fb94de00640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb940005fd0 tx=0x7fb94009b1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb80bb63b3287d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.598+0000 7fb92f400640 10 client.25958 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:41.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.599+0000 7fb92f400640 1 -- 172.21.15.31:0/4269313233 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400b4060 con 0x55ee25c623e0 2024-06-02T22:47:41.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.599+0000 7fb92f400640 1 -- 172.21.15.31:0/4269313233 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fb940084b40 con 0x55ee25c623e0 2024-06-02T22:47:41.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.599+0000 7fb92f400640 1 -- 172.21.15.31:0/4269313233 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb94001d030 con 0x55ee25c623e0 2024-06-02T22:47:41.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.599+0000 7fb957a0d740 10 client.25958 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:41.600 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.599+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ee25c7f7e0 con 0x55ee25c623e0 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.600+0000 7fb92f400640 1 -- 172.21.15.31:0/4269313233 <== mon.2 v2:172.21.15.98:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb94009aa00 con 0x55ee25c623e0 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 10 client.25958 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 10 client.25958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 20 client.25958 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25c80db0 0x55ee25c831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 4 client.25958 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:47:41.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.601+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee25bcab50 con 0x55ee25c80db0 2024-06-02T22:47:41.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.603+0000 7fb94d400640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25c80db0 0x55ee25c831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.604+0000 7fb94d400640 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25c80db0 0x55ee25c831e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff149f3dc97699b5 server_cookie=cf6e9e2990ed1ec in_seq=0 out_seq=0 2024-06-02T22:47:41.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.604+0000 7fb92f400640 10 client.25958 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.606+0000 7fb92f400640 1 -- 172.21.15.31:0/4269313233 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ee25bcab50 con 0x55ee25c80db0 2024-06-02T22:47:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.606+0000 7fb92f400640 10 client.25958 handle_command_reply: tid=0 2024-06-02T22:47:41.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.606+0000 7fb957a0d740 1 client.25958 shutdown 2024-06-02T22:47:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.608+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 msgr2=0x55ee25c55390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.608 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.608+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb940005fd0 tx=0x7fb94009b1b0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 shutdown_connections 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25c80db0 0x55ee25c831e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c5c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c62dd0 0x55ee25c558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 --2- 172.21.15.31:0/4269313233 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c55390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 >> 172.21.15.31:0/4269313233 conn(0x55ee25c21f80 msgr2=0x55ee25c54810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.609+0000 7fb92f400640 0 client.25958 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:41.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.611+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 shutdown_connections 2024-06-02T22:47:41.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.611+0000 7fb957a0d740 1 -- 172.21.15.31:0/4269313233 wait complete. 2024-06-02T22:47:41.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.611+0000 7fb957a0d740 20 client.25958 trim_cache size 0 max 16384 2024-06-02T22:47:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.665+0000 7fb957a0d740 1 Processor -- start 2024-06-02T22:47:41.665 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.665+0000 7fb957a0d740 1 -- start start 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c5c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c89200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501b0b90 con 0x55ee25c623e0 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501b26d0 con 0x55ee25c62dd0 2024-06-02T22:47:41.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb957a0d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501b1260 con 0x55ee25c67f40 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb94e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c89200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb94e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c89200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:50818/0 (socket says 172.21.15.31:50818) 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.666+0000 7fb94e800640 1 -- 172.21.15.31:0/1943945370 learned_addr learned my addr 172.21.15.31:0/1943945370 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.667+0000 7fb94d400640 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c5c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.667+0000 7fb94de00640 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 -- 172.21.15.31:0/1943945370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 msgr2=0x55ee25c89200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c89200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 -- 172.21.15.31:0/1943945370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 msgr2=0x55ee25c615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 -- 172.21.15.31:0/1943945370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee25c631b0 con 0x55ee25c62dd0 2024-06-02T22:47:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.668+0000 7fb94d400640 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c5c7f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb93c01c040 tx=0x7fb93c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19b2e431f8b61eb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.669+0000 7fb93a600640 1 -- 172.21.15.31:0/1943945370 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c009de0 con 0x55ee25c62dd0 2024-06-02T22:47:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.669+0000 7fb93a600640 1 -- 172.21.15.31:0/1943945370 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb93c0050e0 con 0x55ee25c62dd0 2024-06-02T22:47:41.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.669+0000 7fb93a600640 1 -- 172.21.15.31:0/1943945370 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0036e0 con 0x55ee25c62dd0 2024-06-02T22:47:41.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.671+0000 7fb957a0d740 1 -- 172.21.15.31:0/1943945370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 msgr2=0x55ee25c5c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.671+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c5c7f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb93c01c040 tx=0x7fb93c000bc0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.672+0000 7fb957a0d740 1 -- 172.21.15.31:0/1943945370 shutdown_connections 2024-06-02T22:47:41.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.672+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c67f40 0x55ee25c89200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.672+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c62dd0 0x55ee25c5c7f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.673+0000 7fb957a0d740 1 --2- 172.21.15.31:0/1943945370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c623e0 0x55ee25c615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.673 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.673+0000 7fb957a0d740 1 -- 172.21.15.31:0/1943945370 >> 172.21.15.31:0/1943945370 conn(0x55ee25c21f80 msgr2=0x55ee25c87ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.677+0000 7fb957a0d740 1 -- 172.21.15.31:0/1943945370 shutdown_connections 2024-06-02T22:47:41.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.677+0000 7fb957a0d740 1 -- 172.21.15.31:0/1943945370 wait complete. 2024-06-02T22:47:41.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.678+0000 7fb957a0d740 1 -- start start 2024-06-02T22:47:41.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.678+0000 7fb957a0d740 1 Processor -- start 2024-06-02T22:47:41.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.679+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.679+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 0x55ee25c5a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.679+0000 7fb957a0d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c67f40 0x55ee25c5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.679+0000 7fb94de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb94de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52816/0 (socket says 172.21.15.31:52816) 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb94de00640 1 -- 172.21.15.31:0/107199314 learned_addr learned my addr 172.21.15.31:0/107199314 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501b2000 con 0x55ee25c67f40 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501b1930 con 0x55ee25c623e0 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb9501aeb90 con 0x55ee25c62dd0 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb957a0d740 10 client.0 _ll_register_callbacks cb 0x7fb9400057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:41.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb94d400640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 0x55ee25c5a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb94de00640 1 -- 172.21.15.31:0/107199314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 msgr2=0x55ee25c5a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.680+0000 7fb94de00640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 0x55ee25c5a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb94de00640 1 -- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c67f40 msgr2=0x55ee25c5b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb94de00640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c67f40 0x55ee25c5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb94de00640 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee25c5bcf0 con 0x55ee25c623e0 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb94d400640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 0x55ee25c5a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb94de00640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb9400058c0 tx=0x7fb9400cc720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbf4536e5b58503 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.681+0000 7fb92f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400b4040 con 0x55ee25c623e0 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fb940097300 con 0x55ee25c623e0 2024-06-02T22:47:41.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb93c0050e0 con 0x55ee25c623e0 2024-06-02T22:47:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb94009b380 con 0x55ee25c623e0 2024-06-02T22:47:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb957a0d740 10 client.25964 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.682+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee25cebd60 con 0x55ee25c623e0 2024-06-02T22:47:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.683+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb93c0050e0 con 0x55ee25c623e0 2024-06-02T22:47:41.684 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.684+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fb940097500 con 0x55ee25c623e0 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 10 client.25964 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 10 client.25964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 20 client.25964 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25cec370 0x55ee25cee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 4 client.25964 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:47:41.685 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee25bc4ea0 con 0x55ee25cec370 2024-06-02T22:47:41.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.685+0000 7fb94d400640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25cec370 0x55ee25cee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:41.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.687+0000 7fb94d400640 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25cec370 0x55ee25cee7a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afee90a9eeff90cb server_cookie=bd818f5393ce39dc in_seq=0 out_seq=0 2024-06-02T22:47:41.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.687+0000 7fb92f400640 10 client.25964 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.933+0000 7fb92f400640 1 -- 172.21.15.31:0/107199314 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ee25bc4ea0 con 0x55ee25cec370 2024-06-02T22:47:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.934+0000 7fb92f400640 10 client.25964 handle_command_reply: tid=0 2024-06-02T22:47:41.934 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.934+0000 7fb957a0d740 1 client.25964 shutdown 2024-06-02T22:47:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 msgr2=0x55ee25c5a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.935 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb9400058c0 tx=0x7fb9400cc720 comp rx=0 tx=0).stop 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 shutdown_connections 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55ee25cec370 0x55ee25cee7a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ee25c67f40 0x55ee25c5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ee25c62dd0 0x55ee25c5a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 --2- 172.21.15.31:0/107199314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee25c623e0 0x55ee25c5a1b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 >> 172.21.15.31:0/107199314 conn(0x55ee25c21f80 msgr2=0x55ee25c88370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.935+0000 7fb92f400640 0 client.25964 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.936+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 shutdown_connections 2024-06-02T22:47:41.936 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.936+0000 7fb957a0d740 1 -- 172.21.15.31:0/107199314 wait complete. 2024-06-02T22:47:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.936+0000 7fb957a0d740 20 client.25964 trim_cache size 0 max 16384 2024-06-02T22:47:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:47:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:47:41.937 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 msgr2=0x7fb9340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 0x7fb9340a51c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb948006010 tx=0x7fb948009500 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 msgr2=0x7fb950072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c890 tx=0x7fb94000cd50 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 shutdown_connections 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fb9340a2d00 0x7fb9340a51c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb950109890 0x7fb950071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb950075980 0x7fb950073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 --2- 172.21.15.31:0/4283779531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9500743a0 0x7fb950072f30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:41.938 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.937+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 >> 172.21.15.31:0/4283779531 conn(0x7fb9500fcf90 msgr2=0x7fb950105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.938+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 shutdown_connections 2024-06-02T22:47:41.939 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:41.938+0000 7fb954c00640 1 -- 172.21.15.31:0/4283779531 wait complete. 2024-06-02T22:47:42.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:41 smithi031 ceph-mon[31767]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.4 MiB/s wr, 437 op/s 2024-06-02T22:47:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:41 smithi098 ceph-mon[36750]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.4 MiB/s wr, 437 op/s 2024-06-02T22:47:42.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:41 smithi178 ceph-mon[36614]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.4 MiB/s wr, 437 op/s 2024-06-02T22:47:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:43 smithi031 ceph-mon[31767]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 561 op/s 2024-06-02T22:47:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:43 smithi098 ceph-mon[36750]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 561 op/s 2024-06-02T22:47:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:43 smithi178 ceph-mon[36614]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.4 MiB/s wr, 561 op/s 2024-06-02T22:47:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 620.0 s, 595.6 tps, lat 162.767 ms stddev 175.463 2024-06-02T22:47:46.114 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:45 smithi178 ceph-mon[36614]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 MiB/s wr, 508 op/s 2024-06-02T22:47:46.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:45 smithi031 ceph-mon[31767]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 MiB/s wr, 508 op/s 2024-06-02T22:47:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:45 smithi098 ceph-mon[36750]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.6 MiB/s wr, 508 op/s 2024-06-02T22:47:48.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:47 smithi031 ceph-mon[31767]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 532 op/s 2024-06-02T22:47:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:47 smithi098 ceph-mon[36750]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 532 op/s 2024-06-02T22:47:48.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:47 smithi178 ceph-mon[36614]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 532 op/s 2024-06-02T22:47:50.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:49 smithi031 ceph-mon[31767]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.7 MiB/s wr, 544 op/s 2024-06-02T22:47:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:49 smithi098 ceph-mon[36750]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.7 MiB/s wr, 544 op/s 2024-06-02T22:47:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 625.0 s, 508.8 tps, lat 201.592 ms stddev 242.853 2024-06-02T22:47:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:49 smithi178 ceph-mon[36614]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.7 MiB/s wr, 544 op/s 2024-06-02T22:47:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:51 smithi098 ceph-mon[36750]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 463 op/s 2024-06-02T22:47:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:51 smithi178 ceph-mon[36614]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 463 op/s 2024-06-02T22:47:52.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:51 smithi031 ceph-mon[31767]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 463 op/s 2024-06-02T22:47:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:53 smithi098 ceph-mon[36750]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 MiB/s wr, 621 op/s 2024-06-02T22:47:54.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:53 smithi178 ceph-mon[36614]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 MiB/s wr, 621 op/s 2024-06-02T22:47:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:53 smithi031 ceph-mon[31767]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.6 MiB/s wr, 621 op/s 2024-06-02T22:47:55.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 630.0 s, 499.1 tps, lat 194.916 ms stddev 196.679 2024-06-02T22:47:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 -- 172.21.15.31:0/2936349130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341089a0 msgr2=0x7f6334108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 --2- 172.21.15.31:0/2936349130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341089a0 0x7f6334108dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f632c009ca0 tx=0x7f632c02a8e0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 -- 172.21.15.31:0/2936349130 shutdown_connections 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 --2- 172.21.15.31:0/2936349130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334110220 0x7f6334112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 --2- 172.21.15.31:0/2936349130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6334109300 0x7f633410fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 --2- 172.21.15.31:0/2936349130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341089a0 0x7f6334108dc0 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f632c009ca0 tx=0x7f632c02a8e0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.225+0000 7f633c200640 1 -- 172.21.15.31:0/2936349130 >> 172.21.15.31:0/2936349130 conn(0x7f633406ea10 msgr2=0x7f6334070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.226+0000 7f633c200640 1 -- 172.21.15.31:0/2936349130 shutdown_connections 2024-06-02T22:47:55.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.226+0000 7f633c200640 1 -- 172.21.15.31:0/2936349130 wait complete. 2024-06-02T22:47:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.227+0000 7f633c200640 1 Processor -- start 2024-06-02T22:47:55.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 -- start start 2024-06-02T22:47:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6334110220 0x7f63341a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341a7e70 0x7f63341aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6334118140 con 0x7f6334110220 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6334117fc0 con 0x7f63341a7e70 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.228+0000 7f633c200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63341182c0 con 0x7f6334109300 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.229+0000 7f6339800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.229+0000 7f6339800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35418/0 (socket says 172.21.15.31:35418) 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.229+0000 7f6339800640 1 -- 172.21.15.31:0/2922876329 learned_addr learned my addr 172.21.15.31:0/2922876329 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.229+0000 7f6339800640 1 -- 172.21.15.31:0/2922876329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341a7e70 msgr2=0x7f63341aa260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T22:47:55.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.229+0000 7f6339800640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341a7e70 0x7f63341aa260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.230+0000 7f6339800640 1 -- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6334110220 msgr2=0x7f63341a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.230+0000 7f6339800640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6334110220 0x7f63341a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.230+0000 7f6339800640 1 -- 172.21.15.31:0/2922876329 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63341aa8d0 con 0x7f6334109300 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.231+0000 7f6339800640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f632c02aed0 tx=0x7f632c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.231+0000 7f6332000640 1 -- 172.21.15.31:0/2922876329 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c032e80 con 0x7f6334109300 2024-06-02T22:47:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.231+0000 7f6332000640 1 -- 172.21.15.31:0/2922876329 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632c030d60 con 0x7f6334109300 2024-06-02T22:47:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.231+0000 7f6332000640 1 -- 172.21.15.31:0/2922876329 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c004860 con 0x7f6334109300 2024-06-02T22:47:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.232+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63341aab60 con 0x7f6334109300 2024-06-02T22:47:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.232+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341ab060 con 0x7f6334109300 2024-06-02T22:47:55.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.237+0000 7f6332000640 1 -- 172.21.15.31:0/2922876329 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f632c030880 con 0x7f6334109300 2024-06-02T22:47:55.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.239+0000 7f6332000640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 0x7f631c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.239+0000 7f6332000640 1 -- 172.21.15.31:0/2922876329 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f632c0f0c10 con 0x7f6334109300 2024-06-02T22:47:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.242+0000 7f633f082740 1 Processor -- start 2024-06-02T22:47:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 -- start start 2024-06-02T22:47:55.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55698492e420 con 0x5569849cabd0 2024-06-02T22:47:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569848d5c50 con 0x5569849d0730 2024-06-02T22:47:55.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.243+0000 7f633f082740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55698492a3e0 con 0x5569849cb5c0 2024-06-02T22:47:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.244+0000 7f6338e00640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 0x7f631c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58880/0 (socket says 172.21.15.31:58880) 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 -- 172.21.15.31:0/3540386681 learned_addr learned my addr 172.21.15.31:0/3540386681 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f6338e00640 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 -- 172.21.15.31:0/3540386681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 msgr2=0x5569849d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 -- 172.21.15.31:0/3540386681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 msgr2=0x5569849caff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849caff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.245+0000 7f633a200640 1 -- 172.21.15.31:0/3540386681 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556984642210 con 0x5569849d0730 2024-06-02T22:47:55.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.246+0000 7f633a200640 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6320009bd0 tx=0x7f632000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5f23e4aee1ad9f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.248+0000 7f6326a00640 1 -- 172.21.15.31:0/3540386681 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320005020 con 0x5569849d0730 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.248+0000 7f6326a00640 1 -- 172.21.15.31:0/3540386681 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63200047a0 con 0x5569849d0730 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.248+0000 7f6326a00640 1 -- 172.21.15.31:0/3540386681 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320010690 con 0x5569849d0730 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.249+0000 7f633f082740 1 -- 172.21.15.31:0/3540386681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 msgr2=0x5569849d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.249+0000 7f633f082740 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6320009bd0 tx=0x7f632000e720 comp rx=0 tx=0).stop 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.249+0000 7f6338e00640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 0x7f631c0a5170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63341a3de0 tx=0x7f6328018c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 -- 172.21.15.31:0/3540386681 shutdown_connections 2024-06-02T22:47:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849d2bc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 --2- 172.21.15.31:0/3540386681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 -- 172.21.15.31:0/3540386681 >> 172.21.15.31:0/3540386681 conn(0x556984992f80 msgr2=0x5569849c6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 -- 172.21.15.31:0/3540386681 shutdown_connections 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 -- 172.21.15.31:0/3540386681 wait complete. 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.251+0000 7f633f082740 1 -- start start 2024-06-02T22:47:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.252+0000 7f633f082740 1 Processor -- start 2024-06-02T22:47:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.253+0000 7f633f082740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f6339800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849dc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5569849d36e0 con 0x5569849cabd0 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569848e90b0 con 0x5569849d0730 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5569849d3860 con 0x5569849cb5c0 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f6338e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f6338e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:35426/0 (socket says 172.21.15.31:35426) 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f6338e00640 1 -- 172.21.15.31:0/4184302088 learned_addr learned my addr 172.21.15.31:0/4184302088 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633a200640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849dc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.254+0000 7f633f082740 10 client.0 _ll_register_callbacks cb 0x5569848d4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.255+0000 7f6338e00640 1 -- 172.21.15.31:0/4184302088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 msgr2=0x5569849dc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.255+0000 7f6338e00640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849dc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.255+0000 7f6338e00640 1 -- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 msgr2=0x5569849d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.255+0000 7f6338e00640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.255+0000 7f6338e00640 1 -- 172.21.15.31:0/4184302088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698470e620 con 0x5569849cb5c0 2024-06-02T22:47:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.256+0000 7f6338e00640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6328018370 tx=0x7f63280047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3d1a5318226439 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.256+0000 7f631b400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:47:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.256+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328016e30 con 0x5569849cb5c0 2024-06-02T22:47:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.256+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f632800d9a0 con 0x5569849cb5c0 2024-06-02T22:47:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.256+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63200047a0 con 0x5569849cb5c0 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.258+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f632800dba0 con 0x5569849cb5c0 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.258+0000 7f633f082740 10 client.25954 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.258+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5569849df6d0 con 0x5569849cb5c0 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.258+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63200047a0 con 0x5569849cb5c0 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.258+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f63280243f0 con 0x5569849cb5c0 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 10 client.25954 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 20 client.25954 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5569849e0da0 0x5569849e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 4 client.25954 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:47:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.259+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55698493bb50 con 0x5569849e0da0 2024-06-02T22:47:55.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.261+0000 7f6339800640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5569849e0da0 0x5569849e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.264+0000 7f6339800640 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5569849e0da0 0x5569849e31f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c421be65f99afe server_cookie=f63abc35bb4dd851 in_seq=0 out_seq=0 2024-06-02T22:47:55.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.264+0000 7f631b400640 10 client.25954 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.265+0000 7f631b400640 1 -- 172.21.15.31:0/4184302088 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55698493bb50 con 0x5569849e0da0 2024-06-02T22:47:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.265+0000 7f631b400640 10 client.25954 handle_command_reply: tid=0 2024-06-02T22:47:55.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.265+0000 7f633f082740 1 client.25954 shutdown 2024-06-02T22:47:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 msgr2=0x5569849d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6328018370 tx=0x7f63280047e0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 shutdown_connections 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5569849e0da0 0x5569849e31f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849d0730 0x5569849dc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 --2- 172.21.15.31:0/4184302088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 >> 172.21.15.31:0/4184302088 conn(0x556984992f80 msgr2=0x5569849c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f631b400640 0 client.25954 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 shutdown_connections 2024-06-02T22:47:55.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.266+0000 7f633f082740 1 -- 172.21.15.31:0/4184302088 wait complete. 2024-06-02T22:47:55.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.267+0000 7f633f082740 20 client.25954 trim_cache size 0 max 16384 2024-06-02T22:47:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.302+0000 7f633f082740 1 Processor -- start 2024-06-02T22:47:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 -- start start 2024-06-02T22:47:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 0x5569849dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b1180 con 0x5569849cabd0 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b2cc0 con 0x5569849cb5c0 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.303+0000 7f633f082740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b1850 con 0x5569849d0730 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.304+0000 7f6339800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.304+0000 7f6339800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48432/0 (socket says 172.21.15.31:48432) 2024-06-02T22:47:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.304+0000 7f6339800640 1 -- 172.21.15.31:0/624697762 learned_addr learned my addr 172.21.15.31:0/624697762 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.305+0000 7f633a200640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 0x5569849dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6338e00640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6339800640 1 -- 172.21.15.31:0/624697762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 msgr2=0x5569849dc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6339800640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 0x5569849dc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6339800640 1 -- 172.21.15.31:0/624697762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 msgr2=0x5569849d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6339800640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6339800640 1 -- 172.21.15.31:0/624697762 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569849cb9a0 con 0x5569849cabd0 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f6338e00640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:55.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.306+0000 7f633a200640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 0x5569849dc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:47:55.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.307+0000 7f6339800640 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f632c0bcde0 tx=0x7f632c031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eacf394bec0f31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.308+0000 7f6326000640 1 -- 172.21.15.31:0/624697762 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0bd7e0 con 0x5569849cabd0 2024-06-02T22:47:55.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.308+0000 7f6326000640 1 -- 172.21.15.31:0/624697762 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632c036030 con 0x5569849cabd0 2024-06-02T22:47:55.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.308+0000 7f6326000640 1 -- 172.21.15.31:0/624697762 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c030b70 con 0x5569849cabd0 2024-06-02T22:47:55.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.309+0000 7f633f082740 1 -- 172.21.15.31:0/624697762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 msgr2=0x5569849d4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.309+0000 7f633f082740 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f632c0bcde0 tx=0x7f632c031a00 comp rx=0 tx=0).stop 2024-06-02T22:47:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 -- 172.21.15.31:0/624697762 shutdown_connections 2024-06-02T22:47:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849d0730 0x5569849dc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 --2- 172.21.15.31:0/624697762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849cabd0 0x5569849d4fa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 -- 172.21.15.31:0/624697762 >> 172.21.15.31:0/624697762 conn(0x556984992f80 msgr2=0x5569849c60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 -- 172.21.15.31:0/624697762 shutdown_connections 2024-06-02T22:47:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.312+0000 7f633f082740 1 -- 172.21.15.31:0/624697762 wait complete. 2024-06-02T22:47:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.313+0000 7f633f082740 1 -- start start 2024-06-02T22:47:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.313+0000 7f633f082740 1 Processor -- start 2024-06-02T22:47:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.314+0000 7f633f082740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 0x5569849d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.314+0000 7f633f082740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.314+0000 7f633f082740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849d0730 0x556984a49ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58914/0 (socket says 172.21.15.31:58914) 2024-06-02T22:47:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 -- 172.21.15.31:0/4096662206 learned_addr learned my addr 172.21.15.31:0/4096662206 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:47:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b25f0 con 0x5569849d0730 2024-06-02T22:47:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63341b1f20 con 0x5569849cb5c0 2024-06-02T22:47:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63341af180 con 0x5569849cabd0 2024-06-02T22:47:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f633f082740 10 client.0 _ll_register_callbacks cb 0x7f6328009030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6339800640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 0x5569849d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 -- 172.21.15.31:0/4096662206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 msgr2=0x5569849d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 0x5569849d92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 -- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849d0730 msgr2=0x556984a49ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.315+0000 7f6338e00640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849d0730 0x556984a49ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.316+0000 7f6338e00640 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569849d9ea0 con 0x5569849cb5c0 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.316+0000 7f6339800640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 0x5569849d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.316+0000 7f631b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:47:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.316+0000 7f6338e00640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f632801fcb0 tx=0x7f6328023f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a302bf7706c7f1cc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.317+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632802ae80 con 0x5569849cb5c0 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.317+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6328021300 con 0x5569849cb5c0 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.317+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f632c036030 con 0x5569849cb5c0 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.318+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6328021500 con 0x5569849cb5c0 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.318+0000 7f633f082740 10 client.25976 fetch_fsmap learned FSMap version 30 2024-06-02T22:47:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.318+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556984a4b0b0 con 0x5569849cb5c0 2024-06-02T22:47:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f632c036030 con 0x5569849cb5c0 2024-06-02T22:47:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f63280243f0 con 0x5569849cb5c0 2024-06-02T22:47:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 10 client.25976 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:47:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 10 client.25976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 20 client.25976 populate_metadata read hostname 'smithi031' 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556984a4ba00 0x556984a4de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 4 client.25976 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.319+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556984935ea0 con 0x556984a4ba00 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.320+0000 7f6339800640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556984a4ba00 0x556984a4de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.321+0000 7f6339800640 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556984a4ba00 0x556984a4de20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=337c1d7764f56327 server_cookie=46d76a14b58e76b0 in_seq=0 out_seq=0 2024-06-02T22:47:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.321+0000 7f631b400640 10 client.25976 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.398+0000 7f631b400640 1 -- 172.21.15.31:0/4096662206 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556984935ea0 con 0x556984a4ba00 2024-06-02T22:47:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.398+0000 7f631b400640 10 client.25976 handle_command_reply: tid=0 2024-06-02T22:47:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.398+0000 7f633f082740 1 client.25976 shutdown 2024-06-02T22:47:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 msgr2=0x5569849d9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f632801fcb0 tx=0x7f6328023f90 comp rx=0 tx=0).stop 2024-06-02T22:47:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 shutdown_connections 2024-06-02T22:47:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556984a4ba00 0x556984a4de20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5569849d0730 0x556984a49ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569849cb5c0 0x5569849d9830 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 --2- 172.21.15.31:0/4096662206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569849cabd0 0x5569849d92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 >> 172.21.15.31:0/4096662206 conn(0x556984992f80 msgr2=0x5569849cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.399+0000 7f631b400640 0 client.25976 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.400+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 shutdown_connections 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.400+0000 7f633f082740 1 -- 172.21.15.31:0/4096662206 wait complete. 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.400+0000 7f633f082740 20 client.25976 trim_cache size 0 max 16384 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:47:55.401 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:47:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:47:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.401+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 msgr2=0x7f631c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.401+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 0x7f631c0a5170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63341a3de0 tx=0x7f6328018c10 comp rx=0 tx=0).stop 2024-06-02T22:47:55.402 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.401+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 msgr2=0x7f63341a28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.401+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f632c02aed0 tx=0x7f632c003ba0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 shutdown_connections 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f631c0a2cb0 0x7f631c0a5170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63341a7e70 0x7f63341aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6334110220 0x7f63341a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 --2- 172.21.15.31:0/2922876329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6334109300 0x7f63341a28d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 >> 172.21.15.31:0/2922876329 conn(0x7f633406ea10 msgr2=0x7f63340706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 shutdown_connections 2024-06-02T22:47:55.403 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:47:55.402+0000 7f633c200640 1 -- 172.21.15.31:0/2922876329 wait complete. 2024-06-02T22:47:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:55 smithi098 ceph-mon[36750]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 572 op/s 2024-06-02T22:47:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:55 smithi178 ceph-mon[36614]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 572 op/s 2024-06-02T22:47:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:55 smithi031 ceph-mon[31767]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 572 op/s 2024-06-02T22:47:57.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:56 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:47:57.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:56 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:47:57.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:56 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:47:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:57 smithi098 ceph-mon[36750]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 575 op/s 2024-06-02T22:47:58.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:57 smithi178 ceph-mon[36614]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 575 op/s 2024-06-02T22:47:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:57 smithi031 ceph-mon[31767]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 575 op/s 2024-06-02T22:47:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:47:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:47:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:47:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:47:59.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:47:59.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:47:59.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:47:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:47:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:47:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:47:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:47:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:48:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 635.0 s, 452.5 tps, lat 225.693 ms stddev 273.341 2024-06-02T22:48:00.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:00 smithi178 ceph-mon[36614]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 568 op/s 2024-06-02T22:48:00.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:00 smithi031 ceph-mon[31767]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 568 op/s 2024-06-02T22:48:00.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:00 smithi098 ceph-mon[36750]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 568 op/s 2024-06-02T22:48:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:02 smithi178 ceph-mon[36614]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 499 op/s 2024-06-02T22:48:02.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:02 smithi031 ceph-mon[31767]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 499 op/s 2024-06-02T22:48:02.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:02 smithi098 ceph-mon[36750]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 499 op/s 2024-06-02T22:48:04.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:04 smithi178 ceph-mon[36614]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 589 op/s 2024-06-02T22:48:04.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:04 smithi031 ceph-mon[31767]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 589 op/s 2024-06-02T22:48:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:04 smithi098 ceph-mon[36750]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 589 op/s 2024-06-02T22:48:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 640.0 s, 529.6 tps, lat 189.037 ms stddev 244.868 2024-06-02T22:48:06.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:06 smithi178 ceph-mon[36614]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 476 op/s 2024-06-02T22:48:06.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:06 smithi031 ceph-mon[31767]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 476 op/s 2024-06-02T22:48:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:06 smithi098 ceph-mon[36750]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 476 op/s 2024-06-02T22:48:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:08 smithi178 ceph-mon[36614]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 468 op/s 2024-06-02T22:48:08.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:08 smithi031 ceph-mon[31767]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 468 op/s 2024-06-02T22:48:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 -- 172.21.15.31:0/447517107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28077f40 msgr2=0x7f0c280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 --2- 172.21.15.31:0/447517107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28077f40 0x7f0c280787e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ca0 tx=0x7f0c2002a8b0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 -- 172.21.15.31:0/447517107 shutdown_connections 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 --2- 172.21.15.31:0/447517107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28077f40 0x7f0c280787e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 --2- 172.21.15.31:0/447517107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c280775a0 0x7f0c28077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 --2- 172.21.15.31:0/447517107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c28076360 0x7f0c28076780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 -- 172.21.15.31:0/447517107 >> 172.21.15.31:0/447517107 conn(0x7f0c280ff1c0 msgr2=0x7f0c281015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 -- 172.21.15.31:0/447517107 shutdown_connections 2024-06-02T22:48:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.623+0000 7f0c2d200640 1 -- 172.21.15.31:0/447517107 wait complete. 2024-06-02T22:48:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.625+0000 7f0c2d200640 1 Processor -- start 2024-06-02T22:48:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 -- start start 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28076360 0x7f0c2810e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 0x7f0c281ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28113d00 con 0x7f0c28077f40 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28113b80 con 0x7f0c28076360 2024-06-02T22:48:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.626+0000 7f0c2d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c28113e80 con 0x7f0c280775a0 2024-06-02T22:48:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28076360 0x7f0c2810e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51940/0 (socket says 172.21.15.31:51940) 2024-06-02T22:48:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 -- 172.21.15.31:0/3705572503 learned_addr learned my addr 172.21.15.31:0/3705572503 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c26800640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 0x7f0c281ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 -- 172.21.15.31:0/3705572503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28076360 msgr2=0x7f0c2810e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28076360 0x7f0c2810e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.627+0000 7f0c25400640 1 -- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 msgr2=0x7f0c281ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c25400640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 0x7f0c281ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c25400640 1 -- 172.21.15.31:0/3705572503 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c28111b70 con 0x7f0c280775a0 2024-06-02T22:48:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c26800640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 0x7f0c281ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c25400640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400d950 tx=0x7f0c1400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c1ea00640 1 -- 172.21.15.31:0/3705572503 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14017070 con 0x7f0c280775a0 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c1ea00640 1 -- 172.21.15.31:0/3705572503 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c14009c30 con 0x7f0c280775a0 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.628+0000 7f0c1ea00640 1 -- 172.21.15.31:0/3705572503 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f6b0 con 0x7f0c280775a0 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.629+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c281ae910 con 0x7f0c280775a0 2024-06-02T22:48:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.629+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c281aede0 con 0x7f0c280775a0 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.632+0000 7f0c2ffde740 1 Processor -- start 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.632+0000 7f0c2ffde740 1 -- start start 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e22e11c420 con 0x55e22e1c9be0 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e22e0c3c50 con 0x55e22e1cf740 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e22e1183e0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51948/0 (socket says 172.21.15.31:51948) 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c25e00640 1 -- 172.21.15.31:0/4260597907 learned_addr learned my addr 172.21.15.31:0/4260597907 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.633+0000 7f0c26800640 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 -- 172.21.15.31:0/4260597907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 msgr2=0x55e22e1d1bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1d1bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 -- 172.21.15.31:0/4260597907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 msgr2=0x55e22e1ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.635 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 -- 172.21.15.31:0/4260597907 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22de30210 con 0x55e22e1ca5d0 2024-06-02T22:48:08.636 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c26800640 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c25e00640 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800bd10 tx=0x7f0c180327b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cc1743bce68b9ae server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.634+0000 7f0c1ea00640 1 -- 172.21.15.31:0/3705572503 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f0c140109d0 con 0x7f0c280775a0 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.635+0000 7f0c13400640 1 -- 172.21.15.31:0/4260597907 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18004030 con 0x55e22e1ca5d0 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.635+0000 7f0c13400640 1 -- 172.21.15.31:0/4260597907 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c180041d0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.635+0000 7f0c13400640 1 -- 172.21.15.31:0/4260597907 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18033890 con 0x55e22e1ca5d0 2024-06-02T22:48:08.637 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 -- 172.21.15.31:0/4260597907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 msgr2=0x55e22e1cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800bd10 tx=0x7f0c180327b0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 -- 172.21.15.31:0/4260597907 shutdown_connections 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1cf0d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/4260597907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 -- 172.21.15.31:0/4260597907 >> 172.21.15.31:0/4260597907 conn(0x55e22e180f80 msgr2=0x55e22e1b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 -- 172.21.15.31:0/4260597907 shutdown_connections 2024-06-02T22:48:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.636+0000 7f0c2ffde740 1 -- 172.21.15.31:0/4260597907 wait complete. 2024-06-02T22:48:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.637+0000 7f0c1ea00640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 0x7f0c0c0a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.637+0000 7f0c2ffde740 1 -- start start 2024-06-02T22:48:08.640 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.637+0000 7f0c1ea00640 1 -- 172.21.15.31:0/3705572503 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c140cefc0 con 0x7f0c280775a0 2024-06-02T22:48:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.637+0000 7f0c2ffde740 1 Processor -- start 2024-06-02T22:48:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.637+0000 7f0c26800640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 0x7f0c0c0a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c26800640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 0x7f0c0c0a5110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55e22e1cae30 tx=0x7f0c20030930 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.641 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 0x55e22e1ba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55e22e1b8b30 con 0x55e22e1cf740 2024-06-02T22:48:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e22e0d70b0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e22e1b8cb0 con 0x55e22e1c9be0 2024-06-02T22:48:08.642 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c2ffde740 10 client.0 _ll_register_callbacks cb 0x55e22e0c2f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:51950/0 (socket says 172.21.15.31:51950) 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.638+0000 7f0c25e00640 1 -- 172.21.15.31:0/3232803274 learned_addr learned my addr 172.21.15.31:0/3232803274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 0x55e22e1ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c26800640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 -- 172.21.15.31:0/3232803274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 msgr2=0x55e22e1ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 -- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 msgr2=0x55e22e1c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.643 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25400640 1 -- 172.21.15.31:0/3232803274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22defc620 con 0x55e22e1ca5d0 2024-06-02T22:48:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.639+0000 7f0c25e00640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:48:08.644 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.640+0000 7f0c25400640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 0x55e22e1ba970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cc6d0 tx=0x7f0c1409ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1941bc9ff32559 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.640+0000 7f0c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:48:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.640+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14020070 con 0x55e22e1ca5d0 2024-06-02T22:48:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.641+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c180041d0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.645 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.641+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c140ccb90 con 0x55e22e1ca5d0 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c1409f7e0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 10 client.25985 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e22e1c4d90 con 0x55e22e1ca5d0 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c180041d0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c1409a880 con 0x55e22e1ca5d0 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 10 client.25985 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 20 client.25985 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:08.646 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e1c63e0 0x55e22e1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 4 client.25985 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:48:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.642+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e22e129b50 con 0x55e22e1c63e0 2024-06-02T22:48:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.645+0000 7f0c25e00640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e1c63e0 0x55e22e1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.647 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.647+0000 7f0c25e00640 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e1c63e0 0x55e22e1c8860 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41f09b07aee2f0e7 server_cookie=837cc242d97a8123 in_seq=0 out_seq=0 2024-06-02T22:48:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.647+0000 7f0c07e00640 10 client.25985 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.655+0000 7f0c07e00640 1 -- 172.21.15.31:0/3232803274 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e22e129b50 con 0x55e22e1c63e0 2024-06-02T22:48:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.655+0000 7f0c07e00640 10 client.25985 handle_command_reply: tid=0 2024-06-02T22:48:08.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.655+0000 7f0c2ffde740 1 client.25985 shutdown 2024-06-02T22:48:08.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.656+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 msgr2=0x55e22e1ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.656+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 0x55e22e1ba970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cc6d0 tx=0x7f0c1409ae50 comp rx=0 tx=0).stop 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 shutdown_connections 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e1c63e0 0x55e22e1c8860 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1ca5d0 0x55e22e1ba970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/3232803274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1c9be0 0x55e22e1ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 >> 172.21.15.31:0/3232803274 conn(0x55e22e180f80 msgr2=0x55e22e1b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c07e00640 0 client.25985 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 shutdown_connections 2024-06-02T22:48:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.658+0000 7f0c2ffde740 1 -- 172.21.15.31:0/3232803274 wait complete. 2024-06-02T22:48:08.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.659+0000 7f0c2ffde740 20 client.25985 trim_cache size 0 max 16384 2024-06-02T22:48:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.703+0000 7f0c2ffde740 1 Processor -- start 2024-06-02T22:48:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.703+0000 7f0c2ffde740 1 -- start start 2024-06-02T22:48:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c2ffde740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281b0c30 con 0x55e22e1c9be0 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c26800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c26800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46820/0 (socket says 172.21.15.31:46820) 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.704+0000 7f0c26800640 1 -- 172.21.15.31:0/2383381405 learned_addr learned my addr 172.21.15.31:0/2383381405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.705+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281b2770 con 0x55e22e1cf740 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.705+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281b1300 con 0x55e22e1ca5d0 2024-06-02T22:48:08.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.705+0000 7f0c25400640 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c26800640 1 -- 172.21.15.31:0/2383381405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 msgr2=0x55e22e1c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c26800640 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c26800640 1 -- 172.21.15.31:0/2383381405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 msgr2=0x55e22e1b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c26800640 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c26800640 1 -- 172.21.15.31:0/2383381405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22e1b9850 con 0x55e22e1cf740 2024-06-02T22:48:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.706+0000 7f0c25400640 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:48:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.707+0000 7f0c26800640 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c20035000 tx=0x7f0c20040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4b56fb914b8d80 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.708+0000 7f0c12a00640 1 -- 172.21.15.31:0/2383381405 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20003970 con 0x55e22e1cf740 2024-06-02T22:48:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.708+0000 7f0c12a00640 1 -- 172.21.15.31:0/2383381405 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c20036040 con 0x55e22e1cf740 2024-06-02T22:48:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.708+0000 7f0c12a00640 1 -- 172.21.15.31:0/2383381405 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2003d420 con 0x55e22e1cf740 2024-06-02T22:48:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.709+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 msgr2=0x55e22e1b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.709+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c20035000 tx=0x7f0c20040000 comp rx=0 tx=0).stop 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.710+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 shutdown_connections 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.711+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1cf740 0x55e22e1b4610 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.711+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.711+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/2383381405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1c9be0 0x55e22e1b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.711+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 >> 172.21.15.31:0/2383381405 conn(0x55e22e180f80 msgr2=0x55e22e1cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.712+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 shutdown_connections 2024-06-02T22:48:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.712+0000 7f0c2ffde740 1 -- 172.21.15.31:0/2383381405 wait complete. 2024-06-02T22:48:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:08 smithi098 ceph-mon[36750]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 468 op/s 2024-06-02T22:48:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.713+0000 7f0c2ffde740 1 -- start start 2024-06-02T22:48:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.713+0000 7f0c2ffde740 1 Processor -- start 2024-06-02T22:48:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.714+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.714+0000 7f0c2ffde740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46828/0 (socket says 172.21.15.31:46828) 2024-06-02T22:48:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25e00640 1 -- 172.21.15.31:0/320917218 learned_addr learned my addr 172.21.15.31:0/320917218 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281b20a0 con 0x55e22e1cf740 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0c281b19d0 con 0x55e22e1c9be0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c280737a0 con 0x55e22e1ca5d0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c2ffde740 10 client.0 _ll_register_callbacks cb 0x7f0c1400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25400640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25400640 1 -- 172.21.15.31:0/320917218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 msgr2=0x55e22e1c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25400640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.715+0000 7f0c25400640 1 -- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 msgr2=0x55e22e1be420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c25400640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c25400640 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22e1c1a70 con 0x55e22e1ca5d0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c25e00640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c25400640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1bdee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009610 tx=0x7f0c1400bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3cd635c333a25ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14020070 con 0x55e22e1ca5d0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.716+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0c140ccb90 con 0x55e22e1ca5d0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.717+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c20036040 con 0x55e22e1ca5d0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.717+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0c140b4410 con 0x55e22e1ca5d0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.717+0000 7f0c2ffde740 10 client.25975 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.717+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e22e239330 con 0x55e22e1ca5d0 2024-06-02T22:48:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c20036040 con 0x55e22e1ca5d0 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0c1407c030 con 0x55e22e1ca5d0 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 10 client.25975 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 10 client.25975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 20 client.25975 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e239b50 0x55e22e23bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 4 client.25975 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e22e123ea0 con 0x55e22e239b50 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.718+0000 7f0c25e00640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e239b50 0x55e22e23bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.719+0000 7f0c25e00640 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e239b50 0x55e22e23bf70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bb605aec79d72d server_cookie=8aabf4f3140f8107 in_seq=0 out_seq=0 2024-06-02T22:48:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.719+0000 7f0c07e00640 10 client.25975 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c07e00640 1 -- 172.21.15.31:0/320917218 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e22e123ea0 con 0x55e22e239b50 2024-06-02T22:48:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c07e00640 10 client.25975 handle_command_reply: tid=0 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 client.25975 shutdown 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 msgr2=0x55e22e1bdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1bdee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009610 tx=0x7f0c1400bf60 comp rx=0 tx=0).stop 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 shutdown_connections 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55e22e239b50 0x55e22e23bf70 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55e22e1cf740 0x55e22e1be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e22e1ca5d0 0x55e22e1bdee0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 --2- 172.21.15.31:0/320917218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e22e1c9be0 0x55e22e1c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 >> 172.21.15.31:0/320917218 conn(0x55e22e180f80 msgr2=0x55e22e1b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.909+0000 7f0c07e00640 0 client.25975 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.910+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 shutdown_connections 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.910+0000 7f0c2ffde740 1 -- 172.21.15.31:0/320917218 wait complete. 2024-06-02T22:48:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.910+0000 7f0c2ffde740 20 client.25975 trim_cache size 0 max 16384 2024-06-02T22:48:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:48:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:48:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:48:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.911+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 msgr2=0x7f0c0c0a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.911+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 0x7f0c0c0a5110 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55e22e1cae30 tx=0x7f0c20030930 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.911+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 msgr2=0x7f0c2810ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.911+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400d950 tx=0x7f0c1400de10 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 shutdown_connections 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f0c0c0a2c50 0x7f0c0c0a5110 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c28077f40 0x7f0c281ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c280775a0 0x7f0c2810ea40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 --2- 172.21.15.31:0/3705572503 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0c28076360 0x7f0c2810e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 >> 172.21.15.31:0/3705572503 conn(0x7f0c280ff1c0 msgr2=0x7f0c28100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 shutdown_connections 2024-06-02T22:48:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:08.912+0000 7f0c2d200640 1 -- 172.21.15.31:0/3705572503 wait complete. 2024-06-02T22:48:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 645.0 s, 519.2 tps, lat 193.928 ms stddev 227.736 2024-06-02T22:48:10.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:10 smithi178 ceph-mon[36614]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 489 op/s 2024-06-02T22:48:10.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:10 smithi031 ceph-mon[31767]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 489 op/s 2024-06-02T22:48:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:10 smithi098 ceph-mon[36750]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.0 MiB/s wr, 489 op/s 2024-06-02T22:48:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:12 smithi178 ceph-mon[36614]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 434 op/s 2024-06-02T22:48:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:12 smithi031 ceph-mon[31767]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 434 op/s 2024-06-02T22:48:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:12 smithi098 ceph-mon[36750]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 434 op/s 2024-06-02T22:48:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:14 smithi178 ceph-mon[36614]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 541 op/s 2024-06-02T22:48:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:14 smithi031 ceph-mon[31767]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 541 op/s 2024-06-02T22:48:14.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:14 smithi098 ceph-mon[36750]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 541 op/s 2024-06-02T22:48:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 650.0 s, 583.2 tps, lat 167.500 ms stddev 197.712 2024-06-02T22:48:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:16 smithi178 ceph-mon[36614]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 495 op/s 2024-06-02T22:48:16.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:16 smithi031 ceph-mon[31767]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 495 op/s 2024-06-02T22:48:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:16 smithi098 ceph-mon[36750]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 495 op/s 2024-06-02T22:48:18.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:18 smithi031 ceph-mon[31767]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 502 op/s 2024-06-02T22:48:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:18 smithi098 ceph-mon[36750]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 502 op/s 2024-06-02T22:48:18.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:18 smithi178 ceph-mon[36614]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 502 op/s 2024-06-02T22:48:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 655.0 s, 578.8 tps, lat 177.088 ms stddev 213.023 2024-06-02T22:48:20.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:20 smithi031 ceph-mon[31767]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-06-02T22:48:20.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:20 smithi098 ceph-mon[36750]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-06-02T22:48:20.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:20 smithi178 ceph-mon[36614]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-06-02T22:48:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:22 smithi031 ceph-mon[31767]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-06-02T22:48:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:22 smithi098 ceph-mon[36750]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-06-02T22:48:22.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:22 smithi178 ceph-mon[36614]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 466 op/s 2024-06-02T22:48:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.193+0000 7f9746200640 1 -- 172.21.15.31:0/2512181222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740110220 msgr2=0x7f9740112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.193+0000 7f9746200640 1 --2- 172.21.15.31:0/2512181222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740110220 0x7f9740112610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f972c009900 tx=0x7f972c02a410 comp rx=0 tx=0).stop 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 -- 172.21.15.31:0/2512181222 shutdown_connections 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 --2- 172.21.15.31:0/2512181222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740110220 0x7f9740112610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 --2- 172.21.15.31:0/2512181222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9740109300 0x7f974010fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 --2- 172.21.15.31:0/2512181222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97401089a0 0x7f9740108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 -- 172.21.15.31:0/2512181222 >> 172.21.15.31:0/2512181222 conn(0x7f974006ea10 msgr2=0x7f9740070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 -- 172.21.15.31:0/2512181222 shutdown_connections 2024-06-02T22:48:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.194+0000 7f9746200640 1 -- 172.21.15.31:0/2512181222 wait complete. 2024-06-02T22:48:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 Processor -- start 2024-06-02T22:48:23.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 -- start start 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 0x7f9740119a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9740110220 0x7f974011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9740113d20 con 0x7f9740109300 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9740113ba0 con 0x7f97401089a0 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.196+0000 7f9746200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9740113ea0 con 0x7f9740110220 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60410/0 (socket says 172.21.15.31:60410) 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 -- 172.21.15.31:0/2899025083 learned_addr learned my addr 172.21.15.31:0/2899025083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973fe00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9740110220 0x7f974011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973ea00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 0x7f9740119a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.197 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 -- 172.21.15.31:0/2899025083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9740110220 msgr2=0x7f974011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9740110220 0x7f974011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 -- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 msgr2=0x7f9740119a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 0x7f9740119a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.198 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.197+0000 7f973f400640 1 -- 172.21.15.31:0/2899025083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974011f140 con 0x7f97401089a0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.198+0000 7f973ea00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 0x7f9740119a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.198+0000 7f973f400640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f973800cce0 tx=0x7f973800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.198+0000 7f9737e00640 1 -- 172.21.15.31:0/2899025083 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738004b20 con 0x7f97401089a0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.198+0000 7f9737e00640 1 -- 172.21.15.31:0/2899025083 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9738004cc0 con 0x7f97401089a0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.198+0000 7f9737e00640 1 -- 172.21.15.31:0/2899025083 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973800f8c0 con 0x7f97401089a0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.199+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974011f430 con 0x7f97401089a0 2024-06-02T22:48:23.199 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.200+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974011f980 con 0x7f97401089a0 2024-06-02T22:48:23.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.210+0000 7f9748fd4740 1 Processor -- start 2024-06-02T22:48:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.214+0000 7f9737e00640 1 -- 172.21.15.31:0/2899025083 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f973800fa60 con 0x7f97401089a0 2024-06-02T22:48:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.215+0000 7f9748fd4740 1 -- start start 2024-06-02T22:48:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.215+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a01bd0 0x558972a01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.215+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.216+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a07730 0x558972a09bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.216+0000 7f973f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.216+0000 7f973f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60426/0 (socket says 172.21.15.31:60426) 2024-06-02T22:48:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 -- 172.21.15.31:0/3867447187 learned_addr learned my addr 172.21.15.31:0/3867447187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558972965420 con 0x558972a07730 2024-06-02T22:48:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55897290cc50 con 0x558972a025c0 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5589729613e0 con 0x558972a01bd0 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f9737e00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 0x7f97240a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973ea00640 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a07730 0x558972a09bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 -- 172.21.15.31:0/3867447187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a01bd0 msgr2=0x558972a01ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a01bd0 0x558972a01ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 -- 172.21.15.31:0/3867447187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a07730 msgr2=0x558972a09bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a07730 0x558972a09bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.217+0000 7f973f400640 1 -- 172.21.15.31:0/3867447187 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558972679210 con 0x558972a025c0 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.218+0000 7f973fe00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 0x7f97240a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.218+0000 7f973f400640 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97380cce10 tx=0x7f97380d7690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8056484540153b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.219+0000 7f972be00640 1 -- 172.21.15.31:0/3867447187 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738097ed0 con 0x558972a025c0 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.219+0000 7f972be00640 1 -- 172.21.15.31:0/3867447187 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f973809c330 con 0x558972a025c0 2024-06-02T22:48:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.219+0000 7f972be00640 1 -- 172.21.15.31:0/3867447187 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973809b590 con 0x558972a025c0 2024-06-02T22:48:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.219+0000 7f9737e00640 1 -- 172.21.15.31:0/2899025083 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f97380cf760 con 0x7f97401089a0 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f973fe00640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 0x7f97240a50f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c0315d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 msgr2=0x558972a070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97380cce10 tx=0x7f97380d7690 comp rx=0 tx=0).stop 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 shutdown_connections 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a07730 0x558972a09bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a025c0 0x558972a070c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3867447187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a01bd0 0x558972a01ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 >> 172.21.15.31:0/3867447187 conn(0x5589729c9f80 msgr2=0x5589729fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.224+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 shutdown_connections 2024-06-02T22:48:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.225+0000 7f9748fd4740 1 -- 172.21.15.31:0/3867447187 wait complete. 2024-06-02T22:48:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.225+0000 7f9748fd4740 1 -- start start 2024-06-02T22:48:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.225+0000 7f9748fd4740 1 Processor -- start 2024-06-02T22:48:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.230+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a0c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.230+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.230+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a13b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.230+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60428/0 (socket says 172.21.15.31:60428) 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 -- 172.21.15.31:0/3255956018 learned_addr learned my addr 172.21.15.31:0/3255956018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558972a0a6e0 con 0x558972a01bd0 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5589729200b0 con 0x558972a07730 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558972a0a860 con 0x558972a11730 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f9748fd4740 10 client.0 _ll_register_callbacks cb 0x55897290bf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973fe00640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a13b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 -- 172.21.15.31:0/3255956018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 msgr2=0x558972a13b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a13b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 -- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 msgr2=0x558972a0c1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a0c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973ea00640 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558972745620 con 0x558972a07730 2024-06-02T22:48:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.231+0000 7f973fe00640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a13b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:48:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.233+0000 7f973ea00640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f973000bf70 tx=0x7f973000f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcb44f0ed0965617 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.233+0000 7f9728c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:48:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.234+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730018020 con 0x558972a07730 2024-06-02T22:48:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.234+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9730014670 con 0x558972a07730 2024-06-02T22:48:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.234+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f973809c330 con 0x558972a07730 2024-06-02T22:48:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9730023050 con 0x558972a07730 2024-06-02T22:48:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 10 client.25997 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558972a16ee0 con 0x558972a07730 2024-06-02T22:48:23.234 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f973809c330 con 0x558972a07730 2024-06-02T22:48:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9730013b70 con 0x558972a07730 2024-06-02T22:48:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 10 client.25997 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 10 client.25997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 20 client.25997 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a18620 0x558972a1aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 4 client.25997 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:48:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.235+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558972972b50 con 0x558972a18620 2024-06-02T22:48:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.238+0000 7f973f400640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a18620 0x558972a1aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.240+0000 7f973f400640 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a18620 0x558972a1aab0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=284abd476476f9cc server_cookie=955b7c60fd1bc76 in_seq=0 out_seq=0 2024-06-02T22:48:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.240+0000 7f9728c00640 10 client.25997 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9728c00640 1 -- 172.21.15.31:0/3255956018 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558972972b50 con 0x558972a18620 2024-06-02T22:48:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9728c00640 10 client.25997 handle_command_reply: tid=0 2024-06-02T22:48:23.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9748fd4740 1 client.25997 shutdown 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 msgr2=0x558972a0c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f973000bf70 tx=0x7f973000f670 comp rx=0 tx=0).stop 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.244+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 shutdown_connections 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.245+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a18620 0x558972a1aab0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.245+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a13b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.245+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a0c700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.245+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3255956018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a0c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.245+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 >> 172.21.15.31:0/3255956018 conn(0x5589729c9f80 msgr2=0x5589729fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.246+0000 7f9728c00640 0 client.25997 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.246+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 shutdown_connections 2024-06-02T22:48:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.246+0000 7f9748fd4740 1 -- 172.21.15.31:0/3255956018 wait complete. 2024-06-02T22:48:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.246+0000 7f9748fd4740 20 client.25997 trim_cache size 0 max 16384 2024-06-02T22:48:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.305+0000 7f9748fd4740 1 Processor -- start 2024-06-02T22:48:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.305+0000 7f9748fd4740 1 -- start start 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x5589729fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x5589729fd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97401c1c80 con 0x558972a01bd0 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f97401c37c0 con 0x558972a07730 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f9748fd4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f97401c2350 con 0x558972a11730 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x5589729fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42288/0 (socket says 172.21.15.31:42288) 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x5589729fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973fe00640 1 -- 172.21.15.31:0/3981173897 learned_addr learned my addr 172.21.15.31:0/3981173897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.306+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x5589729fd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60430/0 (socket says 172.21.15.31:60430) 2024-06-02T22:48:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 -- 172.21.15.31:0/3981173897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 msgr2=0x5589729fd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x5589729fd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 -- 172.21.15.31:0/3981173897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 msgr2=0x5589729fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x5589729fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 -- 172.21.15.31:0/3981173897 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589729f86a0 con 0x558972a11730 2024-06-02T22:48:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.307+0000 7f973fe00640 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f972c033000 tx=0x7f972c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fcc29046a1901f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.308+0000 7f972b400640 1 -- 172.21.15.31:0/3981173897 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c04d070 con 0x558972a11730 2024-06-02T22:48:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.308+0000 7f972b400640 1 -- 172.21.15.31:0/3981173897 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f972c031c20 con 0x558972a11730 2024-06-02T22:48:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.308+0000 7f972b400640 1 -- 172.21.15.31:0/3981173897 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c04d070 con 0x558972a11730 2024-06-02T22:48:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.311+0000 7f9748fd4740 1 -- 172.21.15.31:0/3981173897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 msgr2=0x5589729fbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.311+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f972c033000 tx=0x7f972c03d000 comp rx=0 tx=0).stop 2024-06-02T22:48:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 -- 172.21.15.31:0/3981173897 shutdown_connections 2024-06-02T22:48:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x5589729fbf80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x5589729fd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 --2- 172.21.15.31:0/3981173897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x5589729fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 -- 172.21.15.31:0/3981173897 >> 172.21.15.31:0/3981173897 conn(0x5589729c9f80 msgr2=0x558972a03b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 -- 172.21.15.31:0/3981173897 shutdown_connections 2024-06-02T22:48:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.312+0000 7f9748fd4740 1 -- 172.21.15.31:0/3981173897 wait complete. 2024-06-02T22:48:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.313+0000 7f9748fd4740 1 -- start start 2024-06-02T22:48:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.313+0000 7f9748fd4740 1 Processor -- start 2024-06-02T22:48:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.314+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a29fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.314+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.314+0000 7f9748fd4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f9748fd4740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97401c30f0 con 0x558972a01bd0 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f9748fd4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f97401c2a20 con 0x558972a07730 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f9748fd4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f97401bfc60 con 0x558972a11730 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f973fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f973fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42302/0 (socket says 172.21.15.31:42302) 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f973fe00640 1 -- 172.21.15.31:0/2388642745 learned_addr learned my addr 172.21.15.31:0/2388642745 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f973ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:60432/0 (socket says 172.21.15.31:60432) 2024-06-02T22:48:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.315+0000 7f9748fd4740 10 client.0 _ll_register_callbacks cb 0x7f973000b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 -- 172.21.15.31:0/2388642745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 msgr2=0x558972a2a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 -- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 msgr2=0x558972a29fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a29fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 -- 172.21.15.31:0/2388642745 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558972a2ba80 con 0x558972a11730 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973ea00640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f973fe00640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f972c0314e0 tx=0x7f972c003f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef67f7a0e7c8bf3f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.316+0000 7f9728c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.317+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c04d030 con 0x558972a11730 2024-06-02T22:48:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.318+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f972c031a20 con 0x558972a11730 2024-06-02T22:48:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.318+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f972c031c20 con 0x558972a11730 2024-06-02T22:48:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.318+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f972c035040 con 0x558972a11730 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.318+0000 7f9748fd4740 10 client.25984 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.318+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558972a2cd70 con 0x558972a11730 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f972c031c20 con 0x558972a11730 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f972c067020 con 0x558972a11730 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 10 client.25984 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 10 client.25984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 20 client.25984 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a83a50 0x558972a85e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 4 client.25984 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:48:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55897296cea0 con 0x558972a83a50 2024-06-02T22:48:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.319+0000 7f973f400640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a83a50 0x558972a85e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.320+0000 7f9728c00640 10 client.25984 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.321+0000 7f973f400640 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a83a50 0x558972a85e70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3042a72c0ef9100 server_cookie=6a9416da1681de95 in_seq=0 out_seq=0 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.558+0000 7f9728c00640 1 -- 172.21.15.31:0/2388642745 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55897296cea0 con 0x558972a83a50 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.558+0000 7f9728c00640 10 client.25984 handle_command_reply: tid=0 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.558+0000 7f9748fd4740 1 client.25984 shutdown 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.558+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 msgr2=0x558972a2b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.558+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f972c0314e0 tx=0x7f972c003f20 comp rx=0 tx=0).stop 2024-06-02T22:48:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 shutdown_connections 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558972a83a50 0x558972a85e70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558972a11730 0x558972a2b490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558972a07730 0x558972a2a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 --2- 172.21.15.31:0/2388642745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558972a01bd0 0x558972a29fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 >> 172.21.15.31:0/2388642745 conn(0x5589729c9f80 msgr2=0x5589729fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9728c00640 0 client.25984 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 shutdown_connections 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 1 -- 172.21.15.31:0/2388642745 wait complete. 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.559+0000 7f9748fd4740 20 client.25984 trim_cache size 0 max 16384 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:48:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.560+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 msgr2=0x7f97240a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.560+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 0x7f97240a50f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c0315d0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.560+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 msgr2=0x7f9740119530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.560+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f973800cce0 tx=0x7f973800a620 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 shutdown_connections 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f97240a2c30 0x7f97240a50f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9740110220 0x7f974011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9740109300 0x7f9740119a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 --2- 172.21.15.31:0/2899025083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f97401089a0 0x7f9740119530 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.561+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 >> 172.21.15.31:0/2899025083 conn(0x7f974006ea10 msgr2=0x7f974010bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.562+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 shutdown_connections 2024-06-02T22:48:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:23.563+0000 7f9746200640 1 -- 172.21.15.31:0/2899025083 wait complete. 2024-06-02T22:48:23.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:23 smithi031 ceph-mon[31767]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 577 op/s 2024-06-02T22:48:23.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:23 smithi098 ceph-mon[36750]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 577 op/s 2024-06-02T22:48:23.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:23 smithi178 ceph-mon[36614]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.2 MiB/s wr, 577 op/s 2024-06-02T22:48:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 660.0 s, 474.0 tps, lat 210.127 ms stddev 252.672 2024-06-02T22:48:26.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:25 smithi178 ceph-mon[36614]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 529 op/s 2024-06-02T22:48:26.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:25 smithi031 ceph-mon[31767]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 529 op/s 2024-06-02T22:48:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:25 smithi098 ceph-mon[36750]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.5 MiB/s wr, 529 op/s 2024-06-02T22:48:28.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:27 smithi178 ceph-mon[36614]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2024-06-02T22:48:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:27 smithi031 ceph-mon[31767]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2024-06-02T22:48:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:27 smithi098 ceph-mon[36750]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.7 MiB/s wr, 479 op/s 2024-06-02T22:48:30.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:29 smithi031 ceph-mon[31767]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.9 MiB/s wr, 603 op/s 2024-06-02T22:48:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:29 smithi098 ceph-mon[36750]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.9 MiB/s wr, 603 op/s 2024-06-02T22:48:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 665.0 s, 618.0 tps, lat 165.224 ms stddev 188.692 2024-06-02T22:48:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:29 smithi178 ceph-mon[36614]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.9 MiB/s wr, 603 op/s 2024-06-02T22:48:32.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:31 smithi031 ceph-mon[31767]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 499 op/s 2024-06-02T22:48:32.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:31 smithi098 ceph-mon[36750]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 499 op/s 2024-06-02T22:48:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:31 smithi178 ceph-mon[36614]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.8 MiB/s wr, 499 op/s 2024-06-02T22:48:34.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:33 smithi031 ceph-mon[31767]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.8 MiB/s wr, 630 op/s 2024-06-02T22:48:34.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:33 smithi098 ceph-mon[36750]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.8 MiB/s wr, 630 op/s 2024-06-02T22:48:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:33 smithi178 ceph-mon[36614]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.8 MiB/s wr, 630 op/s 2024-06-02T22:48:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 670.0 s, 592.6 tps, lat 161.269 ms stddev 206.850 2024-06-02T22:48:36.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:35 smithi031 ceph-mon[31767]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 561 op/s 2024-06-02T22:48:36.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:35 smithi098 ceph-mon[36750]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 561 op/s 2024-06-02T22:48:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:35 smithi178 ceph-mon[36614]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.9 MiB/s wr, 561 op/s 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 -- 172.21.15.31:0/1564917146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c100270 msgr2=0x7f711c1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 --2- 172.21.15.31:0/1564917146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c100270 0x7f711c1026a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7108009860 tx=0x7f710802a360 comp rx=0 tx=0).stop 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 -- 172.21.15.31:0/1564917146 shutdown_connections 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 --2- 172.21.15.31:0/1564917146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f711c105590 0x7f711c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 --2- 172.21.15.31:0/1564917146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c102be0 0x7f711c105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.780+0000 7f7122200640 1 --2- 172.21.15.31:0/1564917146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c100270 0x7f711c1026a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.781+0000 7f7122200640 1 -- 172.21.15.31:0/1564917146 >> 172.21.15.31:0/1564917146 conn(0x7f711c0fbe70 msgr2=0x7f711c0fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:36.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.781+0000 7f7122200640 1 -- 172.21.15.31:0/1564917146 shutdown_connections 2024-06-02T22:48:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.781+0000 7f7122200640 1 -- 172.21.15.31:0/1564917146 wait complete. 2024-06-02T22:48:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.782+0000 7f7122200640 1 Processor -- start 2024-06-02T22:48:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.785+0000 7f7122200640 1 -- start start 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f711c100270 0x7f711c10b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c102be0 0x7f711c10bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f711c113ca0 con 0x7f711c102be0 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f711c113b20 con 0x7f711c105590 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f7122200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f711c113e20 con 0x7f711c100270 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f711be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f711be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56370/0 (socket says 172.21.15.31:56370) 2024-06-02T22:48:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f711be00640 1 -- 172.21.15.31:0/436613 learned_addr learned my addr 172.21.15.31:0/436613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.786+0000 7f711aa00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c102be0 0x7f711c10bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.787 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 -- 172.21.15.31:0/436613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f711c100270 msgr2=0x7f711c10b790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f711c100270 0x7f711c10b790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 -- 172.21.15.31:0/436613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c102be0 msgr2=0x7f711c10bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c102be0 0x7f711c10bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 -- 172.21.15.31:0/436613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c10ee50 con 0x7f711c105590 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f711be00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f711400eaa0 tx=0x7f711400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f7113e00640 1 -- 172.21.15.31:0/436613 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114004d20 con 0x7f711c105590 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f7113e00640 1 -- 172.21.15.31:0/436613 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7114005020 con 0x7f711c105590 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.787+0000 7f7113e00640 1 -- 172.21.15.31:0/436613 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71140116d0 con 0x7f711c105590 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.788+0000 7f7122200640 1 -- 172.21.15.31:0/436613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711c1ae970 con 0x7f711c105590 2024-06-02T22:48:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.788+0000 7f7122200640 1 -- 172.21.15.31:0/436613 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711c1aee70 con 0x7f711c105590 2024-06-02T22:48:36.795 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.794+0000 7f7124fd3740 1 Processor -- start 2024-06-02T22:48:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.797+0000 7f7124fd3740 1 -- start start 2024-06-02T22:48:36.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.797+0000 7f7113e00640 1 -- 172.21.15.31:0/436613 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f71140051d0 con 0x7f711c105590 2024-06-02T22:48:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.798+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591f9aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f7124fd3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b591efe420 con 0x55b591f9abd0 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f711b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f711b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:56386/0 (socket says 172.21.15.31:56386) 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f711b400640 1 -- 172.21.15.31:0/3673803167 learned_addr learned my addr 172.21.15.31:0/3673803167 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f711aa00640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.799+0000 7f7124fd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b591ea5c50 con 0x55b591f9b5c0 2024-06-02T22:48:36.800 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.800+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b591efa3e0 con 0x55b591fa0730 2024-06-02T22:48:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.800+0000 7f7113e00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 0x7f71000a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711aa00640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591f9aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 -- 172.21.15.31:0/3673803167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 msgr2=0x55b591fa2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.801 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 -- 172.21.15.31:0/3673803167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 msgr2=0x55b591f9aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591f9aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f7113e00640 1 -- 172.21.15.31:0/436613 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f71140cf8b0 con 0x7f711c105590 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 -- 172.21.15.31:0/3673803167 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b591c12210 con 0x55b591f9b5c0 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711aa00640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.801+0000 7f711b400640 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7108030580 tx=0x7f7108005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8318318e465c4f0f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.802+0000 7f711be00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 0x7f71000a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.802+0000 7f7107e00640 1 -- 172.21.15.31:0/3673803167 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710803f020 con 0x55b591f9b5c0 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.802+0000 7f7107e00640 1 -- 172.21.15.31:0/3673803167 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7108030e20 con 0x55b591f9b5c0 2024-06-02T22:48:36.802 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.802+0000 7f7107e00640 1 -- 172.21.15.31:0/3673803167 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108037040 con 0x55b591f9b5c0 2024-06-02T22:48:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 msgr2=0x55b591fa00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7108030580 tx=0x7f7108005780 comp rx=0 tx=0).stop 2024-06-02T22:48:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 shutdown_connections 2024-06-02T22:48:36.803 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9b5c0 0x55b591fa00c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3673803167 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591f9aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.803+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 >> 172.21.15.31:0/3673803167 conn(0x55b591f62f80 msgr2=0x55b591f96650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.804+0000 7f711be00640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 0x7f71000a51f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f711409ba20 tx=0x7f71140cfb00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.804+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 shutdown_connections 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.804+0000 7f7124fd3740 1 -- 172.21.15.31:0/3673803167 wait complete. 2024-06-02T22:48:36.804 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.805+0000 7f7124fd3740 1 -- start start 2024-06-02T22:48:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.805+0000 7f7124fd3740 1 Processor -- start 2024-06-02T22:48:36.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591fa4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b591fa3680 con 0x55b591f9abd0 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b591eb90b0 con 0x55b591fa0730 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b591fa3800 con 0x55b591f9b5c0 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f7124fd3740 10 client.0 _ll_register_callbacks cb 0x55b591ea4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40014/0 (socket says 172.21.15.31:40014) 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 -- 172.21.15.31:0/1368646929 learned_addr learned my addr 172.21.15.31:0/1368646929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:36.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711aa00640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 -- 172.21.15.31:0/1368646929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 msgr2=0x55b591fac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 -- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 msgr2=0x55b591fa4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591fa4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711b400640 1 -- 172.21.15.31:0/1368646929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b591cde620 con 0x55b591f9b5c0 2024-06-02T22:48:36.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.806+0000 7f711aa00640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.807+0000 7f711b400640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7108009950 tx=0x7f7108030a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce5a0a81b9a7fc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.807+0000 7f7104c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.807+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710803f030 con 0x55b591f9b5c0 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.807+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7108030e20 con 0x55b591f9b5c0 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.807+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7108004250 con 0x55b591f9b5c0 2024-06-02T22:48:36.808 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.808+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7108037050 con 0x55b591f9b5c0 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.808+0000 7f7124fd3740 10 client.25993 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.808+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b591fa36d0 con 0x55b591f9b5c0 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.808+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7108003c70 con 0x55b591f9b5c0 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f710803a030 con 0x55b591f9b5c0 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 10 client.25993 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 10 client.25993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 20 client.25993 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b591fb0ac0 0x55b591fb2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 4 client.25993 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:48:36.809 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.809+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7108030e20 con 0x55b591fb0ac0 2024-06-02T22:48:36.810 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.810+0000 7f711aa00640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b591fb0ac0 0x55b591fb2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.812+0000 7f7104c00640 10 client.25993 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:36.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.812+0000 7f711aa00640 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b591fb0ac0 0x55b591fb2eb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2953cb59d37c50c server_cookie=6f0b07afbe20c160 in_seq=0 out_seq=0 2024-06-02T22:48:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7104c00640 1 -- 172.21.15.31:0/1368646929 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f7108030e20 con 0x55b591fb0ac0 2024-06-02T22:48:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7104c00640 10 client.25993 handle_command_reply: tid=0 2024-06-02T22:48:36.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 client.25993 shutdown 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 msgr2=0x55b591fa5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7108009950 tx=0x7f7108030a20 comp rx=0 tx=0).stop 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 shutdown_connections 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b591fb0ac0 0x55b591fb2eb0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.814 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9b5c0 0x55b591fa5490 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7108009950 tx=0x7f7108030a20 comp rx=0 tx=0).stop 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 --2- 172.21.15.31:0/1368646929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591f9abd0 0x55b591fa4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 >> 172.21.15.31:0/1368646929 conn(0x55b591f62f80 msgr2=0x55b591f95810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.814+0000 7f7104c00640 0 client.25993 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.815+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 shutdown_connections 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.815+0000 7f7124fd3740 1 -- 172.21.15.31:0/1368646929 wait complete. 2024-06-02T22:48:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.816+0000 7f7124fd3740 20 client.25993 trim_cache size 0 max 16384 2024-06-02T22:48:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.849+0000 7f7124fd3740 1 Processor -- start 2024-06-02T22:48:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 -- start start 2024-06-02T22:48:36.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 0x55b591f967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591f99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1b9450 con 0x55b591fa55c0 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1baf90 con 0x55b591fa0730 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.850+0000 7f7124fd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1b9b20 con 0x55b591f9abd0 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.851+0000 7f711aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 0x55b591f967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.851+0000 7f711aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 0x55b591f967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40024/0 (socket says 172.21.15.31:40024) 2024-06-02T22:48:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.851+0000 7f711aa00640 1 -- 172.21.15.31:0/3058463247 learned_addr learned my addr 172.21.15.31:0/3058463247 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.852+0000 7f711b400640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.852+0000 7f711aa00640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591f99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.852+0000 7f711b400640 1 -- 172.21.15.31:0/3058463247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 msgr2=0x55b591f967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.852+0000 7f711b400640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 0x55b591f967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.852+0000 7f711b400640 1 -- 172.21.15.31:0/3058463247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 msgr2=0x55b591f99310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.853+0000 7f711b400640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591f99310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.853+0000 7f711b400640 1 -- 172.21.15.31:0/3058463247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b591f9fc00 con 0x55b591fa0730 2024-06-02T22:48:36.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.853+0000 7f711aa00640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591f99310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:48:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.855+0000 7f711b400640 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7108034000 tx=0x7f7108030b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ad7a1901a1c2aa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.855+0000 7f7107400640 1 -- 172.21.15.31:0/3058463247 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710803f040 con 0x55b591fa0730 2024-06-02T22:48:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.855+0000 7f7107400640 1 -- 172.21.15.31:0/3058463247 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7108044e10 con 0x55b591fa0730 2024-06-02T22:48:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.855+0000 7f7107400640 1 -- 172.21.15.31:0/3058463247 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108003720 con 0x55b591fa0730 2024-06-02T22:48:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 -- 172.21.15.31:0/3058463247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 msgr2=0x55b591fac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7108034000 tx=0x7f7108030b10 comp rx=0 tx=0).stop 2024-06-02T22:48:36.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 -- 172.21.15.31:0/3058463247 shutdown_connections 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591f99310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591fa0730 0x55b591fac490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3058463247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591f9abd0 0x55b591f967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 -- 172.21.15.31:0/3058463247 >> 172.21.15.31:0/3058463247 conn(0x55b591f62f80 msgr2=0x55b591f960d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.856+0000 7f7124fd3740 1 -- 172.21.15.31:0/3058463247 shutdown_connections 2024-06-02T22:48:36.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.857+0000 7f7124fd3740 1 -- 172.21.15.31:0/3058463247 wait complete. 2024-06-02T22:48:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.857+0000 7f7124fd3740 1 -- start start 2024-06-02T22:48:36.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.858+0000 7f7124fd3740 1 Processor -- start 2024-06-02T22:48:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.859+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9abd0 0x55b591fa9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.859 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f711aa00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9abd0 0x55b591fa9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591faaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1ba8c0 con 0x55b591fa55c0 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1ba1f0 con 0x55b591f9abd0 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f711c1b7430 con 0x55b591fa0730 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f7124fd3740 10 client.0 _ll_register_callbacks cb 0x7f710c0097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.860+0000 7f711b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:40028/0 (socket says 172.21.15.31:40028) 2024-06-02T22:48:36.860 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 -- 172.21.15.31:0/3564590600 learned_addr learned my addr 172.21.15.31:0/3564590600 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 -- 172.21.15.31:0/3564590600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9abd0 msgr2=0x55b591fa9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9abd0 0x55b591fa9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 -- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 msgr2=0x55b591faaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591faaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.861+0000 7f711b400640 1 -- 172.21.15.31:0/3564590600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b591fab290 con 0x55b591fa0730 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.862+0000 7f711b400640 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7108009980 tx=0x7f7108009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd52f4c8ad417316 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.862+0000 7f7104c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:36.862 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.862+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710803f040 con 0x55b591fa0730 2024-06-02T22:48:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.862+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f7108044660 con 0x55b591fa0730 2024-06-02T22:48:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.862+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7108044e10 con 0x55b591fa0730 2024-06-02T22:48:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.864+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7108003720 con 0x55b591fa0730 2024-06-02T22:48:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.864+0000 7f7124fd3740 10 client.25999 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.864+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b591fac510 con 0x55b591fa0730 2024-06-02T22:48:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.864+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7108044e10 con 0x55b591fa0730 2024-06-02T22:48:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f710803a070 con 0x55b591fa0730 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 10 client.25999 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 10 client.25999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 20 client.25999 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b59201ba30 0x55b59201de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 4 client.25999 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.869+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b591f0bb50 con 0x55b59201ba30 2024-06-02T22:48:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.870+0000 7f711aa00640 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b59201ba30 0x55b59201de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.871+0000 7f711aa00640 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b59201ba30 0x55b59201de20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636a9644c7b62b85 server_cookie=ddaabb59713c683c in_seq=0 out_seq=0 2024-06-02T22:48:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:36.871+0000 7f7104c00640 10 client.25999 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:38.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:37 smithi031 ceph-mon[31767]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.4 MiB/s wr, 493 op/s 2024-06-02T22:48:38.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:37 smithi098 ceph-mon[36750]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.4 MiB/s wr, 493 op/s 2024-06-02T22:48:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:37 smithi178 ceph-mon[36614]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.4 MiB/s wr, 493 op/s 2024-06-02T22:48:40.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:39 smithi031 ceph-mon[31767]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.0 MiB/s wr, 645 op/s 2024-06-02T22:48:40.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:39 smithi098 ceph-mon[36750]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.0 MiB/s wr, 645 op/s 2024-06-02T22:48:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 675.0 s, 489.4 tps, lat 211.062 ms stddev 243.461 2024-06-02T22:48:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:39 smithi178 ceph-mon[36614]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.0 MiB/s wr, 645 op/s 2024-06-02T22:48:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7104c00640 1 -- 172.21.15.31:0/3564590600 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b591f0bb50 con 0x55b59201ba30 2024-06-02T22:48:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7104c00640 10 client.25999 handle_command_reply: tid=0 2024-06-02T22:48:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 client.25999 shutdown 2024-06-02T22:48:41.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 msgr2=0x55b591fa9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7108009980 tx=0x7f7108009580 comp rx=0 tx=0).stop 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 shutdown_connections 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55b59201ba30 0x55b59201de20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b591fa55c0 0x55b591faaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7104c00640 0 client.25999 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b591fa0730 0x55b591fa9c90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 --2- 172.21.15.31:0/3564590600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b591f9abd0 0x55b591fa9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.454+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 >> 172.21.15.31:0/3564590600 conn(0x55b591f62f80 msgr2=0x55b591f94f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.455+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 shutdown_connections 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.455+0000 7f7124fd3740 1 -- 172.21.15.31:0/3564590600 wait complete. 2024-06-02T22:48:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.455+0000 7f7124fd3740 20 client.25999 trim_cache size 0 max 16384 2024-06-02T22:48:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:48:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:48:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:48:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 msgr2=0x7f71000a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 0x7f71000a51f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f711409ba20 tx=0x7f71140cfb00 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 msgr2=0x7f711c1ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f711400eaa0 tx=0x7f711400eea0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 shutdown_connections 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f71000a2d30 0x7f71000a51f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f711c105590 0x7f711c1ae370 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711c102be0 0x7f711c10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 --2- 172.21.15.31:0/436613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f711c100270 0x7f711c10b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 >> 172.21.15.31:0/436613 conn(0x7f711c0fbe70 msgr2=0x7f711c1038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 shutdown_connections 2024-06-02T22:48:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:41.456+0000 7f7122200640 1 -- 172.21.15.31:0/436613 wait complete. 2024-06-02T22:48:42.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:41 smithi031 ceph-mon[31767]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 486 op/s 2024-06-02T22:48:42.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:41 smithi098 ceph-mon[36750]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 486 op/s 2024-06-02T22:48:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:41 smithi178 ceph-mon[36614]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 486 op/s 2024-06-02T22:48:44.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:43 smithi031 ceph-mon[31767]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 619 op/s 2024-06-02T22:48:44.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:43 smithi098 ceph-mon[36750]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 619 op/s 2024-06-02T22:48:44.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:43 smithi178 ceph-mon[36614]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 7.2 MiB/s wr, 619 op/s 2024-06-02T22:48:45.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 680.0 s, 467.5 tps, lat 213.651 ms stddev 241.763 2024-06-02T22:48:46.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:45 smithi098 ceph-mon[36750]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-06-02T22:48:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:45 smithi178 ceph-mon[36614]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-06-02T22:48:46.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:45 smithi031 ceph-mon[31767]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 543 op/s 2024-06-02T22:48:48.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:47 smithi098 ceph-mon[36750]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-06-02T22:48:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:47 smithi178 ceph-mon[36614]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-06-02T22:48:48.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:47 smithi031 ceph-mon[31767]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.3 MiB/s wr, 484 op/s 2024-06-02T22:48:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:49 smithi098 ceph-mon[36750]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-06-02T22:48:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 685.0 s, 517.5 tps, lat 192.081 ms stddev 225.670 2024-06-02T22:48:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:49 smithi178 ceph-mon[36614]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-06-02T22:48:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:49 smithi031 ceph-mon[31767]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.6 MiB/s wr, 565 op/s 2024-06-02T22:48:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:51 smithi098 ceph-mon[36750]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:48:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:51 smithi178 ceph-mon[36614]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:48:52.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:51 smithi031 ceph-mon[31767]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.9 MiB/s wr, 464 op/s 2024-06-02T22:48:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:53 smithi098 ceph-mon[36750]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 581 op/s 2024-06-02T22:48:54.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:53 smithi178 ceph-mon[36614]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 581 op/s 2024-06-02T22:48:54.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:53 smithi031 ceph-mon[31767]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.4 MiB/s wr, 581 op/s 2024-06-02T22:48:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 690.0 s, 474.2 tps, lat 203.570 ms stddev 248.613 2024-06-02T22:48:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.296+0000 7f27dbc00640 1 -- 172.21.15.31:0/4121910327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4105590 msgr2=0x7f27d4105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.298 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.296+0000 7f27dbc00640 1 --2- 172.21.15.31:0/4121910327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4105590 0x7f27d4105a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009be0 tx=0x7f27cc02a6e0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.297+0000 7f27dbc00640 1 -- 172.21.15.31:0/4121910327 shutdown_connections 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.297+0000 7f27dbc00640 1 --2- 172.21.15.31:0/4121910327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4105590 0x7f27d4105a10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.297+0000 7f27dbc00640 1 --2- 172.21.15.31:0/4121910327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d4105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.297+0000 7f27dbc00640 1 --2- 172.21.15.31:0/4121910327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4100270 0x7f27d41026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.297+0000 7f27dbc00640 1 -- 172.21.15.31:0/4121910327 >> 172.21.15.31:0/4121910327 conn(0x7f27d40fbe90 msgr2=0x7f27d40fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.298+0000 7f27dbc00640 1 -- 172.21.15.31:0/4121910327 shutdown_connections 2024-06-02T22:48:55.299 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.298+0000 7f27dbc00640 1 -- 172.21.15.31:0/4121910327 wait complete. 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 Processor -- start 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 -- start start 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 0x7f27d410b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d410bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 0x7f27d41ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27d4113ca0 con 0x7f27d4102be0 2024-06-02T22:48:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27d4113b20 con 0x7f27d4105590 2024-06-02T22:48:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.301+0000 7f27dbc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f27d4113e20 con 0x7f27d4100270 2024-06-02T22:48:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 0x7f27d410b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.303 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 0x7f27d410b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:53292/0 (socket says 172.21.15.31:53292) 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9200640 1 -- 172.21.15.31:0/3440665269 learned_addr learned my addr 172.21.15.31:0/3440665269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 0x7f27d41ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d3e00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d410bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9c00640 1 -- 172.21.15.31:0/3440665269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 msgr2=0x7f27d410b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 0x7f27d410b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.302+0000 7f27d9c00640 1 -- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 msgr2=0x7f27d410bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.303+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d410bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.303+0000 7f27d9c00640 1 -- 172.21.15.31:0/3440665269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d410edb0 con 0x7f27d4105590 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.303+0000 7f27d3e00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:48:55.304 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.303+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 0x7f27d41ae350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f27cc034040 tx=0x7f27cc0305b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.303+0000 7f27d1600640 1 -- 172.21.15.31:0/3440665269 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc041020 con 0x7f27d4105590 2024-06-02T22:48:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.304+0000 7f27d1600640 1 -- 172.21.15.31:0/3440665269 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27cc003e50 con 0x7f27d4105590 2024-06-02T22:48:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.304+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d41ae890 con 0x7f27d4105590 2024-06-02T22:48:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.304+0000 7f27d1600640 1 -- 172.21.15.31:0/3440665269 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc036040 con 0x7f27d4105590 2024-06-02T22:48:55.305 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.304+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d41aecf0 con 0x7f27d4105590 2024-06-02T22:48:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.313+0000 7f27d1600640 1 -- 172.21.15.31:0/3440665269 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f27cc044020 con 0x7f27d4105590 2024-06-02T22:48:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.315+0000 7f27debd6740 1 Processor -- start 2024-06-02T22:48:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.315+0000 7f27debd6740 1 -- start start 2024-06-02T22:48:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b7675c0 0x556d5b76c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b76c730 0x556d5b76ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556d5b6ca420 con 0x556d5b7675c0 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556d5b671c50 con 0x556d5b76c730 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27debd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d5b6c63e0 con 0x556d5b766bd0 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:53302/0 (socket says 172.21.15.31:53302) 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27d3e00640 1 -- 172.21.15.31:0/4123678803 learned_addr learned my addr 172.21.15.31:0/4123678803 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.316+0000 7f27d3e00640 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b76c730 0x556d5b76ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 -- 172.21.15.31:0/4123678803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b76c730 msgr2=0x556d5b76ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b76c730 0x556d5b76ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 -- 172.21.15.31:0/4123678803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b7675c0 msgr2=0x556d5b76c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b7675c0 0x556d5b76c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 -- 172.21.15.31:0/4123678803 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5b3de210 con 0x556d5b766bd0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d3e00640 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27c8013890 tx=0x7f27c800b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986aa83ea2ef4719 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27d1600640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 0x7f27bc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.317+0000 7f27c2000640 1 -- 172.21.15.31:0/4123678803 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c800e8f0 con 0x556d5b766bd0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.318+0000 7f27c2000640 1 -- 172.21.15.31:0/4123678803 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c80113e0 con 0x556d5b766bd0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.318+0000 7f27c2000640 1 -- 172.21.15.31:0/4123678803 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8010630 con 0x556d5b766bd0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.318+0000 7f27d9200640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 0x7f27bc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.318+0000 7f27d1600640 1 -- 172.21.15.31:0/3440665269 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27cc0efca0 con 0x7f27d4105590 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.319+0000 7f27d9200640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 0x7f27bc0a5260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b770 tx=0x7f27c400b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.319+0000 7f27debd6740 1 -- 172.21.15.31:0/4123678803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 msgr2=0x556d5b766ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.319+0000 7f27debd6740 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27c8013890 tx=0x7f27c800b420 comp rx=0 tx=0).stop 2024-06-02T22:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.319+0000 7f27debd6740 1 -- 172.21.15.31:0/4123678803 shutdown_connections 2024-06-02T22:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b76c730 0x556d5b76ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b7675c0 0x556d5b76c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 --2- 172.21.15.31:0/4123678803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b766ff0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 -- 172.21.15.31:0/4123678803 >> 172.21.15.31:0/4123678803 conn(0x556d5b72ef80 msgr2=0x556d5b762650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 -- 172.21.15.31:0/4123678803 shutdown_connections 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 -- 172.21.15.31:0/4123678803 wait complete. 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.320+0000 7f27debd6740 1 -- start start 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.321+0000 7f27debd6740 1 Processor -- start 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.321+0000 7f27debd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.321+0000 7f27debd6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b7675c0 0x556d5b7714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.321+0000 7f27debd6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b778530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27debd6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556d5b76f730 con 0x556d5b76c730 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27debd6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556d5b6850b0 con 0x556d5b7675c0 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27debd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d5b76f8b0 con 0x556d5b766bd0 2024-06-02T22:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:53304/0 (socket says 172.21.15.31:53304) 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 -- 172.21.15.31:0/2272968223 learned_addr learned my addr 172.21.15.31:0/2272968223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27debd6740 10 client.0 _ll_register_callbacks cb 0x556d5b670f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b7675c0 0x556d5b7714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9c00640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b778530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 -- 172.21.15.31:0/2272968223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b7675c0 msgr2=0x556d5b7714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b7675c0 0x556d5b7714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 -- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 msgr2=0x556d5b778530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b778530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.322+0000 7f27d9200640 1 -- 172.21.15.31:0/2272968223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5b4aa620 con 0x556d5b766bd0 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.323+0000 7f27d9c00640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b778530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:55.326 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.323+0000 7f27d9200640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f27c4004700 tx=0x7f27c400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d760e804d8e4f4b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.323+0000 7f27b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.323+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4011e60 con 0x556d5b766bd0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.324+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27c4005220 con 0x556d5b766bd0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.324+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c80113e0 con 0x556d5b766bd0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.325+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27c402e050 con 0x556d5b766bd0 2024-06-02T22:48:55.327 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.325+0000 7f27debd6740 10 client.26011 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.325+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556d5b77b790 con 0x556d5b766bd0 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.327+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c80113e0 con 0x556d5b766bd0 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.327+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f27c401e7a0 con 0x556d5b766bd0 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.327+0000 7f27debd6740 10 client.26011 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.328+0000 7f27debd6740 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.328+0000 7f27debd6740 20 client.26011 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.328+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b77cf20 0x556d5b77f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.329+0000 7f27debd6740 4 client.26011 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:48:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.329+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d5b6d7b50 con 0x556d5b77cf20 2024-06-02T22:48:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.329+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b77cf20 0x556d5b77f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.330+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b77cf20 0x556d5b77f3a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f8a9342c76ba570 server_cookie=23a7f30ebfed5590 in_seq=0 out_seq=0 2024-06-02T22:48:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.330+0000 7f27b6a00640 10 client.26011 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.331+0000 7f27b6a00640 1 -- 172.21.15.31:0/2272968223 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556d5b6d7b50 con 0x556d5b77cf20 2024-06-02T22:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.331+0000 7f27b6a00640 10 client.26011 handle_command_reply: tid=0 2024-06-02T22:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.331+0000 7f27debd6740 1 client.26011 shutdown 2024-06-02T22:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.331+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 msgr2=0x556d5b770fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.331+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f27c4004700 tx=0x7f27c400b480 comp rx=0 tx=0).stop 2024-06-02T22:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 shutdown_connections 2024-06-02T22:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b77cf20 0x556d5b77f3a0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b778530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b7675c0 0x556d5b7714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27b6a00640 0 client.26011 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 --2- 172.21.15.31:0/2272968223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b766bd0 0x556d5b770fb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 >> 172.21.15.31:0/2272968223 conn(0x556d5b72ef80 msgr2=0x556d5b761810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 shutdown_connections 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 1 -- 172.21.15.31:0/2272968223 wait complete. 2024-06-02T22:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.332+0000 7f27debd6740 20 client.26011 trim_cache size 0 max 16384 2024-06-02T22:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.356+0000 7f27debd6740 1 Processor -- start 2024-06-02T22:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 -- start start 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b767e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b770bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41d2a50 con 0x556d5b76c730 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41d4590 con 0x556d5b766bd0 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27debd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41d3120 con 0x556d5b7675c0 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.357+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:53316/0 (socket says 172.21.15.31:53316) 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 -- 172.21.15.31:0/3643751402 learned_addr learned my addr 172.21.15.31:0/3643751402 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d9200640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b767e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b770bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 -- 172.21.15.31:0/3643751402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 msgr2=0x556d5b767e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b767e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 -- 172.21.15.31:0/3643751402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 msgr2=0x556d5b770bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b770bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 -- 172.21.15.31:0/3643751402 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5b77b5b0 con 0x556d5b7675c0 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d9c00640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b770bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.358+0000 7f27d3e00640 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27c8013890 tx=0x7f27c8011d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=176c6347bc22e47e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.359+0000 7f27c1600640 1 -- 172.21.15.31:0/3643751402 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8011e00 con 0x556d5b7675c0 2024-06-02T22:48:55.361 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.359+0000 7f27c1600640 1 -- 172.21.15.31:0/3643751402 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c8005040 con 0x556d5b7675c0 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.359+0000 7f27c1600640 1 -- 172.21.15.31:0/3643751402 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8011640 con 0x556d5b7675c0 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.359+0000 7f27debd6740 1 -- 172.21.15.31:0/3643751402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 msgr2=0x556d5b7784c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.359+0000 7f27debd6740 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f27c8013890 tx=0x7f27c8011d90 comp rx=0 tx=0).stop 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 -- 172.21.15.31:0/3643751402 shutdown_connections 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b770bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7784c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 --2- 172.21.15.31:0/3643751402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b767e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 -- 172.21.15.31:0/3643751402 >> 172.21.15.31:0/3643751402 conn(0x556d5b72ef80 msgr2=0x556d5b76bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 -- 172.21.15.31:0/3643751402 shutdown_connections 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 -- 172.21.15.31:0/3643751402 wait complete. 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.360+0000 7f27debd6740 1 -- start start 2024-06-02T22:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 Processor -- start 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b774f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b7e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41d3ec0 con 0x556d5b76c730 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41d37f0 con 0x556d5b766bd0 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f27d40735e0 con 0x556d5b7675c0 2024-06-02T22:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27debd6740 10 client.0 _ll_register_callbacks cb 0x7f27c4004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:53320/0 (socket says 172.21.15.31:53320) 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27d3e00640 1 -- 172.21.15.31:0/2328715704 learned_addr learned my addr 172.21.15.31:0/2328715704 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.361+0000 7f27d9200640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b774f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d9c00640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b7e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d3e00640 1 -- 172.21.15.31:0/2328715704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 msgr2=0x556d5b774f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b774f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d3e00640 1 -- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 msgr2=0x556d5b7e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b7e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.362+0000 7f27d3e00640 1 -- 172.21.15.31:0/2328715704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5b7785a0 con 0x556d5b7675c0 2024-06-02T22:48:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.363+0000 7f27d3e00640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f27c8011d60 tx=0x7f27c8011e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00d44728de0188e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:48:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.363+0000 7f27b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c803e020 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f27c8005400 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27c8005040 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27c80134e0 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27debd6740 10 client.26017 fetch_fsmap learned FSMap version 30 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.364+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556d5b7e70a0 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27c8005040 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f27c802d020 con 0x556d5b7675c0 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 10 client.26017 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 10 client.26017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 20 client.26017 populate_metadata read hostname 'smithi031' 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b7e7940 0x556d5b7e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 4 client.26017 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:48:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.365+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d5b6d1ea0 con 0x556d5b7e7940 2024-06-02T22:48:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.366+0000 7f27d9200640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b7e7940 0x556d5b7e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:48:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.367+0000 7f27d9200640 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b7e7940 0x556d5b7e9d60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504f28db38cb3947 server_cookie=3bb112b15dc0fc56 in_seq=0 out_seq=0 2024-06-02T22:48:55.367 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.367+0000 7f27b6a00640 10 client.26017 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.395+0000 7f27b6a00640 1 -- 172.21.15.31:0/2328715704 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556d5b6d1ea0 con 0x556d5b7e7940 2024-06-02T22:48:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.395+0000 7f27b6a00640 10 client.26017 handle_command_reply: tid=0 2024-06-02T22:48:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.395+0000 7f27debd6740 1 client.26017 shutdown 2024-06-02T22:48:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 msgr2=0x556d5b7754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f27c8011d60 tx=0x7f27c8011e90 comp rx=0 tx=0).stop 2024-06-02T22:48:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 shutdown_connections 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x556d5b7e7940 0x556d5b7e9d60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556d5b76c730 0x556d5b7e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d5b7675c0 0x556d5b7754d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 --2- 172.21.15.31:0/2328715704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556d5b766bd0 0x556d5b774f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 >> 172.21.15.31:0/2328715704 conn(0x556d5b72ef80 msgr2=0x556d5b7620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27b6a00640 0 client.26017 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 shutdown_connections 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.396+0000 7f27debd6740 1 -- 172.21.15.31:0/2328715704 wait complete. 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.397+0000 7f27debd6740 20 client.26017 trim_cache size 0 max 16384 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:48:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.397+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 msgr2=0x7f27bc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.397+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 0x7f27bc0a5260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b770 tx=0x7f27c400b700 comp rx=0 tx=0).stop 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.397+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 msgr2=0x7f27d41ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.397+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 0x7f27d41ae350 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f27cc034040 tx=0x7f27cc0305b0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 shutdown_connections 2024-06-02T22:48:55.399 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f27bc0a2da0 0x7f27bc0a5260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27d4105590 0x7f27d41ae350 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27d4102be0 0x7f27d410bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 --2- 172.21.15.31:0/3440665269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d4100270 0x7f27d410b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 >> 172.21.15.31:0/3440665269 conn(0x7f27d40fbe90 msgr2=0x7f27d4103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 shutdown_connections 2024-06-02T22:48:55.400 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:48:55.398+0000 7f27dbc00640 1 -- 172.21.15.31:0/3440665269 wait complete. 2024-06-02T22:48:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:55 smithi098 ceph-mon[36750]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 498 op/s 2024-06-02T22:48:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:55 smithi178 ceph-mon[36614]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 498 op/s 2024-06-02T22:48:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:55 smithi031 ceph-mon[31767]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.8 MiB/s wr, 498 op/s 2024-06-02T22:48:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:57 smithi098 ceph-mon[36750]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 437 op/s 2024-06-02T22:48:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:57 smithi178 ceph-mon[36614]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 437 op/s 2024-06-02T22:48:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:57 smithi031 ceph-mon[31767]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.7 MiB/s wr, 437 op/s 2024-06-02T22:48:59.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:58 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:48:59.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:58 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:48:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:58 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:49:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:48:59 smithi098 ceph-mon[36750]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-06-02T22:49:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 695.0 s, 504.0 tps, lat 209.349 ms stddev 290.165 2024-06-02T22:49:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:48:59 smithi178 ceph-mon[36614]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-06-02T22:49:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:48:59 smithi031 ceph-mon[31767]: pgmap v871: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.0 MiB/s wr, 534 op/s 2024-06-02T22:49:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:01 smithi098 ceph-mon[36750]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 489 op/s 2024-06-02T22:49:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:49:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:49:02.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:01 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:49:02.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:01 smithi178 ceph-mon[36614]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 489 op/s 2024-06-02T22:49:02.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:49:02.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:49:02.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:01 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:49:02.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:01 smithi031 ceph-mon[31767]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.6 MiB/s wr, 489 op/s 2024-06-02T22:49:02.375 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:49:02.375 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:49:02.375 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:01 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:49:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:03 smithi178 ceph-mon[36614]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 516 op/s 2024-06-02T22:49:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:03 smithi031 ceph-mon[31767]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 516 op/s 2024-06-02T22:49:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:03 smithi098 ceph-mon[36750]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.9 MiB/s wr, 516 op/s 2024-06-02T22:49:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 700.0 s, 568.8 tps, lat 170.809 ms stddev 185.962 2024-06-02T22:49:06.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:05 smithi178 ceph-mon[36614]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2024-06-02T22:49:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:05 smithi031 ceph-mon[31767]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2024-06-02T22:49:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:05 smithi098 ceph-mon[36750]: pgmap v874: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.2 MiB/s wr, 490 op/s 2024-06-02T22:49:08.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:07 smithi178 ceph-mon[36614]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-06-02T22:49:08.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:07 smithi031 ceph-mon[31767]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-06-02T22:49:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:07 smithi098 ceph-mon[36750]: pgmap v875: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-06-02T22:49:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.578+0000 7fe76a400640 1 -- 172.21.15.31:0/3241074261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410b310 msgr2=0x7fe76410d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.578+0000 7fe76a400640 1 --2- 172.21.15.31:0/3241074261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410b310 0x7fe76410d780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe754009900 tx=0x7fe75402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.582+0000 7fe76a400640 1 -- 172.21.15.31:0/3241074261 shutdown_connections 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.582+0000 7fe76a400640 1 --2- 172.21.15.31:0/3241074261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76410dcc0 0x7fe76410e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.582+0000 7fe76a400640 1 --2- 172.21.15.31:0/3241074261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410b310 0x7fe76410d780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.582+0000 7fe76a400640 1 --2- 172.21.15.31:0/3241074261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe76410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.582+0000 7fe76a400640 1 -- 172.21.15.31:0/3241074261 >> 172.21.15.31:0/3241074261 conn(0x7fe76406ea10 msgr2=0x7fe764070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.583+0000 7fe76a400640 1 -- 172.21.15.31:0/3241074261 shutdown_connections 2024-06-02T22:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.583+0000 7fe76a400640 1 -- 172.21.15.31:0/3241074261 wait complete. 2024-06-02T22:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.585+0000 7fe76a400640 1 Processor -- start 2024-06-02T22:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.585+0000 7fe76a400640 1 -- start start 2024-06-02T22:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76410b310 0x7fe7641a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410dcc0 0x7fe7641adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe76411c4e0 con 0x7fe76410b310 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe76411c360 con 0x7fe76410dcc0 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe76a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe76411c660 con 0x7fe7641089a0 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49304/0 (socket says 172.21.15.31:49304) 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 -- 172.21.15.31:0/4094938617 learned_addr learned my addr 172.21.15.31:0/4094938617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763e00640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410dcc0 0x7fe7641adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 -- 172.21.15.31:0/4094938617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410dcc0 msgr2=0x7fe7641adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410dcc0 0x7fe7641adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 -- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76410b310 msgr2=0x7fe7641a6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.586+0000 7fe763400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76410b310 0x7fe7641a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.587+0000 7fe763400640 1 -- 172.21.15.31:0/4094938617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7641ae630 con 0x7fe7641089a0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.587+0000 7fe763400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009f20 tx=0x7fe74c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.587+0000 7fe75be00640 1 -- 172.21.15.31:0/4094938617 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00cd80 con 0x7fe7641089a0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.587+0000 7fe75be00640 1 -- 172.21.15.31:0/4094938617 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe74c021920 con 0x7fe7641089a0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.588+0000 7fe75be00640 1 -- 172.21.15.31:0/4094938617 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c029960 con 0x7fe7641089a0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.588+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe764110130 con 0x7fe7641089a0 2024-06-02T22:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.588+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641106d0 con 0x7fe7641089a0 2024-06-02T22:49:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.592+0000 7fe76d20b740 1 Processor -- start 2024-06-02T22:49:08.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.593+0000 7fe76d20b740 1 -- start start 2024-06-02T22:49:08.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.595+0000 7fe75be00640 1 -- 172.21.15.31:0/4094938617 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe74c021ad0 con 0x7fe7641089a0 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.595+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca541ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.595+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.595+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca549bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe76d20b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca4a5420 con 0x55d1ca541bd0 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe76d20b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca44cc50 con 0x55d1ca547730 2024-06-02T22:49:08.596 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe76d20b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca4a13e0 con 0x55d1ca5425c0 2024-06-02T22:49:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe762a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca549bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe762a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca549bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:41054/0 (socket says 172.21.15.31:41054) 2024-06-02T22:49:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49308/0 (socket says 172.21.15.31:49308) 2024-06-02T22:49:08.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.596+0000 7fe762a00640 1 -- 172.21.15.31:0/1676556644 learned_addr learned my addr 172.21.15.31:0/1676556644 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:08.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.597+0000 7fe763400640 1 -- 172.21.15.31:0/1676556644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 msgr2=0x55d1ca549bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.597+0000 7fe763400640 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca549bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.597+0000 7fe763400640 1 -- 172.21.15.31:0/1676556644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 msgr2=0x55d1ca541ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:49:08.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.597+0000 7fe75be00640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 0x7fe7480a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.598 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.598+0000 7fe75be00640 1 -- 172.21.15.31:0/4094938617 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe74c0e08d0 con 0x7fe7641089a0 2024-06-02T22:49:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.599+0000 7fe763e00640 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca541ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.599+0000 7fe763400640 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca541ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.599+0000 7fe763400640 1 -- 172.21.15.31:0/1676556644 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ca1b9210 con 0x55d1ca5425c0 2024-06-02T22:49:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.601+0000 7fe763400640 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0de010 tx=0x7fe74c00efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ba5d3c3d96a5e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.601+0000 7fe762a00640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 0x7fe7480a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.601+0000 7fe758c00640 1 -- 172.21.15.31:0/1676556644 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0ac700 con 0x55d1ca5425c0 2024-06-02T22:49:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.602+0000 7fe758c00640 1 -- 172.21.15.31:0/1676556644 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe74c0e2e50 con 0x55d1ca5425c0 2024-06-02T22:49:08.602 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.602+0000 7fe758c00640 1 -- 172.21.15.31:0/1676556644 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0b5a10 con 0x55d1ca5425c0 2024-06-02T22:49:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.603+0000 7fe76d20b740 1 -- 172.21.15.31:0/1676556644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 msgr2=0x55d1ca5470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.603+0000 7fe76d20b740 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0de010 tx=0x7fe74c00efb0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.604+0000 7fe762a00640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 0x7fe7480a5170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe754031610 tx=0x7fe754031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 -- 172.21.15.31:0/1676556644 shutdown_connections 2024-06-02T22:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca549bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca5470c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 --2- 172.21.15.31:0/1676556644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca541ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 -- 172.21.15.31:0/1676556644 >> 172.21.15.31:0/1676556644 conn(0x55d1ca509f80 msgr2=0x55d1ca53d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 -- 172.21.15.31:0/1676556644 shutdown_connections 2024-06-02T22:49:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.605+0000 7fe76d20b740 1 -- 172.21.15.31:0/1676556644 wait complete. 2024-06-02T22:49:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.606+0000 7fe76d20b740 1 -- start start 2024-06-02T22:49:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.606+0000 7fe76d20b740 1 Processor -- start 2024-06-02T22:49:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca54be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca54c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca553400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca54a680 con 0x55d1ca541bd0 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca4600b0 con 0x55d1ca547730 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d1ca54a800 con 0x55d1ca5425c0 2024-06-02T22:49:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.609+0000 7fe76d20b740 10 client.0 _ll_register_callbacks cb 0x55d1ca44bf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.610+0000 7fe763e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca553400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.610+0000 7fe763e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca553400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:41056/0 (socket says 172.21.15.31:41056) 2024-06-02T22:49:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.610+0000 7fe763e00640 1 -- 172.21.15.31:0/3557592237 learned_addr learned my addr 172.21.15.31:0/3557592237 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.610+0000 7fe762a00640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca54c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.611+0000 7fe762a00640 1 -- 172.21.15.31:0/3557592237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 msgr2=0x55d1ca553400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.611+0000 7fe762a00640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca553400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.611+0000 7fe762a00640 1 -- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 msgr2=0x55d1ca54be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.611+0000 7fe762a00640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca54be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.611+0000 7fe762a00640 1 -- 172.21.15.31:0/3557592237 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ca285620 con 0x55d1ca5425c0 2024-06-02T22:49:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.617+0000 7fe751600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.617+0000 7fe762a00640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca54c3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d1ca53e500 tx=0x7fe754005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd70d93f21cd6c6e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.618+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754042070 con 0x55d1ca5425c0 2024-06-02T22:49:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.620+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe754004b90 con 0x55d1ca5425c0 2024-06-02T22:49:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.620+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe74c0e2e50 con 0x55d1ca5425c0 2024-06-02T22:49:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.623+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe754042070 con 0x55d1ca5425c0 2024-06-02T22:49:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.623+0000 7fe76d20b740 10 client.26029 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.623+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1ca556830 con 0x55d1ca5425c0 2024-06-02T22:49:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.624+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe75404e070 con 0x55d1ca5425c0 2024-06-02T22:49:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe75403a040 con 0x55d1ca5425c0 2024-06-02T22:49:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 10 client.26029 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 10 client.26029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 20 client.26029 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca557fc0 0x55d1ca55a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 4 client.26029 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:49:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.627+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe74c0e2e50 con 0x55d1ca557fc0 2024-06-02T22:49:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.630+0000 7fe763400640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca557fc0 0x55d1ca55a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.631+0000 7fe763400640 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca557fc0 0x55d1ca55a3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af190eb46fc71ce server_cookie=8c5cbd1407923f4d in_seq=0 out_seq=0 2024-06-02T22:49:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.631+0000 7fe751600640 10 client.26029 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.632+0000 7fe751600640 1 -- 172.21.15.31:0/3557592237 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7fe74c0e2e50 con 0x55d1ca557fc0 2024-06-02T22:49:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.632+0000 7fe751600640 10 client.26029 handle_command_reply: tid=0 2024-06-02T22:49:08.634 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.632+0000 7fe76d20b740 1 client.26029 shutdown 2024-06-02T22:49:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.636+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 msgr2=0x55d1ca54c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.636+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca54c3c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d1ca53e500 tx=0x7fe754005fd0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 shutdown_connections 2024-06-02T22:49:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca557fc0 0x55d1ca55a3f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.638 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca547730 0x55d1ca553400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca5425c0 0x55d1ca54c3c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 --2- 172.21.15.31:0/3557592237 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca541bd0 0x55d1ca54be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe751600640 0 client.26029 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.637+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 >> 172.21.15.31:0/3557592237 conn(0x55d1ca509f80 msgr2=0x55d1ca53c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.638+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 shutdown_connections 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.638+0000 7fe76d20b740 1 -- 172.21.15.31:0/3557592237 wait complete. 2024-06-02T22:49:08.639 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.639+0000 7fe76d20b740 20 client.26029 trim_cache size 0 max 16384 2024-06-02T22:49:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.685+0000 7fe76d20b740 1 Processor -- start 2024-06-02T22:49:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.686+0000 7fe76d20b740 1 -- start start 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.686+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 0x55d1ca5533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 0x55d1ca540ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe76d20b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b0ac0 con 0x55d1ca547730 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe76d20b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b2600 con 0x55d1ca5425c0 2024-06-02T22:49:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe76d20b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b1190 con 0x55d1ca541bd0 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe763e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 0x55d1ca540ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe763400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49332/0 (socket says 172.21.15.31:49332) 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe763e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 0x55d1ca540ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55162/0 (socket says 172.21.15.31:55162) 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.687+0000 7fe763e00640 1 -- 172.21.15.31:0/354926363 learned_addr learned my addr 172.21.15.31:0/354926363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.688+0000 7fe762a00640 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 0x55d1ca5533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.688+0000 7fe763400640 1 -- 172.21.15.31:0/354926363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 msgr2=0x55d1ca5533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.688+0000 7fe763400640 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 0x55d1ca5533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.688+0000 7fe763400640 1 -- 172.21.15.31:0/354926363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 msgr2=0x55d1ca540ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.691+0000 7fe763400640 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 0x55d1ca540ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.691 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.691+0000 7fe763400640 1 -- 172.21.15.31:0/354926363 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ca538ff0 con 0x55d1ca541bd0 2024-06-02T22:49:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.691+0000 7fe762a00640 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 0x55d1ca5533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:49:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.691+0000 7fe763400640 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0acce0 tx=0x7fe74c0acc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c0c30b37873a576 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.692+0000 7fe753e00640 1 -- 172.21.15.31:0/354926363 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0ad4a0 con 0x55d1ca541bd0 2024-06-02T22:49:08.692 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.692+0000 7fe753e00640 1 -- 172.21.15.31:0/354926363 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe74c0b5a10 con 0x55d1ca541bd0 2024-06-02T22:49:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.692+0000 7fe753e00640 1 -- 172.21.15.31:0/354926363 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0ac1f0 con 0x55d1ca541bd0 2024-06-02T22:49:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 -- 172.21.15.31:0/354926363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 msgr2=0x55d1ca540590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.693 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0acce0 tx=0x7fe74c0acc70 comp rx=0 tx=0).stop 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 -- 172.21.15.31:0/354926363 shutdown_connections 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca547730 0x55d1ca540ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca5425c0 0x55d1ca5533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 --2- 172.21.15.31:0/354926363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca541bd0 0x55d1ca540590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.693+0000 7fe76d20b740 1 -- 172.21.15.31:0/354926363 >> 172.21.15.31:0/354926363 conn(0x55d1ca509f80 msgr2=0x55d1ca5438a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.694+0000 7fe76d20b740 1 -- 172.21.15.31:0/354926363 shutdown_connections 2024-06-02T22:49:08.694 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.694+0000 7fe76d20b740 1 -- 172.21.15.31:0/354926363 wait complete. 2024-06-02T22:49:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.695+0000 7fe76d20b740 1 -- start start 2024-06-02T22:49:08.695 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.695+0000 7fe76d20b740 1 Processor -- start 2024-06-02T22:49:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.696+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 0x55d1ca550be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.696 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.696+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca5425c0 0x55d1ca551120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.696+0000 7fe76d20b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 0x55d1ca552130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe76d20b740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b1f30 con 0x55d1ca5425c0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 0x55d1ca550be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 0x55d1ca550be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:41082/0 (socket says 172.21.15.31:41082) 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763400640 1 -- 172.21.15.31:0/197782625 learned_addr learned my addr 172.21.15.31:0/197782625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641b1860 con 0x55d1ca541bd0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe7641aeaa0 con 0x55d1ca547730 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763e00640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 0x55d1ca552130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe76d20b740 10 client.0 _ll_register_callbacks cb 0x7fe74c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe762a00640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca5425c0 0x55d1ca551120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763e00640 1 -- 172.21.15.31:0/197782625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 msgr2=0x55d1ca550be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763e00640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 0x55d1ca550be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763e00640 1 -- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca5425c0 msgr2=0x55d1ca551120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.697+0000 7fe763e00640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca5425c0 0x55d1ca551120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.698+0000 7fe763e00640 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ca552720 con 0x55d1ca547730 2024-06-02T22:49:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.699+0000 7fe763e00640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 0x55d1ca552130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe75c013960 tx=0x7fe75c013e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c5d093d4ea0899e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.699+0000 7fe751600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.699+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c011b30 con 0x55d1ca547730 2024-06-02T22:49:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.700+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe75c011cd0 con 0x55d1ca547730 2024-06-02T22:49:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.700+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe74c0b5a10 con 0x55d1ca547730 2024-06-02T22:49:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.702+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe75c004b20 con 0x55d1ca547730 2024-06-02T22:49:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.702+0000 7fe76d20b740 10 client.26035 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.702+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d1ca5c2e80 con 0x55d1ca547730 2024-06-02T22:49:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe74c0b5a10 con 0x55d1ca547730 2024-06-02T22:49:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fe75c00f040 con 0x55d1ca547730 2024-06-02T22:49:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 10 client.26035 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 20 client.26035 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca5c3890 0x55d1ca5c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 4 client.26035 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.703+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1ca4b2b50 con 0x55d1ca5c3890 2024-06-02T22:49:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.704+0000 7fe763400640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca5c3890 0x55d1ca5c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.705+0000 7fe763400640 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca5c3890 0x55d1ca5c5cb0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f6418654ba3ca6 server_cookie=2f838add8c163090 in_seq=0 out_seq=0 2024-06-02T22:49:08.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.705+0000 7fe751600640 10 client.26035 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.861+0000 7fe751600640 1 -- 172.21.15.31:0/197782625 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d1ca4b2b50 con 0x55d1ca5c3890 2024-06-02T22:49:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.861+0000 7fe751600640 10 client.26035 handle_command_reply: tid=0 2024-06-02T22:49:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 client.26035 shutdown 2024-06-02T22:49:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 msgr2=0x55d1ca552130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 0x55d1ca552130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe75c013960 tx=0x7fe75c013e20 comp rx=0 tx=0).stop 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 shutdown_connections 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d1ca5c3890 0x55d1ca5c5cb0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1ca547730 0x55d1ca552130 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d1ca5425c0 0x55d1ca551120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 --2- 172.21.15.31:0/197782625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d1ca541bd0 0x55d1ca550be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 >> 172.21.15.31:0/197782625 conn(0x55d1ca509f80 msgr2=0x55d1ca540590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe751600640 0 client.26035 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 shutdown_connections 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.862+0000 7fe76d20b740 1 -- 172.21.15.31:0/197782625 wait complete. 2024-06-02T22:49:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.863+0000 7fe76d20b740 20 client.26035 trim_cache size 0 max 16384 2024-06-02T22:49:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:49:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:49:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:49:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.863+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 msgr2=0x7fe7480a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.863+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 0x7fe7480a5170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe754031610 tx=0x7fe754031400 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.863+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 msgr2=0x7fe7641a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.863+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009f20 tx=0x7fe74c00ee80 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 shutdown_connections 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7480a2cb0 0x7fe7480a5170 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe76410dcc0 0x7fe7641adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe76410b310 0x7fe7641a6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 --2- 172.21.15.31:0/4094938617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7641089a0 0x7fe7641a6a60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 >> 172.21.15.31:0/4094938617 conn(0x7fe76406ea10 msgr2=0x7fe76410ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 shutdown_connections 2024-06-02T22:49:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:08.864+0000 7fe76a400640 1 -- 172.21.15.31:0/4094938617 wait complete. 2024-06-02T22:49:10.225 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 705.0 s, 498.6 tps, lat 203.827 ms stddev 243.355 2024-06-02T22:49:10.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:09 smithi178 ceph-mon[36614]: pgmap v876: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.2 MiB/s wr, 560 op/s 2024-06-02T22:49:10.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:09 smithi031 ceph-mon[31767]: pgmap v876: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.2 MiB/s wr, 560 op/s 2024-06-02T22:49:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:09 smithi098 ceph-mon[36750]: pgmap v876: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 6.2 MiB/s wr, 560 op/s 2024-06-02T22:49:12.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:11 smithi178 ceph-mon[36614]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-06-02T22:49:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:11 smithi031 ceph-mon[31767]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-06-02T22:49:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:11 smithi098 ceph-mon[36750]: pgmap v877: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.4 MiB/s wr, 513 op/s 2024-06-02T22:49:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:14 smithi178 ceph-mon[36614]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-06-02T22:49:14.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:13 smithi031 ceph-mon[31767]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-06-02T22:49:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:14 smithi098 ceph-mon[36750]: pgmap v878: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.0 MiB/s wr, 559 op/s 2024-06-02T22:49:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 710.0 s, 540.9 tps, lat 174.753 ms stddev 237.823 2024-06-02T22:49:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:16 smithi178 ceph-mon[36614]: pgmap v879: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2024-06-02T22:49:16.370 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:16 smithi031 ceph-mon[31767]: pgmap v879: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2024-06-02T22:49:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:16 smithi098 ceph-mon[36750]: pgmap v879: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.7 MiB/s wr, 560 op/s 2024-06-02T22:49:18.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:18 smithi178 ceph-mon[36614]: pgmap v880: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.5 MiB/s wr, 438 op/s 2024-06-02T22:49:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:18 smithi031 ceph-mon[31767]: pgmap v880: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.5 MiB/s wr, 438 op/s 2024-06-02T22:49:18.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:18 smithi098 ceph-mon[36750]: pgmap v880: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.5 MiB/s wr, 438 op/s 2024-06-02T22:49:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 715.0 s, 485.7 tps, lat 214.741 ms stddev 263.714 2024-06-02T22:49:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:20 smithi178 ceph-mon[36614]: pgmap v881: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-06-02T22:49:20.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:20 smithi031 ceph-mon[31767]: pgmap v881: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-06-02T22:49:20.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:20 smithi098 ceph-mon[36750]: pgmap v881: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.3 MiB/s wr, 574 op/s 2024-06-02T22:49:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.070+0000 7f9e16400640 1 -- 172.21.15.31:0/693039444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10108030 msgr2=0x7f9e10108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.070+0000 7f9e16400640 1 --2- 172.21.15.31:0/693039444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10108030 0x7f9e10108450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9e0001a910 tx=0x7f9e0003b450 comp rx=0 tx=0).stop 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 -- 172.21.15.31:0/693039444 shutdown_connections 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 --2- 172.21.15.31:0/693039444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10109be0 0x7f9e10110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 --2- 172.21.15.31:0/693039444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e10109220 0x7f9e101096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 --2- 172.21.15.31:0/693039444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10108030 0x7f9e10108450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 -- 172.21.15.31:0/693039444 >> 172.21.15.31:0/693039444 conn(0x7f9e10076ff0 msgr2=0x7f9e10079410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.071+0000 7f9e16400640 1 -- 172.21.15.31:0/693039444 shutdown_connections 2024-06-02T22:49:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.072+0000 7f9e16400640 1 -- 172.21.15.31:0/693039444 wait complete. 2024-06-02T22:49:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.074+0000 7f9e16400640 1 Processor -- start 2024-06-02T22:49:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 -- start start 2024-06-02T22:49:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 0x7f9e10195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e10109be0 0x7f9e1019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1006e010 con 0x7f9e10109be0 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1006de90 con 0x7f9e10108030 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.075+0000 7f9e16400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1006e190 con 0x7f9e10109220 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.076+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.076+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39714/0 (socket says 172.21.15.31:39714) 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.076+0000 7f9e0ea00640 1 -- 172.21.15.31:0/3434814373 learned_addr learned my addr 172.21.15.31:0/3434814373 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:22.077 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.076+0000 7f9e0f400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 0x7f9e10195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 -- 172.21.15.31:0/3434814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 msgr2=0x7f9e10195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 0x7f9e10195ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 -- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e10109be0 msgr2=0x7f9e1019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e10109be0 0x7f9e1019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 -- 172.21.15.31:0/3434814373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1019d650 con 0x7f9e10109220 2024-06-02T22:49:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0f400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 0x7f9e10195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:49:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.078+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d950 tx=0x7f9dfc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.079+0000 7f9e07e00640 1 -- 172.21.15.31:0/3434814373 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc017070 con 0x7f9e10109220 2024-06-02T22:49:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.079+0000 7f9e07e00640 1 -- 172.21.15.31:0/3434814373 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dfc009c30 con 0x7f9e10109220 2024-06-02T22:49:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.079+0000 7f9e07e00640 1 -- 172.21.15.31:0/3434814373 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00f690 con 0x7f9e10109220 2024-06-02T22:49:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.079+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1019d940 con 0x7f9e10109220 2024-06-02T22:49:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.079+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1019de40 con 0x7f9e10109220 2024-06-02T22:49:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 Processor -- start 2024-06-02T22:49:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 -- start start 2024-06-02T22:49:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539ebd0 0x55d63539eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6353a4730 0x55d6353a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d635302420 con 0x55d63539ebd0 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.086+0000 7f9e191cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d6352a9c50 con 0x55d6353a4730 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.087+0000 7f9e191cb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6352fe3e0 con 0x55d63539f5c0 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.087+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.087+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39718/0 (socket says 172.21.15.31:39718) 2024-06-02T22:49:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.087+0000 7f9e0f400640 1 -- 172.21.15.31:0/1546803142 learned_addr learned my addr 172.21.15.31:0/1546803142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.087+0000 7f9e07e00640 1 -- 172.21.15.31:0/3434814373 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f9dfc0109d0 con 0x7f9e10109220 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539ebd0 0x55d63539eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6353a4730 0x55d6353a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0f400640 1 -- 172.21.15.31:0/1546803142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6353a4730 msgr2=0x55d6353a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6353a4730 0x55d6353a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0f400640 1 -- 172.21.15.31:0/1546803142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539ebd0 msgr2=0x55d63539eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539ebd0 0x55d63539eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.088+0000 7f9e0f400640 1 -- 172.21.15.31:0/1546803142 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d635016210 con 0x55d63539f5c0 2024-06-02T22:49:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.089+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000c00 tx=0x7f9e00004800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3417c6d539cc537 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.090+0000 7f9e04c00640 1 -- 172.21.15.31:0/1546803142 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00051020 con 0x55d63539f5c0 2024-06-02T22:49:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.090+0000 7f9e04c00640 1 -- 172.21.15.31:0/1546803142 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e000049f0 con 0x55d63539f5c0 2024-06-02T22:49:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.090+0000 7f9e04c00640 1 -- 172.21.15.31:0/1546803142 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00046070 con 0x55d63539f5c0 2024-06-02T22:49:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.090+0000 7f9e07e00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 0x7f9df40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.090+0000 7f9e07e00640 1 -- 172.21.15.31:0/3434814373 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9dfc0cee60 con 0x7f9e10109220 2024-06-02T22:49:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.091+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 0x7f9df40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 -- 172.21.15.31:0/1546803142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 msgr2=0x55d6353a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9e00000c00 tx=0x7f9e00004800 comp rx=0 tx=0).stop 2024-06-02T22:49:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 0x7f9df40a51c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009270 tx=0x7f9e080095e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 -- 172.21.15.31:0/1546803142 shutdown_connections 2024-06-02T22:49:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6353a4730 0x55d6353a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539f5c0 0x55d6353a40c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1546803142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539ebd0 0x55d63539eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 -- 172.21.15.31:0/1546803142 >> 172.21.15.31:0/1546803142 conn(0x55d635366f80 msgr2=0x55d63539a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.092+0000 7f9e191cb740 1 -- 172.21.15.31:0/1546803142 shutdown_connections 2024-06-02T22:49:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.094+0000 7f9e191cb740 1 -- 172.21.15.31:0/1546803142 wait complete. 2024-06-02T22:49:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.094+0000 7f9e191cb740 1 -- start start 2024-06-02T22:49:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.095+0000 7f9e191cb740 1 Processor -- start 2024-06-02T22:49:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.095+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353a8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.095+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353b0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e191cb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d6353a7680 con 0x55d6353a4730 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e191cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d6352bd0b0 con 0x55d63539f5c0 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e191cb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d6353a7800 con 0x55d63539ebd0 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e191cb740 10 client.0 _ll_register_callbacks cb 0x55d6352a8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:44086/0 (socket says 172.21.15.31:44086) 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 -- 172.21.15.31:0/2039181331 learned_addr learned my addr 172.21.15.31:0/2039181331 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 -- 172.21.15.31:0/2039181331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 msgr2=0x55d6353a8eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353a8eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.097 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 -- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 msgr2=0x55d6353b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.096+0000 7f9e0ea00640 1 -- 172.21.15.31:0/2039181331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6350e2620 con 0x55d63539f5c0 2024-06-02T22:49:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.097+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc097c70 tx=0x7f9dfc005f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4a5a6fa3c7f1ac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.097+0000 7f9df9600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:49:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.098+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc099470 con 0x55d63539f5c0 2024-06-02T22:49:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.098+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9dfc019dc0 con 0x55d63539f5c0 2024-06-02T22:49:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.098+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e000049f0 con 0x55d63539f5c0 2024-06-02T22:49:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.099+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9dfc009de0 con 0x55d63539f5c0 2024-06-02T22:49:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.099+0000 7f9e191cb740 10 client.26069 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.099+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d6353b3810 con 0x55d63539f5c0 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.099+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e000049f0 con 0x55d63539f5c0 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.099+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9dfc09a780 con 0x55d63539f5c0 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 10 client.26069 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 20 client.26069 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6353b5350 0x55d6353b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 4 client.26069 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:49:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.100+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63530fb50 con 0x55d6353b5350 2024-06-02T22:49:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.101+0000 7f9e0f400640 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6353b5350 0x55d6353b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.102+0000 7f9df9600640 10 client.26069 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.102+0000 7f9e0f400640 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6353b5350 0x55d6353b77f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb3953785469466 server_cookie=c28afb455adffc in_seq=0 out_seq=0 2024-06-02T22:49:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.103+0000 7f9df9600640 1 -- 172.21.15.31:0/2039181331 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d63530fb50 con 0x55d6353b5350 2024-06-02T22:49:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.103+0000 7f9df9600640 10 client.26069 handle_command_reply: tid=0 2024-06-02T22:49:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.103+0000 7f9e191cb740 1 client.26069 shutdown 2024-06-02T22:49:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 msgr2=0x55d6353a93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc097c70 tx=0x7f9dfc005f70 comp rx=0 tx=0).stop 2024-06-02T22:49:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 shutdown_connections 2024-06-02T22:49:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6353b5350 0x55d6353b77f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353a93f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 --2- 172.21.15.31:0/2039181331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353a8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.104+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 >> 172.21.15.31:0/2039181331 conn(0x55d635366f80 msgr2=0x55d635399810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.105+0000 7f9df9600640 0 client.26069 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.108+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 shutdown_connections 2024-06-02T22:49:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.108+0000 7f9e191cb740 1 -- 172.21.15.31:0/2039181331 wait complete. 2024-06-02T22:49:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.108+0000 7f9e191cb740 20 client.26069 trim_cache size 0 max 16384 2024-06-02T22:49:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.127+0000 7f9e191cb740 1 Processor -- start 2024-06-02T22:49:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 -- start start 2024-06-02T22:49:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539ebd0 0x55d63539a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539f5c0 0x55d6353b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101a84c0 con 0x55d63539f5c0 2024-06-02T22:49:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101aa000 con 0x55d63539ebd0 2024-06-02T22:49:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.129+0000 7f9e191cb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101a8b90 con 0x55d6353a4730 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39746/0 (socket says 172.21.15.31:39746) 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 -- 172.21.15.31:0/146669873 learned_addr learned my addr 172.21.15.31:0/146669873 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0f400640 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539ebd0 0x55d63539a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 -- 172.21.15.31:0/146669873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539ebd0 msgr2=0x55d63539a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539ebd0 0x55d63539a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 -- 172.21.15.31:0/146669873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539f5c0 msgr2=0x55d6353b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539f5c0 0x55d6353b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.130+0000 7f9e0fe00640 1 -- 172.21.15.31:0/146669873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6353a03d0 con 0x55d6353a4730 2024-06-02T22:49:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.131+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9e080125e0 tx=0x7f9e08014070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e432cf7476dc5163 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.131+0000 7f9dfbe00640 1 -- 172.21.15.31:0/146669873 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801f7a0 con 0x55d6353a4730 2024-06-02T22:49:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.131+0000 7f9dfbe00640 1 -- 172.21.15.31:0/146669873 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e0801fe20 con 0x55d6353a4730 2024-06-02T22:49:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.132+0000 7f9dfbe00640 1 -- 172.21.15.31:0/146669873 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801d3b0 con 0x55d6353a4730 2024-06-02T22:49:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.132+0000 7f9e191cb740 1 -- 172.21.15.31:0/146669873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 msgr2=0x55d6353a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.132+0000 7f9e191cb740 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9e080125e0 tx=0x7f9e08014070 comp rx=0 tx=0).stop 2024-06-02T22:49:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 -- 172.21.15.31:0/146669873 shutdown_connections 2024-06-02T22:49:22.133 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6353a4730 0x55d6353a84d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d63539f5c0 0x55d6353b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 --2- 172.21.15.31:0/146669873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539ebd0 0x55d63539a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 -- 172.21.15.31:0/146669873 >> 172.21.15.31:0/146669873 conn(0x55d635366f80 msgr2=0x55d63539a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 -- 172.21.15.31:0/146669873 shutdown_connections 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.133+0000 7f9e191cb740 1 -- 172.21.15.31:0/146669873 wait complete. 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.134+0000 7f9e191cb740 1 -- start start 2024-06-02T22:49:22.134 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.134+0000 7f9e191cb740 1 Processor -- start 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101a9930 con 0x55d6353a4730 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101a9260 con 0x55d63539f5c0 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9e101a64a0 con 0x55d63539ebd0 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e191cb740 10 client.0 _ll_register_callbacks cb 0x7f9dfc00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39756/0 (socket says 172.21.15.31:39756) 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0f400640 1 -- 172.21.15.31:0/1764373472 learned_addr learned my addr 172.21.15.31:0/1764373472 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.135+0000 7f9e0f400640 1 -- 172.21.15.31:0/1764373472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 msgr2=0x55d6353adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0f400640 1 -- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 msgr2=0x55d6353aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0f400640 1 -- 172.21.15.31:0/1764373472 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6353af190 con 0x55d63539ebd0 2024-06-02T22:49:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0fe00640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e0f400640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e0001a910 tx=0x7f9e000047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4feabc8c385883b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9df9600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00051040 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e0801fe20 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9e000049f0 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9e0006e050 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e191cb740 10 client.26050 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.136+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d6353b04a0 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e0801fe20 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9e0004b040 con 0x55d63539ebd0 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 10 client.26050 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 10 client.26050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:22.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 20 client.26050 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6354201b0 0x55d6354225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 4 client.26050 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.137+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6353a8ca0 con 0x55d6354201b0 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.138+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6354201b0 0x55d6354225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.138+0000 7f9df9600640 10 client.26050 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.138+0000 7f9e0ea00640 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6354201b0 0x55d6354225d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c390b28593872d server_cookie=c4a4488f68a18087 in_seq=0 out_seq=0 2024-06-02T22:49:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:22 smithi178 ceph-mon[36614]: pgmap v882: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.2 MiB/s wr, 507 op/s 2024-06-02T22:49:22.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:22 smithi031 ceph-mon[31767]: pgmap v882: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.2 MiB/s wr, 507 op/s 2024-06-02T22:49:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.427+0000 7f9df9600640 1 -- 172.21.15.31:0/1764373472 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d6353a8ca0 con 0x55d6354201b0 2024-06-02T22:49:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.427+0000 7f9df9600640 10 client.26050 handle_command_reply: tid=0 2024-06-02T22:49:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.427+0000 7f9e191cb740 1 client.26050 shutdown 2024-06-02T22:49:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 msgr2=0x55d6353ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9e0001a910 tx=0x7f9e000047e0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 shutdown_connections 2024-06-02T22:49:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d6354201b0 0x55d6354225d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6353a4730 0x55d6353aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d63539f5c0 0x55d6353adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 --2- 172.21.15.31:0/1764373472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d63539ebd0 0x55d6353ad650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 >> 172.21.15.31:0/1764373472 conn(0x55d635366f80 msgr2=0x55d63539a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9df9600640 0 client.26050 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 shutdown_connections 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.428+0000 7f9e191cb740 1 -- 172.21.15.31:0/1764373472 wait complete. 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.429+0000 7f9e191cb740 20 client.26050 trim_cache size 0 max 16384 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:49:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.429+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 msgr2=0x7f9df40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.429+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 0x7f9df40a51c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009270 tx=0x7f9e080095e0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.429+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 msgr2=0x7f9e10196530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.429+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00d950 tx=0x7f9dfc00de10 comp rx=0 tx=0).stop 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 shutdown_connections 2024-06-02T22:49:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9df40a2d00 0x7f9df40a51c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e10109be0 0x7f9e1019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e10109220 0x7f9e10196530 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 --2- 172.21.15.31:0/3434814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e10108030 0x7f9e10195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.430+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 >> 172.21.15.31:0/3434814373 conn(0x7f9e10076ff0 msgr2=0x7f9e100709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.431+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 shutdown_connections 2024-06-02T22:49:22.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:22.431+0000 7f9e16400640 1 -- 172.21.15.31:0/3434814373 wait complete. 2024-06-02T22:49:22.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:22 smithi098 ceph-mon[36750]: pgmap v882: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.2 MiB/s wr, 507 op/s 2024-06-02T22:49:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:24 smithi031 ceph-mon[31767]: pgmap v883: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 535 op/s 2024-06-02T22:49:24.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:24 smithi098 ceph-mon[36750]: pgmap v883: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 535 op/s 2024-06-02T22:49:24.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:24 smithi178 ceph-mon[36614]: pgmap v883: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 535 op/s 2024-06-02T22:49:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 720.0 s, 563.2 tps, lat 178.323 ms stddev 229.447 2024-06-02T22:49:26.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:26 smithi031 ceph-mon[31767]: pgmap v884: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.9 MiB/s wr, 566 op/s 2024-06-02T22:49:26.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:26 smithi098 ceph-mon[36750]: pgmap v884: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.9 MiB/s wr, 566 op/s 2024-06-02T22:49:26.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:26 smithi178 ceph-mon[36614]: pgmap v884: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.9 MiB/s wr, 566 op/s 2024-06-02T22:49:28.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:28 smithi031 ceph-mon[31767]: pgmap v885: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-06-02T22:49:28.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:28 smithi098 ceph-mon[36750]: pgmap v885: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-06-02T22:49:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:28 smithi178 ceph-mon[36614]: pgmap v885: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.0 MiB/s wr, 466 op/s 2024-06-02T22:49:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 725.0 s, 576.8 tps, lat 173.273 ms stddev 191.070 2024-06-02T22:49:30.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:30 smithi031 ceph-mon[31767]: pgmap v886: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.1 MiB/s wr, 613 op/s 2024-06-02T22:49:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:30 smithi098 ceph-mon[36750]: pgmap v886: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.1 MiB/s wr, 613 op/s 2024-06-02T22:49:30.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:30 smithi178 ceph-mon[36614]: pgmap v886: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.1 MiB/s wr, 613 op/s 2024-06-02T22:49:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:32 smithi031 ceph-mon[31767]: pgmap v887: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.6 MiB/s wr, 558 op/s 2024-06-02T22:49:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:32 smithi098 ceph-mon[36750]: pgmap v887: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.6 MiB/s wr, 558 op/s 2024-06-02T22:49:32.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:32 smithi178 ceph-mon[36614]: pgmap v887: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 5.6 MiB/s wr, 558 op/s 2024-06-02T22:49:34.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:34 smithi031 ceph-mon[31767]: pgmap v888: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-06-02T22:49:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:34 smithi098 ceph-mon[36750]: pgmap v888: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-06-02T22:49:34.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:34 smithi178 ceph-mon[36614]: pgmap v888: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.5 MiB/s wr, 576 op/s 2024-06-02T22:49:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 730.0 s, 525.0 tps, lat 194.720 ms stddev 225.823 2024-06-02T22:49:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.655+0000 7f4d79c00640 1 -- 172.21.15.31:0/3251318073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d74109300 msgr2=0x7f4d7410fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.655+0000 7f4d79c00640 1 --2- 172.21.15.31:0/3251318073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d74109300 0x7f4d7410fce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009be0 tx=0x7f4d6402a6c0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 -- 172.21.15.31:0/3251318073 shutdown_connections 2024-06-02T22:49:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 --2- 172.21.15.31:0/3251318073 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74110220 0x7f4d74112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 --2- 172.21.15.31:0/3251318073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d74109300 0x7f4d7410fce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 --2- 172.21.15.31:0/3251318073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d741089a0 0x7f4d74108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 -- 172.21.15.31:0/3251318073 >> 172.21.15.31:0/3251318073 conn(0x7f4d7406ea10 msgr2=0x7f4d74070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 -- 172.21.15.31:0/3251318073 shutdown_connections 2024-06-02T22:49:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.656+0000 7f4d79c00640 1 -- 172.21.15.31:0/3251318073 wait complete. 2024-06-02T22:49:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.657+0000 7f4d79c00640 1 Processor -- start 2024-06-02T22:49:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.657+0000 7f4d79c00640 1 -- start start 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 0x7f4d741a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 0x7f4d741ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74118030 con 0x7f4d74109300 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74117eb0 con 0x7f4d74110220 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d79c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d741181b0 con 0x7f4d741089a0 2024-06-02T22:49:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58702/0 (socket says 172.21.15.31:58702) 2024-06-02T22:49:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.658+0000 7f4d72a00640 1 -- 172.21.15.31:0/1803946239 learned_addr learned my addr 172.21.15.31:0/1803946239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d6a000640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 0x7f4d741a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d73400640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 0x7f4d741ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 -- 172.21.15.31:0/1803946239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 msgr2=0x7f4d741ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 0x7f4d741ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 -- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 msgr2=0x7f4d741a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 0x7f4d741a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 -- 172.21.15.31:0/1803946239 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741ae6a0 con 0x7f4d741089a0 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d73400640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 0x7f4d741ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:49:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d6a000640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 0x7f4d741a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.659+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00e9c0 tx=0x7f4d5c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.660+0000 7f4d6be00640 1 -- 172.21.15.31:0/1803946239 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00ccc0 con 0x7f4d741089a0 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.660+0000 7f4d6be00640 1 -- 172.21.15.31:0/1803946239 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c005500 con 0x7f4d741089a0 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.660+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741ae990 con 0x7f4d741089a0 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.660+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741aef00 con 0x7f4d741089a0 2024-06-02T22:49:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.660+0000 7f4d6be00640 1 -- 172.21.15.31:0/1803946239 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c010430 con 0x7f4d741089a0 2024-06-02T22:49:35.664 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.665+0000 7f4d6be00640 1 -- 172.21.15.31:0/1803946239 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f4d5c010690 con 0x7f4d741089a0 2024-06-02T22:49:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.667+0000 7f4d6be00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 0x7f4d580a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.667+0000 7f4d7ca1d740 1 Processor -- start 2024-06-02T22:49:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.667+0000 7f4d6be00640 1 -- 172.21.15.31:0/1803946239 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d5c0d0760 con 0x7f4d741089a0 2024-06-02T22:49:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 -- start start 2024-06-02T22:49:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d73400640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 0x7f4d580a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e00cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e014bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d59df70420 con 0x55d59e012730 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d59df17c50 con 0x55d59e00cbd0 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d59df6c3e0 con 0x55d59e00d5c0 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d6a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d6a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58710/0 (socket says 172.21.15.31:58710) 2024-06-02T22:49:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d6a000640 1 -- 172.21.15.31:0/305335666 learned_addr learned my addr 172.21.15.31:0/305335666 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.668+0000 7f4d72a00640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e00cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d73400640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e014bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 -- 172.21.15.31:0/305335666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 msgr2=0x55d59e0120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.669 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 -- 172.21.15.31:0/305335666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 msgr2=0x55d59e014bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e014bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 -- 172.21.15.31:0/305335666 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59dc84210 con 0x55d59e00cbd0 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d6a000640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d73400640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e014bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d73400640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 0x7f4d580a51c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009b50 tx=0x7f4d6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.669+0000 7f4d72a00640 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e00cff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c09c930 tx=0x7f4d5c09c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f42924fba1eb3d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.670+0000 7f4d63e00640 1 -- 172.21.15.31:0/305335666 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0a0fe0 con 0x55d59e00cbd0 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.670+0000 7f4d63e00640 1 -- 172.21.15.31:0/305335666 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c0a58a0 con 0x55d59e00cbd0 2024-06-02T22:49:35.670 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.670+0000 7f4d63e00640 1 -- 172.21.15.31:0/305335666 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0a5410 con 0x55d59e00cbd0 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.671+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/305335666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 msgr2=0x55d59e00cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.671+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e00cff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c09c930 tx=0x7f4d5c09c830 comp rx=0 tx=0).stop 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/305335666 shutdown_connections 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e014bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e0120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/305335666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e00cff0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/305335666 >> 172.21.15.31:0/305335666 conn(0x55d59dfd4f80 msgr2=0x55d59e008650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/305335666 shutdown_connections 2024-06-02T22:49:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.672+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/305335666 wait complete. 2024-06-02T22:49:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.673+0000 7f4d7ca1d740 1 -- start start 2024-06-02T22:49:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.673+0000 7f4d7ca1d740 1 Processor -- start 2024-06-02T22:49:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e016f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e01e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d59e0156e0 con 0x55d59e012730 2024-06-02T22:49:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d59df2b0b0 con 0x55d59e00cbd0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d59e015860 con 0x55d59e00d5c0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d7ca1d740 10 client.0 _ll_register_callbacks cb 0x55d59df16f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d6a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e016f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d6a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58714/0 (socket says 172.21.15.31:58714) 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d6a000640 1 -- 172.21.15.31:0/3237414161 learned_addr learned my addr 172.21.15.31:0/3237414161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d73400640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e01e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.674+0000 7f4d72a00640 1 -- 172.21.15.31:0/3237414161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 msgr2=0x55d59e017470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d72a00640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d72a00640 1 -- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 msgr2=0x55d59e01e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d72a00640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e01e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d72a00640 1 -- 172.21.15.31:0/3237414161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59dd50620 con 0x55d59e00cbd0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d73400640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e01e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d6a000640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d72a00640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e016f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005820 tx=0x7f4d5c09ccf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae4a95748c32438 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d60c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c07f020 con 0x55d59e00cbd0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d5c0a5610 con 0x55d59e00cbd0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.675+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d5c0a58a0 con 0x55d59e00cbd0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d5c0bb050 con 0x55d59e00cbd0 2024-06-02T22:49:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 10 client.26084 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d59e0156e0 con 0x55d59e00cbd0 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c0a58a0 con 0x55d59e00cbd0 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4d5c09c080 con 0x55d59e00cbd0 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 10 client.26084 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 20 client.26084 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e024e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.676+0000 7f4d7ca1d740 4 client.26084 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.677+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d59df7db50 con 0x55d59e022a40 2024-06-02T22:49:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.677+0000 7f4d6a000640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e024e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.677+0000 7f4d6a000640 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e024e30 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a495fca053b6130 server_cookie=86665849b8c57726 in_seq=0 out_seq=0 2024-06-02T22:49:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.677+0000 7f4d60c00640 10 client.26084 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.678+0000 7f4d60c00640 1 -- 172.21.15.31:0/3237414161 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d59df7db50 con 0x55d59e022a40 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.678+0000 7f4d60c00640 10 client.26084 handle_command_reply: tid=0 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.678+0000 7f4d7ca1d740 1 client.26084 shutdown 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 msgr2=0x55d59e016f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e016f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005820 tx=0x7f4d5c09ccf0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 shutdown_connections 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e024e30 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d60c00640 0 client.26084 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e01e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e017470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/3237414161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00cbd0 0x55d59e016f30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 >> 172.21.15.31:0/3237414161 conn(0x55d59dfd4f80 msgr2=0x55d59e007810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 shutdown_connections 2024-06-02T22:49:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/3237414161 wait complete. 2024-06-02T22:49:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.679+0000 7f4d7ca1d740 20 client.26084 trim_cache size 0 max 16384 2024-06-02T22:49:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.698+0000 7f4d7ca1d740 1 Processor -- start 2024-06-02T22:49:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 -- start start 2024-06-02T22:49:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 0x55d59e01e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.698 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e016200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.699 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5000fb80 con 0x55d59e012730 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500116c0 con 0x55d59e00d5c0 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d7ca1d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50010250 con 0x55d59e00cbd0 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:58716/0 (socket says 172.21.15.31:58716) 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.699+0000 7f4d72a00640 1 -- 172.21.15.31:0/1910207397 learned_addr learned my addr 172.21.15.31:0/1910207397 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 -- 172.21.15.31:0/1910207397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 msgr2=0x55d59e01e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d6a000640 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 0x55d59e01e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 0x55d59e01e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 -- 172.21.15.31:0/1910207397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 msgr2=0x55d59e016200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e016200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 -- 172.21.15.31:0/1910207397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d59e0251a0 con 0x55d59e00cbd0 2024-06-02T22:49:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d6a000640 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 0x55d59e01e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:49:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d72a00640 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c099090 tx=0x7f4d5c09b140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f6bffcb193da5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d63400640 1 -- 172.21.15.31:0/1910207397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c07f070 con 0x55d59e00cbd0 2024-06-02T22:49:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d63400640 1 -- 172.21.15.31:0/1910207397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c0a58a0 con 0x55d59e00cbd0 2024-06-02T22:49:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.700+0000 7f4d63400640 1 -- 172.21.15.31:0/1910207397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0a5410 con 0x55d59e00cbd0 2024-06-02T22:49:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/1910207397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 msgr2=0x55d59e00bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c099090 tx=0x7f4d5c09b140 comp rx=0 tx=0).stop 2024-06-02T22:49:35.703 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/1910207397 shutdown_connections 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e012730 0x55d59e016200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e00d5c0 0x55d59e01e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/1910207397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00cbd0 0x55d59e00bc20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/1910207397 >> 172.21.15.31:0/1910207397 conn(0x55d59dfd4f80 msgr2=0x55d59e00b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/1910207397 shutdown_connections 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.701+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/1910207397 wait complete. 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.702+0000 7f4d7ca1d740 1 -- start start 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.702+0000 7f4d7ca1d740 1 Processor -- start 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.702+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.702+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e01af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.702+0000 7f4d7ca1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e012730 0x55d59e01b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d72a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37064/0 (socket says 172.21.15.31:37064) 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50010ff0 con 0x55d59e00cbd0 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d72a00640 1 -- 172.21.15.31:0/2343003958 learned_addr learned my addr 172.21.15.31:0/2343003958 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e01af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50010920 con 0x55d59e012730 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5000db60 con 0x55d59e00d5c0 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d73400640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e012730 0x55d59e01b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d7ca1d740 10 client.0 _ll_register_callbacks cb 0x7f4d64034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 -- 172.21.15.31:0/2343003958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e012730 msgr2=0x55d59e01b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e012730 0x55d59e01b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 -- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 msgr2=0x55d59e01e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59e08b740 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d72a00640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d6a000640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e01af10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d64034040 tx=0x7f4d64009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f296b90742f1d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.703+0000 7f4d60c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64036040 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d5c0a58a0 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f4d64030e70 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4d64054050 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d7ca1d740 10 client.26068 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d59e08ca30 con 0x55d59e00d5c0 2024-06-02T22:49:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c0a58a0 con 0x55d59e00d5c0 2024-06-02T22:49:35.707 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.704+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f4d64004250 con 0x55d59e00d5c0 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 10 client.26068 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 10 client.26068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 20 client.26068 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e08f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 4 client.26068 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d59e003d80 con 0x55d59e022a40 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.705+0000 7f4d72a00640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e08f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.706+0000 7f4d72a00640 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e08f470 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b88afc00788065 server_cookie=d4ad33489b525719 in_seq=0 out_seq=0 2024-06-02T22:49:35.708 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.706+0000 7f4d60c00640 10 client.26068 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.825+0000 7f4d60c00640 1 -- 172.21.15.31:0/2343003958 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d59e003d80 con 0x55d59e022a40 2024-06-02T22:49:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.825+0000 7f4d60c00640 10 client.26068 handle_command_reply: tid=0 2024-06-02T22:49:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.825+0000 7f4d7ca1d740 1 client.26068 shutdown 2024-06-02T22:49:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.826+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 msgr2=0x55d59e01af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.826+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e01af10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d64034040 tx=0x7f4d64009920 comp rx=0 tx=0).stop 2024-06-02T22:49:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.827+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 shutdown_connections 2024-06-02T22:49:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.828+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55d59e022a40 0x55d59e08f470 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.828+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d59e012730 0x55d59e01b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.828+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d59e00d5c0 0x55d59e01af10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.828+0000 7f4d7ca1d740 1 --2- 172.21.15.31:0/2343003958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d59e00cbd0 0x55d59e01e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.828+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 >> 172.21.15.31:0/2343003958 conn(0x55d59dfd4f80 msgr2=0x55d59e016200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.829+0000 7f4d60c00640 0 client.26068 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.829+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 shutdown_connections 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.829+0000 7f4d7ca1d740 1 -- 172.21.15.31:0/2343003958 wait complete. 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.829+0000 7f4d7ca1d740 20 client.26068 trim_cache size 0 max 16384 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:49:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:49:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.831+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 msgr2=0x7f4d580a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.831+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 0x7f4d580a51c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009b50 tx=0x7f4d6c005f90 comp rx=0 tx=0).stop 2024-06-02T22:49:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.831+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 msgr2=0x7f4d741a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.831+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00e9c0 tx=0x7f4d5c00ee80 comp rx=0 tx=0).stop 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 shutdown_connections 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4d580a2d00 0x7f4d580a51c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d74110220 0x7f4d741ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d74109300 0x7f4d741a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 --2- 172.21.15.31:0/1803946239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d741089a0 0x7f4d741a6a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 >> 172.21.15.31:0/1803946239 conn(0x7f4d7406ea10 msgr2=0x7f4d740706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 shutdown_connections 2024-06-02T22:49:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:35.835+0000 7f4d79c00640 1 -- 172.21.15.31:0/1803946239 wait complete. 2024-06-02T22:49:36.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:36 smithi031 ceph-mon[31767]: pgmap v889: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-06-02T22:49:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:36 smithi098 ceph-mon[36750]: pgmap v889: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-06-02T22:49:36.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:36 smithi178 ceph-mon[36614]: pgmap v889: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.1 MiB/s wr, 597 op/s 2024-06-02T22:49:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:38 smithi098 ceph-mon[36750]: pgmap v890: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 462 op/s 2024-06-02T22:49:38.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:38 smithi178 ceph-mon[36614]: pgmap v890: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 462 op/s 2024-06-02T22:49:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:38 smithi031 ceph-mon[31767]: pgmap v890: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 462 op/s 2024-06-02T22:49:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 735.0 s, 558.6 tps, lat 170.716 ms stddev 211.438 2024-06-02T22:49:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:40 smithi098 ceph-mon[36750]: pgmap v891: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-06-02T22:49:40.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:40 smithi178 ceph-mon[36614]: pgmap v891: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-06-02T22:49:40.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:40 smithi031 ceph-mon[31767]: pgmap v891: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-06-02T22:49:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:42 smithi098 ceph-mon[36750]: pgmap v892: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-06-02T22:49:42.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:42 smithi178 ceph-mon[36614]: pgmap v892: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-06-02T22:49:42.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:42 smithi031 ceph-mon[31767]: pgmap v892: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.7 MiB/s wr, 526 op/s 2024-06-02T22:49:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:44 smithi098 ceph-mon[36750]: pgmap v893: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-06-02T22:49:44.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:44 smithi178 ceph-mon[36614]: pgmap v893: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-06-02T22:49:44.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:44 smithi031 ceph-mon[31767]: pgmap v893: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.9 MiB/s wr, 513 op/s 2024-06-02T22:49:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 740.0 s, 492.4 tps, lat 206.972 ms stddev 227.705 2024-06-02T22:49:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:46 smithi098 ceph-mon[36750]: pgmap v894: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.6 MiB/s wr, 542 op/s 2024-06-02T22:49:46.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:46 smithi178 ceph-mon[36614]: pgmap v894: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.6 MiB/s wr, 542 op/s 2024-06-02T22:49:46.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:46 smithi031 ceph-mon[31767]: pgmap v894: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.6 MiB/s wr, 542 op/s 2024-06-02T22:49:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:48 smithi098 ceph-mon[36750]: pgmap v895: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 427 op/s 2024-06-02T22:49:48.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:48 smithi178 ceph-mon[36614]: pgmap v895: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 427 op/s 2024-06-02T22:49:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:48 smithi031 ceph-mon[31767]: pgmap v895: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.3 MiB/s wr, 427 op/s 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 -- 172.21.15.31:0/3196733697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2014100720 msgr2=0x7f2014100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 --2- 172.21.15.31:0/3196733697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2014100720 0x7f2014100b40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2004009900 tx=0x7f200402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 -- 172.21.15.31:0/3196733697 shutdown_connections 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 --2- 172.21.15.31:0/3196733697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20141022d0 0x7f2014108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 --2- 172.21.15.31:0/3196733697 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f2014101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 --2- 172.21.15.31:0/3196733697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2014100720 0x7f2014100b40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.053+0000 7f2018a00640 1 -- 172.21.15.31:0/3196733697 >> 172.21.15.31:0/3196733697 conn(0x7f20140fbc90 msgr2=0x7f20140fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.055+0000 7f2018a00640 1 -- 172.21.15.31:0/3196733697 shutdown_connections 2024-06-02T22:49:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.056+0000 7f2018a00640 1 -- 172.21.15.31:0/3196733697 wait complete. 2024-06-02T22:49:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.058+0000 7f2018a00640 1 Processor -- start 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.058+0000 7f2018a00640 1 -- start start 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2014100720 0x7f2014195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20141022d0 0x7f2014192000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2011e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f201410c440 con 0x7f2014100720 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f201410c2c0 con 0x7f2014101910 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2011e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33330/0 (socket says 172.21.15.31:33330) 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2011e00640 1 -- 172.21.15.31:0/1153953572 learned_addr learned my addr 172.21.15.31:0/1153953572 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.059+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f201410c5c0 con 0x7f20141022d0 2024-06-02T22:49:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2013200640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20141022d0 0x7f2014192000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2011e00640 1 -- 172.21.15.31:0/1153953572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20141022d0 msgr2=0x7f2014192000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2011e00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20141022d0 0x7f2014192000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2011e00640 1 -- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2014100720 msgr2=0x7f2014195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2011e00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2014100720 0x7f2014195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.060+0000 7f2011e00640 1 -- 172.21.15.31:0/1153953572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20141928c0 con 0x7f2014101910 2024-06-02T22:49:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.061+0000 7f2011e00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f200000b4a0 tx=0x7f200000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.061+0000 7f200b400640 1 -- 172.21.15.31:0/1153953572 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000014070 con 0x7f2014101910 2024-06-02T22:49:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.061+0000 7f200b400640 1 -- 172.21.15.31:0/1153953572 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2000010af0 con 0x7f2014101910 2024-06-02T22:49:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.061+0000 7f200b400640 1 -- 172.21.15.31:0/1153953572 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000017d40 con 0x7f2014101910 2024-06-02T22:49:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.061+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20141a6200 con 0x7f2014101910 2024-06-02T22:49:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.062+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20141a6690 con 0x7f2014101910 2024-06-02T22:49:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.069+0000 7f200b400640 1 -- 172.21.15.31:0/1153953572 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f2000017070 con 0x7f2014101910 2024-06-02T22:49:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.070+0000 7f201c3b7740 1 Processor -- start 2024-06-02T22:49:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.070+0000 7f201c3b7740 1 -- start start 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.070+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a82c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a82ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f201c3b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56033a78a420 con 0x56033a827780 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f201c3b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033a731c50 con 0x56033a826d90 2024-06-02T22:49:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f201c3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56033a7863e0 con 0x56033a82c8f0 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:33332/0 (socket says 172.21.15.31:33332) 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 -- 172.21.15.31:0/2225406390 learned_addr learned my addr 172.21.15.31:0/2225406390 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 -- 172.21.15.31:0/2225406390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 msgr2=0x56033a82ed80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a82ed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 -- 172.21.15.31:0/2225406390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 msgr2=0x56033a82c280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a82c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.071+0000 7f2013200640 1 -- 172.21.15.31:0/2225406390 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033a49e210 con 0x56033a826d90 2024-06-02T22:49:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.072+0000 7f2013200640 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f200c007e50 tx=0x7f200c00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fedba736121624a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.072+0000 7f1fff400640 1 -- 172.21.15.31:0/2225406390 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c014070 con 0x56033a826d90 2024-06-02T22:49:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.072+0000 7f1fff400640 1 -- 172.21.15.31:0/2225406390 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200c00ee90 con 0x56033a826d90 2024-06-02T22:49:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.072+0000 7f1fff400640 1 -- 172.21.15.31:0/2225406390 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0054e0 con 0x56033a826d90 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.073+0000 7f201c3b7740 1 -- 172.21.15.31:0/2225406390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 msgr2=0x56033a8271b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.073+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f200c007e50 tx=0x7f200c00e720 comp rx=0 tx=0).stop 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 -- 172.21.15.31:0/2225406390 shutdown_connections 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a82ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a82c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2225406390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a826d90 0x56033a8271b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 -- 172.21.15.31:0/2225406390 >> 172.21.15.31:0/2225406390 conn(0x56033a7eef80 msgr2=0x56033a822810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 -- 172.21.15.31:0/2225406390 shutdown_connections 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.074+0000 7f201c3b7740 1 -- 172.21.15.31:0/2225406390 wait complete. 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.075+0000 7f201c3b7740 1 -- start start 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.075+0000 7f201c3b7740 1 Processor -- start 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a826d90 0x56033a831120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.075 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a831660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56033a82f8a0 con 0x56033a826d90 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56033a7450b0 con 0x56033a827780 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56033a82fa20 con 0x56033a82c8f0 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.076+0000 7f201c3b7740 10 client.0 _ll_register_callbacks cb 0x56033a730f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:49.076 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.077+0000 7f2011e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.077+0000 7f200b400640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 0x7f1ff80a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.078+0000 7f200b400640 1 -- 172.21.15.31:0/1153953572 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f20000ce820 con 0x7f2014101910 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.077+0000 7f2011e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48112/0 (socket says 172.21.15.31:48112) 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.077+0000 7f2012800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a831660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.078+0000 7f2011e00640 1 -- 172.21.15.31:0/1711982213 learned_addr learned my addr 172.21.15.31:0/1711982213 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.077+0000 7f2013200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a826d90 0x56033a831120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.080 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2011e00640 1 -- 172.21.15.31:0/1711982213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 msgr2=0x56033a831660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2011e00640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a831660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2011e00640 1 -- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a826d90 msgr2=0x56033a831120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2011e00640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a826d90 0x56033a831120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2011e00640 1 -- 172.21.15.31:0/1711982213 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033a56a620 con 0x56033a82c8f0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2012800640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a831660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.079+0000 7f2013200640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 0x7f1ff80a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.080+0000 7f1ff3e00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.080+0000 7f2011e00640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2000000c00 tx=0x7f200009a930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb7786eeba9cd01b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.080+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200001e070 con 0x56033a82c8f0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.080+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f200c00ee90 con 0x56033a82c8f0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.080+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2000017360 con 0x56033a82c8f0 2024-06-02T22:49:49.081 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.081+0000 7f2013200640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 0x7f1ff80a4fa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f200c010f60 tx=0x7f200c00e720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.081+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f200001e070 con 0x56033a82c8f0 2024-06-02T22:49:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.081+0000 7f201c3b7740 10 client.26077 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.081+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56033a83bb30 con 0x56033a82c8f0 2024-06-02T22:49:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.081+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200c00ee90 con 0x56033a82c8f0 2024-06-02T22:49:49.082 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.082+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f200009a140 con 0x56033a82c8f0 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 10 client.26077 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 10 client.26077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 20 client.26077 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a83d140 0x56033a83f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 4 client.26077 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:49:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.083+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56033a797b50 con 0x56033a83d140 2024-06-02T22:49:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.088+0000 7f2012800640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a83d140 0x56033a83f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.089+0000 7f2012800640 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a83d140 0x56033a83f530 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4afc2f4c391ae37b server_cookie=26223fd68c9223a in_seq=0 out_seq=0 2024-06-02T22:49:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.089+0000 7f1ff3e00640 10 client.26077 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.090+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1711982213 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56033a797b50 con 0x56033a83d140 2024-06-02T22:49:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.090+0000 7f1ff3e00640 10 client.26077 handle_command_reply: tid=0 2024-06-02T22:49:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.090+0000 7f201c3b7740 1 client.26077 shutdown 2024-06-02T22:49:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 msgr2=0x56033a8386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2000000c00 tx=0x7f200009a930 comp rx=0 tx=0).stop 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 shutdown_connections 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a83d140 0x56033a83f530 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a82c8f0 0x56033a8386a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a831660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1711982213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a826d90 0x56033a831120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 >> 172.21.15.31:0/1711982213 conn(0x56033a7eef80 msgr2=0x56033a821970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f1ff3e00640 0 client.26077 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 shutdown_connections 2024-06-02T22:49:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.091+0000 7f201c3b7740 1 -- 172.21.15.31:0/1711982213 wait complete. 2024-06-02T22:49:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.092+0000 7f201c3b7740 20 client.26077 trim_cache size 0 max 16384 2024-06-02T22:49:49.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.116+0000 7f201c3b7740 1 Processor -- start 2024-06-02T22:49:49.116 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.116+0000 7f201c3b7740 1 -- start start 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a825f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 0x56033a8217f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20141b0cc0 con 0x56033a827780 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20141b2800 con 0x56033a82c8f0 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f201c3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f20141b1390 con 0x56033a826d90 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f2011e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f2012800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a825f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.117 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f2011e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55708/0 (socket says 172.21.15.31:55708) 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.117+0000 7f2011e00640 1 -- 172.21.15.31:0/2340709461 learned_addr learned my addr 172.21.15.31:0/2340709461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 -- 172.21.15.31:0/2340709461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 msgr2=0x56033a8217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2013200640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 0x56033a8217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 0x56033a8217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 -- 172.21.15.31:0/2340709461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 msgr2=0x56033a838630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 -- 172.21.15.31:0/2340709461 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033a83f8a0 con 0x56033a826d90 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2011e00640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:49:49.118 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2013200640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 0x56033a8217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:49:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f2012800640 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a825f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56033a8281f0 tx=0x7f2004000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c8f45aff24609 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f1ffea00640 1 -- 172.21.15.31:0/2340709461 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004035040 con 0x56033a826d90 2024-06-02T22:49:49.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f1ffea00640 1 -- 172.21.15.31:0/2340709461 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2004005520 con 0x56033a826d90 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.118+0000 7f1ffea00640 1 -- 172.21.15.31:0/2340709461 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040316b0 con 0x56033a826d90 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 -- 172.21.15.31:0/2340709461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 msgr2=0x56033a825f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a825f90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x56033a8281f0 tx=0x7f2004000bc0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 -- 172.21.15.31:0/2340709461 shutdown_connections 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a82c8f0 0x56033a8217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a827780 0x56033a838630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 --2- 172.21.15.31:0/2340709461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a825f90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 -- 172.21.15.31:0/2340709461 >> 172.21.15.31:0/2340709461 conn(0x56033a7eef80 msgr2=0x56033a8210e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 -- 172.21.15.31:0/2340709461 shutdown_connections 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.119+0000 7f201c3b7740 1 -- 172.21.15.31:0/2340709461 wait complete. 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.120+0000 7f201c3b7740 1 -- start start 2024-06-02T22:49:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.120+0000 7f201c3b7740 1 Processor -- start 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a836040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a82c8f0 0x56033a837050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20141b2130 con 0x56033a82c8f0 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20141b1a60 con 0x56033a827780 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f20141aeca0 con 0x56033a826d90 2024-06-02T22:49:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f201c3b7740 10 client.0 _ll_register_callbacks cb 0x7f2000017660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:49:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f2012800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f2012800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:48130/0 (socket says 172.21.15.31:48130) 2024-06-02T22:49:49.122 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.121+0000 7f2012800640 1 -- 172.21.15.31:0/1123554729 learned_addr learned my addr 172.21.15.31:0/1123554729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2011e00640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a836040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2012800640 1 -- 172.21.15.31:0/1123554729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 msgr2=0x56033a836040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2012800640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a836040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2012800640 1 -- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a82c8f0 msgr2=0x56033a837050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2012800640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a82c8f0 0x56033a837050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.122+0000 7f2012800640 1 -- 172.21.15.31:0/1123554729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033a837640 con 0x56033a826d90 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.123+0000 7f2012800640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2004009850 tx=0x7f2004004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4919a77f43d943 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.123+0000 7f1ff3e00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.123+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004035070 con 0x56033a826d90 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.123+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f2004043040 con 0x56033a826d90 2024-06-02T22:49:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.124+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2004005520 con 0x56033a826d90 2024-06-02T22:49:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.124+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f20040048d0 con 0x56033a826d90 2024-06-02T22:49:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.124+0000 7f201c3b7740 10 client.26083 fetch_fsmap learned FSMap version 30 2024-06-02T22:49:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.124+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56033a8388c0 con 0x56033a826d90 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2004005520 con 0x56033a826d90 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f200403a040 con 0x56033a826d90 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 10 client.26083 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 10 client.26083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 20 client.26083 populate_metadata read hostname 'smithi031' 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a8a8420 0x56033a8aa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 4 client.26083 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.125+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56033a791ea0 con 0x56033a8a8420 2024-06-02T22:49:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.126+0000 7f2011e00640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a8a8420 0x56033a8aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:49:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.127+0000 7f1ff3e00640 10 client.26083 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.127+0000 7f2011e00640 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a8a8420 0x56033a8aa840 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b93f83310ca3275 server_cookie=c1625a60bab0d83f in_seq=0 out_seq=0 2024-06-02T22:49:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.157+0000 7f1ff3e00640 1 -- 172.21.15.31:0/1123554729 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56033a791ea0 con 0x56033a8a8420 2024-06-02T22:49:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.157+0000 7f1ff3e00640 10 client.26083 handle_command_reply: tid=0 2024-06-02T22:49:49.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.157+0000 7f201c3b7740 1 client.26083 shutdown 2024-06-02T22:49:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.159+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 msgr2=0x56033a835b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.159+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2004009850 tx=0x7f2004004430 comp rx=0 tx=0).stop 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 shutdown_connections 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x56033a8a8420 0x56033a8aa840 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56033a82c8f0 0x56033a837050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56033a827780 0x56033a836040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 --2- 172.21.15.31:0/1123554729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56033a826d90 0x56033a835b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f1ff3e00640 0 client.26083 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:49:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.160+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 >> 172.21.15.31:0/1123554729 conn(0x56033a7eef80 msgr2=0x56033a825e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.161+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 shutdown_connections 2024-06-02T22:49:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.161+0000 7f201c3b7740 1 -- 172.21.15.31:0/1123554729 wait complete. 2024-06-02T22:49:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.162+0000 7f201c3b7740 20 client.26083 trim_cache size 0 max 16384 2024-06-02T22:49:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:49:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:49:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:49:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.164+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 msgr2=0x7f1ff80a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.164+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 0x7f1ff80a4fa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f200c010f60 tx=0x7f200c00e720 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.164+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 msgr2=0x7f20141959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.164+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f200000b4a0 tx=0x7f200000b960 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.164+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 shutdown_connections 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1ff80a2ae0 0x7f1ff80a4fa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20141022d0 0x7f2014192000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2014101910 0x7f20141959d0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f200000b4a0 tx=0x7f200000b960 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 --2- 172.21.15.31:0/1153953572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2014100720 0x7f2014195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 >> 172.21.15.31:0/1153953572 conn(0x7f20140fbc90 msgr2=0x7f20140fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 shutdown_connections 2024-06-02T22:49:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:49:49.165+0000 7f2018a00640 1 -- 172.21.15.31:0/1153953572 wait complete. 2024-06-02T22:49:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 745.0 s, 456.4 tps, lat 218.231 ms stddev 265.593 2024-06-02T22:49:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:50 smithi098 ceph-mon[36750]: pgmap v896: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 548 op/s 2024-06-02T22:49:50.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:50 smithi178 ceph-mon[36614]: pgmap v896: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 548 op/s 2024-06-02T22:49:50.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:50 smithi031 ceph-mon[31767]: pgmap v896: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 548 op/s 2024-06-02T22:49:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:52 smithi098 ceph-mon[36750]: pgmap v897: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-06-02T22:49:52.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:52 smithi178 ceph-mon[36614]: pgmap v897: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-06-02T22:49:52.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:52 smithi031 ceph-mon[31767]: pgmap v897: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 497 op/s 2024-06-02T22:49:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:54 smithi098 ceph-mon[36750]: pgmap v898: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-06-02T22:49:54.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:54 smithi178 ceph-mon[36614]: pgmap v898: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-06-02T22:49:54.624 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:54 smithi031 ceph-mon[31767]: pgmap v898: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 503 op/s 2024-06-02T22:49:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 750.0 s, 459.2 tps, lat 218.773 ms stddev 258.952 2024-06-02T22:49:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:56 smithi098 ceph-mon[36750]: pgmap v899: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-06-02T22:49:56.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:56 smithi178 ceph-mon[36614]: pgmap v899: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-06-02T22:49:56.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:56 smithi031 ceph-mon[31767]: pgmap v899: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 5.1 MiB/s wr, 514 op/s 2024-06-02T22:49:58.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:49:58 smithi098 ceph-mon[36750]: pgmap v900: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 393 op/s 2024-06-02T22:49:58.812 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:49:58 smithi031 ceph-mon[31767]: pgmap v900: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 393 op/s 2024-06-02T22:49:58.813 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:49:58 smithi178 ceph-mon[36614]: pgmap v900: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.7 MiB/s wr, 393 op/s 2024-06-02T22:50:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 755.0 s, 502.6 tps, lat 198.668 ms stddev 234.439 2024-06-02T22:50:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:00 smithi098 ceph-mon[36750]: pgmap v901: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 506 op/s 2024-06-02T22:50:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:00 smithi098 ceph-mon[36750]: overall HEALTH_OK 2024-06-02T22:50:00.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:00 smithi178 ceph-mon[36614]: pgmap v901: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 506 op/s 2024-06-02T22:50:00.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:00 smithi178 ceph-mon[36614]: overall HEALTH_OK 2024-06-02T22:50:00.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:00 smithi031 ceph-mon[31767]: pgmap v901: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.6 MiB/s wr, 506 op/s 2024-06-02T22:50:00.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:00 smithi031 ceph-mon[31767]: overall HEALTH_OK 2024-06-02T22:50:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.404+0000 7f638f000640 1 -- 172.21.15.31:0/469378629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63881095b0 msgr2=0x7f63880729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.405+0000 7f638f000640 1 --2- 172.21.15.31:0/469378629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63881095b0 0x7f63880729d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f637c009900 tx=0x7f637c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 -- 172.21.15.31:0/469378629 shutdown_connections 2024-06-02T22:50:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 --2- 172.21.15.31:0/469378629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f638810fce0 0x7f63881120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 --2- 172.21.15.31:0/469378629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6388072f10 0x7f6388073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 --2- 172.21.15.31:0/469378629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63881095b0 0x7f63880729d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 -- 172.21.15.31:0/469378629 >> 172.21.15.31:0/469378629 conn(0x7f638806e840 msgr2=0x7f6388070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.406+0000 7f638f000640 1 -- 172.21.15.31:0/469378629 shutdown_connections 2024-06-02T22:50:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.407+0000 7f638f000640 1 -- 172.21.15.31:0/469378629 wait complete. 2024-06-02T22:50:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.408+0000 7f638f000640 1 Processor -- start 2024-06-02T22:50:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.408+0000 7f638f000640 1 -- start start 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6388072f10 0x7f638819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63881095b0 0x7f638819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6388115d40 con 0x7f6388072f10 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6388115bc0 con 0x7f638810fce0 2024-06-02T22:50:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.409+0000 7f638f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6388115ec0 con 0x7f63881095b0 2024-06-02T22:50:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.410+0000 7f638e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.410+0000 7f638e600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53570/0 (socket says 172.21.15.31:53570) 2024-06-02T22:50:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.410+0000 7f638e600640 1 -- 172.21.15.31:0/1328290488 learned_addr learned my addr 172.21.15.31:0/1328290488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.410+0000 7f638d200640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63881095b0 0x7f638819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 -- 172.21.15.31:0/1328290488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63881095b0 msgr2=0x7f638819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63881095b0 0x7f638819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 -- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6388072f10 msgr2=0x7f638819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6388072f10 0x7f638819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 -- 172.21.15.31:0/1328290488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63881a5dd0 con 0x7f638810fce0 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.411+0000 7f638e600640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f638000b970 tx=0x7f638000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.412+0000 7f6386000640 1 -- 172.21.15.31:0/1328290488 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380019070 con 0x7f638810fce0 2024-06-02T22:50:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.412+0000 7f6386000640 1 -- 172.21.15.31:0/1328290488 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f638000cb40 con 0x7f638810fce0 2024-06-02T22:50:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.412+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63881a60c0 con 0x7f638810fce0 2024-06-02T22:50:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.413+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63881a6640 con 0x7f638810fce0 2024-06-02T22:50:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.414+0000 7f6386000640 1 -- 172.21.15.31:0/1328290488 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800076e0 con 0x7f638810fce0 2024-06-02T22:50:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.421+0000 7f6386000640 1 -- 172.21.15.31:0/1328290488 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f638001c070 con 0x7f638810fce0 2024-06-02T22:50:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.425+0000 7f6386000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 0x7f63700a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.425+0000 7f6386000640 1 -- 172.21.15.31:0/1328290488 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f63800ceac0 con 0x7f638810fce0 2024-06-02T22:50:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.426+0000 7f638dc00640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 0x7f63700a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 Processor -- start 2024-06-02T22:50:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 -- start start 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5559ba11b420 con 0x5559ba1b7d90 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5559ba0c2c50 con 0x5559ba1b8780 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.429+0000 7f63935d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5559ba1173e0 con 0x5559ba1bd8f0 2024-06-02T22:50:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.430+0000 7f638dc00640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 0x7f63700a5110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f637c0096c0 tx=0x7f637c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.431+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.431+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53574/0 (socket says 172.21.15.31:53574) 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.431+0000 7f638d200640 1 -- 172.21.15.31:0/1869081332 learned_addr learned my addr 172.21.15.31:0/1869081332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.431+0000 7f638dc00640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638e600640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638d200640 1 -- 172.21.15.31:0/1869081332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 msgr2=0x5559ba1bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638d200640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1bfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638d200640 1 -- 172.21.15.31:0/1869081332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 msgr2=0x5559ba1b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638d200640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638d200640 1 -- 172.21.15.31:0/1869081332 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b9e2f210 con 0x5559ba1b8780 2024-06-02T22:50:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.432+0000 7f638e600640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1bfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.435+0000 7f638d200640 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f637800bc70 tx=0x7f63780107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae199befee35a326 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.435+0000 7f6376a00640 1 -- 172.21.15.31:0/1869081332 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378004220 con 0x5559ba1b8780 2024-06-02T22:50:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.435+0000 7f6376a00640 1 -- 172.21.15.31:0/1869081332 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637800be20 con 0x5559ba1b8780 2024-06-02T22:50:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.435+0000 7f6376a00640 1 -- 172.21.15.31:0/1869081332 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378004d10 con 0x5559ba1b8780 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 -- 172.21.15.31:0/1869081332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 msgr2=0x5559ba1bd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f637800bc70 tx=0x7f63780107a0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 -- 172.21.15.31:0/1869081332 shutdown_connections 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1bfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1bd280 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.436+0000 7f63935d5740 1 --2- 172.21.15.31:0/1869081332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.437+0000 7f63935d5740 1 -- 172.21.15.31:0/1869081332 >> 172.21.15.31:0/1869081332 conn(0x5559ba17ff80 msgr2=0x5559ba1b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.437+0000 7f63935d5740 1 -- 172.21.15.31:0/1869081332 shutdown_connections 2024-06-02T22:50:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.437+0000 7f63935d5740 1 -- 172.21.15.31:0/1869081332 wait complete. 2024-06-02T22:50:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.438+0000 7f63935d5740 1 -- start start 2024-06-02T22:50:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.438+0000 7f63935d5740 1 Processor -- start 2024-06-02T22:50:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5559ba1c08a0 con 0x5559ba1b7d90 2024-06-02T22:50:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5559ba0d60b0 con 0x5559ba1b8780 2024-06-02T22:50:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5559ba1c0a20 con 0x5559ba1bd8f0 2024-06-02T22:50:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.439+0000 7f63935d5740 10 client.0 _ll_register_callbacks cb 0x5559ba0c1f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.440+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.440+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53578/0 (socket says 172.21.15.31:53578) 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.440+0000 7f638d200640 1 -- 172.21.15.31:0/2736181863 learned_addr learned my addr 172.21.15.31:0/2736181863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.440+0000 7f638e600640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638d200640 1 -- 172.21.15.31:0/2736181863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 msgr2=0x5559ba1c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638d200640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638dc00640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638d200640 1 -- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 msgr2=0x5559ba1c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638d200640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.441+0000 7f638d200640 1 -- 172.21.15.31:0/2736181863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b9efb620 con 0x5559ba1b8780 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.442+0000 7f638dc00640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.442+0000 7f638d200640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6378005cd0 tx=0x7f637801d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93590c44a906fbfc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.443+0000 7f636b400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.443+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637802b060 con 0x5559ba1b8780 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.443+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f637801d770 con 0x5559ba1b8780 2024-06-02T22:50:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.443+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f637800be20 con 0x5559ba1b8780 2024-06-02T22:50:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.444+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f637801d990 con 0x5559ba1b8780 2024-06-02T22:50:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.444+0000 7f63935d5740 10 client.26111 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.444+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5559ba1cc980 con 0x5559ba1b8780 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.444+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637800be20 con 0x5559ba1b8780 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6378011ae0 con 0x5559ba1b8780 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 10 client.26111 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 10 client.26111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 20 client.26111 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba1ce300 0x5559ba1d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 4 client.26111 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:50:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.445+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559ba128b50 con 0x5559ba1ce300 2024-06-02T22:50:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.446+0000 7f638dc00640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba1ce300 0x5559ba1d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.446+0000 7f638dc00640 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba1ce300 0x5559ba1d07a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4495fc2b93667406 server_cookie=41c89595a88807ca in_seq=0 out_seq=0 2024-06-02T22:50:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.446+0000 7f636b400640 10 client.26111 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.447+0000 7f636b400640 1 -- 172.21.15.31:0/2736181863 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5559ba128b50 con 0x5559ba1ce300 2024-06-02T22:50:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.447+0000 7f636b400640 10 client.26111 handle_command_reply: tid=0 2024-06-02T22:50:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.447+0000 7f63935d5740 1 client.26111 shutdown 2024-06-02T22:50:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.448+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 msgr2=0x5559ba1c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.448+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6378005cd0 tx=0x7f637801d680 comp rx=0 tx=0).stop 2024-06-02T22:50:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 shutdown_connections 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba1ce300 0x5559ba1d07a0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b8780 0x5559ba1c2660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 --2- 172.21.15.31:0/2736181863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b7d90 0x5559ba1c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f636b400640 0 client.26111 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.450+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 >> 172.21.15.31:0/2736181863 conn(0x5559ba17ff80 msgr2=0x5559ba1b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.455+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 shutdown_connections 2024-06-02T22:50:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.455+0000 7f63935d5740 1 -- 172.21.15.31:0/2736181863 wait complete. 2024-06-02T22:50:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.455+0000 7f63935d5740 20 client.26111 trim_cache size 0 max 16384 2024-06-02T22:50:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:02 smithi098 ceph-mon[36750]: pgmap v902: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 469 op/s 2024-06-02T22:50:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:02 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:50:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.525+0000 7f63935d5740 1 Processor -- start 2024-06-02T22:50:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 -- start start 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1b8780 0x5559ba1c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 0x5559ba1b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63881c1b70 con 0x5559ba1bd8f0 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63881c36b0 con 0x5559ba1b7d90 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f63935d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63881c2240 con 0x5559ba1b8780 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.529+0000 7f638dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53584/0 (socket says 172.21.15.31:53584) 2024-06-02T22:50:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 -- 172.21.15.31:0/1428314195 learned_addr learned my addr 172.21.15.31:0/1428314195 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 -- 172.21.15.31:0/1428314195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1b8780 msgr2=0x5559ba1c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1b8780 0x5559ba1c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 -- 172.21.15.31:0/1428314195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 msgr2=0x5559ba1b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638e600640 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 0x5559ba1b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 0x5559ba1b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638dc00640 1 -- 172.21.15.31:0/1428314195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559ba1b44c0 con 0x5559ba1b7d90 2024-06-02T22:50:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.530+0000 7f638e600640 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 0x5559ba1b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.531+0000 7f638dc00640 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f637c009900 tx=0x7f637c03a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef0cdc0aae6a4c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.532+0000 7f6376000640 1 -- 172.21.15.31:0/1428314195 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c035040 con 0x5559ba1b7d90 2024-06-02T22:50:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.532+0000 7f6376000640 1 -- 172.21.15.31:0/1428314195 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c040040 con 0x5559ba1b7d90 2024-06-02T22:50:02.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.532+0000 7f6376000640 1 -- 172.21.15.31:0/1428314195 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c04f7a0 con 0x5559ba1b7d90 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 -- 172.21.15.31:0/1428314195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 msgr2=0x5559ba1b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f637c009900 tx=0x7f637c03a000 comp rx=0 tx=0).stop 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 -- 172.21.15.31:0/1428314195 shutdown_connections 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1bd8f0 0x5559ba1b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1b8780 0x5559ba1c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 --2- 172.21.15.31:0/1428314195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1b7d90 0x5559ba1b39a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.533+0000 7f63935d5740 1 -- 172.21.15.31:0/1428314195 >> 172.21.15.31:0/1428314195 conn(0x5559ba17ff80 msgr2=0x5559ba1b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.534+0000 7f63935d5740 1 -- 172.21.15.31:0/1428314195 shutdown_connections 2024-06-02T22:50:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.534+0000 7f63935d5740 1 -- 172.21.15.31:0/1428314195 wait complete. 2024-06-02T22:50:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.534+0000 7f63935d5740 1 -- start start 2024-06-02T22:50:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.535+0000 7f63935d5740 1 Processor -- start 2024-06-02T22:50:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.536+0000 7f63935d5740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 0x5559ba1c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.536+0000 7f63935d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.536+0000 7f63935d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f638d200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53586/0 (socket says 172.21.15.31:53586) 2024-06-02T22:50:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f63935d5740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63881c2fe0 con 0x5559ba1b8780 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f638e600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f638e600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:37080/0 (socket says 172.21.15.31:37080) 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.537+0000 7f638e600640 1 -- 172.21.15.31:0/2937746980 learned_addr learned my addr 172.21.15.31:0/2937746980 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.538+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63881c2910 con 0x5559ba1bd8f0 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.538+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f63881bfb10 con 0x5559ba1c7f30 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.538+0000 7f63935d5740 10 client.0 _ll_register_callbacks cb 0x7f637800bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.538+0000 7f638e600640 1 -- 172.21.15.31:0/2937746980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 msgr2=0x5559ba1c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.539+0000 7f638e600640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.539+0000 7f638e600640 1 -- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 msgr2=0x5559ba1c69e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.539+0000 7f638d200640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.539+0000 7f638dc00640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 0x5559ba1c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.540+0000 7f638e600640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 0x5559ba1c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.540+0000 7f638e600640 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ba1c88f0 con 0x5559ba1c7f30 2024-06-02T22:50:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.540+0000 7f638dc00640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 0x5559ba1c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.541+0000 7f638e600640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f638000cfd0 tx=0x7f6380014d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f0ee233f82c510 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.541+0000 7f636b400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:50:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.541+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63800a3c00 con 0x5559ba1c7f30 2024-06-02T22:50:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.542+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f63800b9bd0 con 0x5559ba1c7f30 2024-06-02T22:50:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.542+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f637c040040 con 0x5559ba1c7f30 2024-06-02T22:50:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.547+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f63800b9dd0 con 0x5559ba1c7f30 2024-06-02T22:50:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.547+0000 7f63935d5740 10 client.26095 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.548+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5559ba238e20 con 0x5559ba1c7f30 2024-06-02T22:50:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.548+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c040040 con 0x5559ba1c7f30 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6380096ce0 con 0x5559ba1c7f30 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 10 client.26095 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 10 client.26095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 20 client.26095 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba239740 0x5559ba23bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 4 client.26095 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:50:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.549+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559ba122ea0 con 0x5559ba239740 2024-06-02T22:50:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.550+0000 7f638dc00640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba239740 0x5559ba23bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.553+0000 7f638dc00640 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba239740 0x5559ba23bb60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27f451259258532 server_cookie=f889ed30ec42743d in_seq=0 out_seq=0 2024-06-02T22:50:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.553+0000 7f636b400640 10 client.26095 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:02 smithi178 ceph-mon[36614]: pgmap v902: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 469 op/s 2024-06-02T22:50:02.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:02 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:50:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.610+0000 7f636b400640 1 -- 172.21.15.31:0/2937746980 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5559ba122ea0 con 0x5559ba239740 2024-06-02T22:50:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.610+0000 7f636b400640 10 client.26095 handle_command_reply: tid=0 2024-06-02T22:50:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.610+0000 7f63935d5740 1 client.26095 shutdown 2024-06-02T22:50:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 msgr2=0x5559ba1c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f638000cfd0 tx=0x7f6380014d30 comp rx=0 tx=0).stop 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 shutdown_connections 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5559ba239740 0x5559ba23bb60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5559ba1c7f30 0x5559ba1c83b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5559ba1bd8f0 0x5559ba1c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 --2- 172.21.15.31:0/2937746980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5559ba1b8780 0x5559ba1c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f636b400640 0 client.26095 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 >> 172.21.15.31:0/2937746980 conn(0x5559ba17ff80 msgr2=0x5559ba1b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:50:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:50:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:50:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 shutdown_connections 2024-06-02T22:50:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 1 -- 172.21.15.31:0/2937746980 wait complete. 2024-06-02T22:50:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.611+0000 7f63935d5740 20 client.26095 trim_cache size 0 max 16384 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 msgr2=0x7f63700a5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 0x7f63700a5110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f637c0096c0 tx=0x7f637c031400 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 msgr2=0x7f63881a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f638000b970 tx=0x7f638000be30 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 shutdown_connections 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f63700a2c50 0x7f63700a5110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f638810fce0 0x7f63881a5760 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63881095b0 0x7f638819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 --2- 172.21.15.31:0/1328290488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6388072f10 0x7f638819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 >> 172.21.15.31:0/1328290488 conn(0x7f638806e840 msgr2=0x7f6388109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 shutdown_connections 2024-06-02T22:50:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:02.612+0000 7f638f000640 1 -- 172.21.15.31:0/1328290488 wait complete. 2024-06-02T22:50:02.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:02 smithi031 ceph-mon[31767]: pgmap v902: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.8 MiB/s wr, 469 op/s 2024-06-02T22:50:02.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:02 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:50:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: pgmap v903: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 491 op/s 2024-06-02T22:50:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:50:04.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:50:04.563 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:50:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: pgmap v903: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 491 op/s 2024-06-02T22:50:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:50:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:50:04.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:50:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: pgmap v903: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.8 MiB/s wr, 491 op/s 2024-06-02T22:50:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:50:04.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:50:04.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:50:04.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:50:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 760.0 s, 499.4 tps, lat 201.044 ms stddev 218.492 2024-06-02T22:50:05.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:05 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:50:05.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:05 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:50:05.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:05 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:50:05.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:05 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:50:05.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:05 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi031 to 177.5M 2024-06-02T22:50:05.714 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:05 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi031 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-02T22:50:06.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:06 smithi178 ceph-mon[36614]: pgmap v904: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-06-02T22:50:06.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:06 smithi031 ceph-mon[31767]: pgmap v904: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-06-02T22:50:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:06 smithi098 ceph-mon[36750]: pgmap v904: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-06-02T22:50:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:08 smithi178 ceph-mon[36614]: pgmap v905: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 414 op/s 2024-06-02T22:50:08.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:08 smithi031 ceph-mon[31767]: pgmap v905: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 414 op/s 2024-06-02T22:50:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:08 smithi098 ceph-mon[36750]: pgmap v905: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.0 MiB/s wr, 414 op/s 2024-06-02T22:50:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 765.0 s, 422.0 tps, lat 231.313 ms stddev 291.359 2024-06-02T22:50:10.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:10 smithi178 ceph-mon[36614]: pgmap v906: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-06-02T22:50:10.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:10 smithi031 ceph-mon[31767]: pgmap v906: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-06-02T22:50:10.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:10 smithi098 ceph-mon[36750]: pgmap v906: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-06-02T22:50:12.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:12 smithi178 ceph-mon[36614]: pgmap v907: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 499 op/s 2024-06-02T22:50:12.625 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:12 smithi031 ceph-mon[31767]: pgmap v907: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 499 op/s 2024-06-02T22:50:12.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:12 smithi098 ceph-mon[36750]: pgmap v907: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.1 MiB/s wr, 499 op/s 2024-06-02T22:50:14.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:14 smithi178 ceph-mon[36614]: pgmap v908: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-06-02T22:50:14.569 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:14 smithi098 ceph-mon[36750]: pgmap v908: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-06-02T22:50:14.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:14 smithi031 ceph-mon[31767]: pgmap v908: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-06-02T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 770.0 s, 491.2 tps, lat 202.766 ms stddev 230.366 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.804+0000 7f0086600640 1 -- 172.21.15.31:0/2705380193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801089a0 msgr2=0x7f008010add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.804+0000 7f0086600640 1 --2- 172.21.15.31:0/2705380193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801089a0 0x7f008010add0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0078009ca0 tx=0x7f007802a8b0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 -- 172.21.15.31:0/2705380193 shutdown_connections 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 --2- 172.21.15.31:0/2705380193 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00801120e0 0x7f0080114530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 --2- 172.21.15.31:0/2705380193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f008010b310 0x7f008010b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 --2- 172.21.15.31:0/2705380193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801089a0 0x7f008010add0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 -- 172.21.15.31:0/2705380193 >> 172.21.15.31:0/2705380193 conn(0x7f008006ea10 msgr2=0x7f0080070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 -- 172.21.15.31:0/2705380193 shutdown_connections 2024-06-02T22:50:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.805+0000 7f0086600640 1 -- 172.21.15.31:0/2705380193 wait complete. 2024-06-02T22:50:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.806+0000 7f0086600640 1 Processor -- start 2024-06-02T22:50:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 -- start start 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 0x7f00801a7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801120e0 0x7f00801ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f00801180e0 con 0x7f008010b310 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0080117f60 con 0x7f00801089a0 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f0086600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0080118260 con 0x7f00801120e0 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f007f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f007f400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52046/0 (socket says 172.21.15.31:52046) 2024-06-02T22:50:15.811 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.807+0000 7f007f400640 1 -- 172.21.15.31:0/745141608 learned_addr learned my addr 172.21.15.31:0/745141608 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007ea00640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 0x7f00801a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007fe00640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801120e0 0x7f00801ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 -- 172.21.15.31:0/745141608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801120e0 msgr2=0x7f00801ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801120e0 0x7f00801ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 -- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 msgr2=0x7f00801a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 0x7f00801a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 -- 172.21.15.31:0/745141608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00801ae6a0 con 0x7f00801089a0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007ea00640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 0x7f00801a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.808+0000 7f007f400640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f007802aea0 tx=0x7f0078003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.809+0000 7f0077e00640 1 -- 172.21.15.31:0/745141608 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078004240 con 0x7f00801089a0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.809+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00801ae930 con 0x7f00801089a0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.809+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00801aeed0 con 0x7f00801089a0 2024-06-02T22:50:15.812 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.809+0000 7f0077e00640 1 -- 172.21.15.31:0/745141608 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0078040070 con 0x7f00801089a0 2024-06-02T22:50:15.813 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.810+0000 7f0077e00640 1 -- 172.21.15.31:0/745141608 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078031bb0 con 0x7f00801089a0 2024-06-02T22:50:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.814+0000 7f00895d1740 1 Processor -- start 2024-06-02T22:50:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 -- start start 2024-06-02T22:50:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426a30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55db42601420 con 0x55db4269e5c0 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db425a8c50 con 0x55db4269dbd0 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f00895d1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55db425fd3e0 con 0x55db426a3730 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f007fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f007fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52052/0 (socket says 172.21.15.31:52052) 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.822+0000 7f007fe00640 1 -- 172.21.15.31:0/879566734 learned_addr learned my addr 172.21.15.31:0/879566734 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.823+0000 7f007ea00640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.823+0000 7f0077e00640 1 -- 172.21.15.31:0/745141608 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f007803b430 con 0x7f00801089a0 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.824+0000 7f007f400640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426a30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007fe00640 1 -- 172.21.15.31:0/879566734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 msgr2=0x55db426a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007fe00640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007fe00640 1 -- 172.21.15.31:0/879566734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 msgr2=0x55db426a30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007fe00640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426a30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007fe00640 1 -- 172.21.15.31:0/879566734 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db42315210 con 0x55db4269dbd0 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f007ea00640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.825+0000 7f0077e00640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 0x7f00640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.826+0000 7f007fe00640 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cb10 tx=0x7f006c00e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106fdb9dfdb7a82f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.826+0000 7f0077e00640 1 -- 172.21.15.31:0/745141608 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f00780f0540 con 0x7f00801089a0 2024-06-02T22:50:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.827+0000 7f007f400640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 0x7f00640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.829+0000 7f0074c00640 1 -- 172.21.15.31:0/879566734 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c004020 con 0x55db4269dbd0 2024-06-02T22:50:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.829+0000 7f007f400640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 0x7f00640a51c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0078006010 tx=0x7f007802a8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.829+0000 7f0074c00640 1 -- 172.21.15.31:0/879566734 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f006c0041c0 con 0x55db4269dbd0 2024-06-02T22:50:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.829+0000 7f0074c00640 1 -- 172.21.15.31:0/879566734 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0107b0 con 0x55db4269dbd0 2024-06-02T22:50:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.830+0000 7f00895d1740 1 -- 172.21.15.31:0/879566734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 msgr2=0x55db4269dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.830+0000 7f00895d1740 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f006c00cb10 tx=0x7f006c00e350 comp rx=0 tx=0).stop 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 -- 172.21.15.31:0/879566734 shutdown_connections 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426a30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 --2- 172.21.15.31:0/879566734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db4269dff0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 -- 172.21.15.31:0/879566734 >> 172.21.15.31:0/879566734 conn(0x55db42665f80 msgr2=0x55db42699650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 -- 172.21.15.31:0/879566734 shutdown_connections 2024-06-02T22:50:15.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.831+0000 7f00895d1740 1 -- 172.21.15.31:0/879566734 wait complete. 2024-06-02T22:50:15.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.832+0000 7f00895d1740 1 -- start start 2024-06-02T22:50:15.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.832+0000 7f00895d1740 1 Processor -- start 2024-06-02T22:50:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.834+0000 7f00895d1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.834+0000 7f00895d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.834+0000 7f00895d1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db426af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.834+0000 7f00895d1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55db426a66e0 con 0x55db426a3730 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.834+0000 7f00895d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55db425bc0b0 con 0x55db4269e5c0 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.835+0000 7f00895d1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55db426a6860 con 0x55db4269dbd0 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.835+0000 7f00895d1740 10 client.0 _ll_register_callbacks cb 0x55db425a7f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.835+0000 7f007fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.835+0000 7f007fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:60704/0 (socket says 172.21.15.31:60704) 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.835+0000 7f007fe00640 1 -- 172.21.15.31:0/3464393430 learned_addr learned my addr 172.21.15.31:0/3464393430 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.836+0000 7f007fe00640 1 -- 172.21.15.31:0/3464393430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 msgr2=0x55db426a84b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.836+0000 7f007fe00640 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426a84b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.836+0000 7f007fe00640 1 -- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 msgr2=0x55db426af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.836+0000 7f007fe00640 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db426af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.836+0000 7f007fe00640 1 -- 172.21.15.31:0/3464393430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db423e1620 con 0x55db4269dbd0 2024-06-02T22:50:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f007fe00640 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f006c003d20 tx=0x7f006c003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca58ab13dd6c119 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f0069600640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:50:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c010990 con 0x55db4269dbd0 2024-06-02T22:50:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f006c010b30 con 0x55db4269dbd0 2024-06-02T22:50:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f006c0041c0 con 0x55db4269dbd0 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.837+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f006c0035f0 con 0x55db4269dbd0 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 10 client.26107 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55db426c3910 con 0x55db4269dbd0 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f006c0041c0 con 0x55db4269dbd0 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f006c026b80 con 0x55db4269dbd0 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 10 client.26107 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 10 client.26107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 20 client.26107 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db426c4f00 0x55db426c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 4 client.26107 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:50:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.838+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db4260eb50 con 0x55db426c4f00 2024-06-02T22:50:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.840+0000 7f007ea00640 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db426c4f00 0x55db426c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.843+0000 7f007ea00640 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db426c4f00 0x55db426c7380 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43b2ee6621e4831 server_cookie=560c47e9a85ae681 in_seq=0 out_seq=0 2024-06-02T22:50:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.843+0000 7f0069600640 10 client.26107 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:15.847 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.847+0000 7f0069600640 1 -- 172.21.15.31:0/3464393430 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55db4260eb50 con 0x55db426c4f00 2024-06-02T22:50:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.847+0000 7f0069600640 10 client.26107 handle_command_reply: tid=0 2024-06-02T22:50:15.848 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.847+0000 7f00895d1740 1 client.26107 shutdown 2024-06-02T22:50:15.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 msgr2=0x55db426a7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f006c003d20 tx=0x7f006c003d50 comp rx=0 tx=0).stop 2024-06-02T22:50:15.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 shutdown_connections 2024-06-02T22:50:15.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db426c4f00 0x55db426c7380 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.849 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db426af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 --2- 172.21.15.31:0/3464393430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426a7f70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 >> 172.21.15.31:0/3464393430 conn(0x55db42665f80 msgr2=0x55db42698810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f0069600640 0 client.26107 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 shutdown_connections 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.848+0000 7f00895d1740 1 -- 172.21.15.31:0/3464393430 wait complete. 2024-06-02T22:50:15.850 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.849+0000 7f00895d1740 20 client.26107 trim_cache size 0 max 16384 2024-06-02T22:50:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.879+0000 7f00895d1740 1 Processor -- start 2024-06-02T22:50:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 -- start start 2024-06-02T22:50:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f006000fbd0 con 0x55db4269e5c0 2024-06-02T22:50:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0060011710 con 0x55db4269dbd0 2024-06-02T22:50:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f00895d1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f00600102a0 con 0x55db426a3730 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.880+0000 7f007fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52056/0 (socket says 172.21.15.31:52056) 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 -- 172.21.15.31:0/2187127685 learned_addr learned my addr 172.21.15.31:0/2187127685 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 -- 172.21.15.31:0/2187127685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 msgr2=0x55db426ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 -- 172.21.15.31:0/2187127685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 msgr2=0x55db426af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.881+0000 7f007fe00640 1 -- 172.21.15.31:0/2187127685 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db4269a300 con 0x55db4269dbd0 2024-06-02T22:50:15.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.882+0000 7f007fe00640 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f006c005fa0 tx=0x7f006c005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e044fd60219d15ee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.882+0000 7f006be00640 1 -- 172.21.15.31:0/2187127685 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c039070 con 0x55db4269dbd0 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.882+0000 7f006be00640 1 -- 172.21.15.31:0/2187127685 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f006c005740 con 0x55db4269dbd0 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.882+0000 7f006be00640 1 -- 172.21.15.31:0/2187127685 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c01ac00 con 0x55db4269dbd0 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- 172.21.15.31:0/2187127685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 msgr2=0x55db426997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f006c005fa0 tx=0x7f006c005a10 comp rx=0 tx=0).stop 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- 172.21.15.31:0/2187127685 shutdown_connections 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db426a3730 0x55db426ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db4269e5c0 0x55db426af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.884 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 --2- 172.21.15.31:0/2187127685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269dbd0 0x55db426997e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- 172.21.15.31:0/2187127685 >> 172.21.15.31:0/2187127685 conn(0x55db42665f80 msgr2=0x55db426990d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- 172.21.15.31:0/2187127685 shutdown_connections 2024-06-02T22:50:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- 172.21.15.31:0/2187127685 wait complete. 2024-06-02T22:50:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.883+0000 7f00895d1740 1 -- start start 2024-06-02T22:50:15.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 Processor -- start 2024-06-02T22:50:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426ac350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db4272dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0060011040 con 0x55db426a3730 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0060010970 con 0x55db4269e5c0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f006000dbb0 con 0x55db4269dbd0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f00895d1740 10 client.0 _ll_register_callbacks cb 0x7f006c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f007ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f007ea00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:52070/0 (socket says 172.21.15.31:52070) 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f007ea00640 1 -- 172.21.15.31:0/76046115 learned_addr learned my addr 172.21.15.31:0/76046115 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.884+0000 7f007fe00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007fe00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db4272dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 -- 172.21.15.31:0/76046115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 msgr2=0x55db426ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 -- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 msgr2=0x55db4272dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db4272dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 -- 172.21.15.31:0/76046115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db426a6a30 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007fe00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db4272dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f007ea00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55db4269a500 tx=0x7f0070004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96c49035aa9fb7ce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.885+0000 7f0069600640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070003df0 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f0070005030 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f006c005740 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0070030050 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f00895d1740 10 client.26129 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55db4272f330 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.886+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f006c005740 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f007001e3f0 con 0x55db4269e5c0 2024-06-02T22:50:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 10 client.26129 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 10 client.26129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 20 client.26129 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db4272fca0 0x55db427320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 4 client.26129 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db42608ea0 con 0x55db4272fca0 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.887+0000 7f007fe00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db4272fca0 0x55db427320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.888+0000 7f007fe00640 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db4272fca0 0x55db427320c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12a8044f5ef25dd server_cookie=dbaa2c1713c4371b in_seq=0 out_seq=0 2024-06-02T22:50:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.888+0000 7f0069600640 10 client.26129 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.958+0000 7f0069600640 1 -- 172.21.15.31:0/76046115 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55db42608ea0 con 0x55db4272fca0 2024-06-02T22:50:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.958+0000 7f0069600640 10 client.26129 handle_command_reply: tid=0 2024-06-02T22:50:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.959+0000 7f00895d1740 1 client.26129 shutdown 2024-06-02T22:50:15.959 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.959+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 msgr2=0x55db426ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.959+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55db4269a500 tx=0x7f0070004410 comp rx=0 tx=0).stop 2024-06-02T22:50:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.959+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 shutdown_connections 2024-06-02T22:50:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.959+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55db4272fca0 0x55db427320c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55db426a3730 0x55db4272dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f0069600640 0 client.26129 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55db4269e5c0 0x55db426ac890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 --2- 172.21.15.31:0/76046115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55db4269dbd0 0x55db426ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 >> 172.21.15.31:0/76046115 conn(0x55db42665f80 msgr2=0x55db426a7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 shutdown_connections 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.960+0000 7f00895d1740 1 -- 172.21.15.31:0/76046115 wait complete. 2024-06-02T22:50:15.962 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.961+0000 7f00895d1740 20 client.26129 trim_cache size 0 max 16384 2024-06-02T22:50:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:50:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:50:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:50:15.963 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 msgr2=0x7f00640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 0x7f00640a51c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0078006010 tx=0x7f007802a8b0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 msgr2=0x7f00801a6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f007802aea0 tx=0x7f0078003ba0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 shutdown_connections 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f00640a2d00 0x7f00640a51c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00801120e0 0x7f00801ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f008010b310 0x7f00801a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 --2- 172.21.15.31:0/745141608 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00801089a0 0x7f00801a6ad0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 >> 172.21.15.31:0/745141608 conn(0x7f008006ea10 msgr2=0x7f0080114240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.962+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 shutdown_connections 2024-06-02T22:50:15.964 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:15.963+0000 7f0086600640 1 -- 172.21.15.31:0/745141608 wait complete. 2024-06-02T22:50:16.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:16 smithi178 ceph-mon[36614]: pgmap v909: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-06-02T22:50:16.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:16 smithi031 ceph-mon[31767]: pgmap v909: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-06-02T22:50:16.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:16 smithi098 ceph-mon[36750]: pgmap v909: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 4.8 MiB/s wr, 516 op/s 2024-06-02T22:50:18.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:18 smithi178 ceph-mon[36614]: pgmap v910: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-06-02T22:50:18.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:18 smithi031 ceph-mon[31767]: pgmap v910: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-06-02T22:50:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:18 smithi098 ceph-mon[36750]: pgmap v910: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-06-02T22:50:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 775.0 s, 423.2 tps, lat 237.640 ms stddev 346.555 2024-06-02T22:50:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:20 smithi178 ceph-mon[36614]: pgmap v911: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2024-06-02T22:50:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:20 smithi031 ceph-mon[31767]: pgmap v911: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2024-06-02T22:50:20.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:20 smithi098 ceph-mon[36750]: pgmap v911: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 534 op/s 2024-06-02T22:50:22.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:22 smithi178 ceph-mon[36614]: pgmap v912: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-06-02T22:50:22.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:22 smithi031 ceph-mon[31767]: pgmap v912: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-06-02T22:50:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:22 smithi098 ceph-mon[36750]: pgmap v912: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 4.4 MiB/s wr, 467 op/s 2024-06-02T22:50:24.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:24 smithi178 ceph-mon[36614]: pgmap v913: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-06-02T22:50:24.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:24 smithi031 ceph-mon[31767]: pgmap v913: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-06-02T22:50:24.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:24 smithi098 ceph-mon[36750]: pgmap v913: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-06-02T22:50:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 780.0 s, 512.0 tps, lat 199.483 ms stddev 281.991 2024-06-02T22:50:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:26 smithi031 ceph-mon[31767]: pgmap v914: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-06-02T22:50:26.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:26 smithi098 ceph-mon[36750]: pgmap v914: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-06-02T22:50:26.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:26 smithi178 ceph-mon[36614]: pgmap v914: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-06-02T22:50:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:28 smithi031 ceph-mon[31767]: pgmap v915: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.8 MiB/s wr, 395 op/s 2024-06-02T22:50:28.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:28 smithi098 ceph-mon[36750]: pgmap v915: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.8 MiB/s wr, 395 op/s 2024-06-02T22:50:28.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:28 smithi178 ceph-mon[36614]: pgmap v915: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.8 MiB/s wr, 395 op/s 2024-06-02T22:50:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.156+0000 7fc641800640 1 -- 172.21.15.31:0/3079830826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c102300 msgr2=0x7fc63c1046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.156+0000 7fc641800640 1 --2- 172.21.15.31:0/3079830826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c102300 0x7fc63c1046f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc62c00fb10 tx=0x7fc62c02e570 comp rx=0 tx=0).stop 2024-06-02T22:50:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 -- 172.21.15.31:0/3079830826 shutdown_connections 2024-06-02T22:50:29.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 --2- 172.21.15.31:0/3079830826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c107560 0x7fc63c109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 --2- 172.21.15.31:0/3079830826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c104c30 0x7fc63c107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 --2- 172.21.15.31:0/3079830826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c102300 0x7fc63c1046f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 -- 172.21.15.31:0/3079830826 >> 172.21.15.31:0/3079830826 conn(0x7fc63c0fbc90 msgr2=0x7fc63c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 -- 172.21.15.31:0/3079830826 shutdown_connections 2024-06-02T22:50:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.157+0000 7fc641800640 1 -- 172.21.15.31:0/3079830826 wait complete. 2024-06-02T22:50:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 Processor -- start 2024-06-02T22:50:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 -- start start 2024-06-02T22:50:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c102300 0x7fc63c19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c104c30 0x7fc63c19e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c10b2e0 con 0x7fc63c104c30 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c10b160 con 0x7fc63c102300 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.158+0000 7fc641800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c10b460 con 0x7fc63c107560 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42220/0 (socket says 172.21.15.31:42220) 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 -- 172.21.15.31:0/3213151284 learned_addr learned my addr 172.21.15.31:0/3213151284 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc63b400640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c104c30 0x7fc63c19e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 -- 172.21.15.31:0/3213151284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c102300 msgr2=0x7fc63c19e170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c102300 0x7fc63c19e170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 -- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c104c30 msgr2=0x7fc63c19e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c104c30 0x7fc63c19e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 -- 172.21.15.31:0/3213151284 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c1a5d90 con 0x7fc63c107560 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.159+0000 7fc640e00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc63400eaa0 tx=0x7fc63400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.160+0000 7fc638c00640 1 -- 172.21.15.31:0/3213151284 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400cdb0 con 0x7fc63c107560 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.160+0000 7fc638c00640 1 -- 172.21.15.31:0/3213151284 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc634005020 con 0x7fc63c107560 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.160+0000 7fc638c00640 1 -- 172.21.15.31:0/3213151284 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6340116b0 con 0x7fc63c107560 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.160+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c1a6080 con 0x7fc63c107560 2024-06-02T22:50:29.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.160+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c1a6570 con 0x7fc63c107560 2024-06-02T22:50:29.164 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.163+0000 7fc638c00640 1 -- 172.21.15.31:0/3213151284 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fc634005560 con 0x7fc63c107560 2024-06-02T22:50:29.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.164+0000 7fc645d95740 1 Processor -- start 2024-06-02T22:50:29.165 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.164+0000 7fc645d95740 1 -- start start 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb5d90 0x561581fb61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fbdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561581f19420 con 0x561581fbb8f0 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561581ec0c50 con 0x561581fb6780 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc645d95740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561581f153e0 con 0x561581fb5d90 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc63be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc63be00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:37338/0 (socket says 172.21.15.31:37338) 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc63be00640 1 -- 172.21.15.31:0/3513913808 learned_addr learned my addr 172.21.15.31:0/3513913808 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc63b400640 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb5d90 0x561581fb61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc638c00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 0x7fc6200a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.165+0000 7fc63b400640 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fbdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc638c00640 1 -- 172.21.15.31:0/3213151284 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc6340cf6a0 con 0x7fc63c107560 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc640e00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 0x7fc6200a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 -- 172.21.15.31:0/3513913808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb5d90 msgr2=0x561581fb61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb5d90 0x561581fb61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 -- 172.21.15.31:0/3513913808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 msgr2=0x561581fbdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fbdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 -- 172.21.15.31:0/3513913808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561581c2d210 con 0x561581fb6780 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc640e00640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 0x7fc6200a50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc634098540 tx=0x7fc634005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.166+0000 7fc63be00640 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004d20 tx=0x7fc62c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a89b2bf2272a59 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.167+0000 7fc631600640 1 -- 172.21.15.31:0/3513913808 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c042020 con 0x561581fb6780 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.167+0000 7fc631600640 1 -- 172.21.15.31:0/3513913808 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c00ea70 con 0x561581fb6780 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.167+0000 7fc631600640 1 -- 172.21.15.31:0/3513913808 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c004dc0 con 0x561581fb6780 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- 172.21.15.31:0/3513913808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 msgr2=0x561581fbb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004d20 tx=0x7fc62c004750 comp rx=0 tx=0).stop 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- 172.21.15.31:0/3513913808 shutdown_connections 2024-06-02T22:50:29.169 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fbdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb6780 0x561581fbb280 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 --2- 172.21.15.31:0/3513913808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb5d90 0x561581fb61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- 172.21.15.31:0/3513913808 >> 172.21.15.31:0/3513913808 conn(0x561581f7df80 msgr2=0x561581fb1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- 172.21.15.31:0/3513913808 shutdown_connections 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- 172.21.15.31:0/3513913808 wait complete. 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.168+0000 7fc645d95740 1 -- start start 2024-06-02T22:50:29.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.169+0000 7fc645d95740 1 Processor -- start 2024-06-02T22:50:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.172 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fc76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x561581fbe840 con 0x561581fbb8f0 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561581ed40b0 con 0x561581fb5d90 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561581fbe9c0 con 0x561581fb6780 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.171+0000 7fc645d95740 10 client.0 _ll_register_callbacks cb 0x561581ebff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.172+0000 7fc63be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.172+0000 7fc63b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fc76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.172+0000 7fc63be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42252/0 (socket says 172.21.15.31:42252) 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.173+0000 7fc63be00640 1 -- 172.21.15.31:0/2226929461 learned_addr learned my addr 172.21.15.31:0/2226929461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:29.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.173+0000 7fc63b400640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.174+0000 7fc63be00640 1 -- 172.21.15.31:0/2226929461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 msgr2=0x561581fc0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.174+0000 7fc63be00640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.174+0000 7fc63be00640 1 -- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 msgr2=0x561581fc76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.174+0000 7fc63be00640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fc76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.175+0000 7fc63be00640 1 -- 172.21.15.31:0/2226929461 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561581cf9620 con 0x561581fb6780 2024-06-02T22:50:29.175 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.175+0000 7fc63b400640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fc76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:50:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.175+0000 7fc63be00640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc62c02ea90 tx=0x7fc62c00f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba6f0aa0b6b4c67 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.175+0000 7fc626000640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:50:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c042030 con 0x561581fb6780 2024-06-02T22:50:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc62c00e3c0 con 0x561581fb6780 2024-06-02T22:50:29.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c00ea70 con 0x561581fb6780 2024-06-02T22:50:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc62c059050 con 0x561581fb6780 2024-06-02T22:50:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc645d95740 10 client.26125 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561581fbe840 con 0x561581fb6780 2024-06-02T22:50:29.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.176+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c00ea70 con 0x561581fb6780 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc62c03e440 con 0x561581fb6780 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 10 client.26125 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 10 client.26125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 20 client.26125 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561581fcbd10 0x561581fce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 4 client.26125 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:50:29.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.177+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561581f26b50 con 0x561581fcbd10 2024-06-02T22:50:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.178+0000 7fc63b400640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561581fcbd10 0x561581fce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.178+0000 7fc63b400640 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561581fcbd10 0x561581fce100 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3868230d980b8c9 server_cookie=a73ce125fed23fb8 in_seq=0 out_seq=0 2024-06-02T22:50:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.178+0000 7fc626000640 10 client.26125 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:29.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.179+0000 7fc626000640 1 -- 172.21.15.31:0/2226929461 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561581f26b50 con 0x561581fcbd10 2024-06-02T22:50:29.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.179+0000 7fc626000640 10 client.26125 handle_command_reply: tid=0 2024-06-02T22:50:29.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.179+0000 7fc645d95740 1 client.26125 shutdown 2024-06-02T22:50:29.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 msgr2=0x561581fc0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc62c02ea90 tx=0x7fc62c00f820 comp rx=0 tx=0).stop 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 shutdown_connections 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561581fcbd10 0x561581fce100 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fbb8f0 0x561581fc76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc0660 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 --2- 172.21.15.31:0/2226929461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 >> 172.21.15.31:0/2226929461 conn(0x561581f7df80 msgr2=0x561581fb0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc626000640 0 client.26125 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 shutdown_connections 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 1 -- 172.21.15.31:0/2226929461 wait complete. 2024-06-02T22:50:29.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.180+0000 7fc645d95740 20 client.26125 trim_cache size 0 max 16384 2024-06-02T22:50:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 Processor -- start 2024-06-02T22:50:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 -- start start 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 0x561581fb19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fbb8f0 0x561581fb46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1b0ab0 con 0x561581fb5d90 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1b25f0 con 0x561581fbb8f0 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.209+0000 7fc645d95740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1b1180 con 0x561581fb6780 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 0x561581fb19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:42264/0 (socket says 172.21.15.31:42264) 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 -- 172.21.15.31:0/753519269 learned_addr learned my addr 172.21.15.31:0/753519269 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63b400640 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fbb8f0 0x561581fb46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 -- 172.21.15.31:0/753519269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fbb8f0 msgr2=0x561581fb46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fbb8f0 0x561581fb46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 -- 172.21.15.31:0/753519269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 msgr2=0x561581fb19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 0x561581fb19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63be00640 1 -- 172.21.15.31:0/753519269 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561581facfd0 con 0x561581fb6780 2024-06-02T22:50:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.210+0000 7fc63b400640 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 0x561581fb19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:50:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.211+0000 7fc63be00640 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc62c03ea00 tx=0x7fc62c00f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9509e9c9a782152a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.211+0000 7fc630c00640 1 -- 172.21.15.31:0/753519269 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c062070 con 0x561581fb6780 2024-06-02T22:50:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.211+0000 7fc630c00640 1 -- 172.21.15.31:0/753519269 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c03ee50 con 0x561581fb6780 2024-06-02T22:50:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.211+0000 7fc630c00640 1 -- 172.21.15.31:0/753519269 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c042040 con 0x561581fb6780 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- 172.21.15.31:0/753519269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 msgr2=0x561581fc7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc62c03ea00 tx=0x7fc62c00f890 comp rx=0 tx=0).stop 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- 172.21.15.31:0/753519269 shutdown_connections 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fbb8f0 0x561581fb46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fb6780 0x561581fc7660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 --2- 172.21.15.31:0/753519269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb5d90 0x561581fb19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- 172.21.15.31:0/753519269 >> 172.21.15.31:0/753519269 conn(0x561581f7df80 msgr2=0x561581fb1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- 172.21.15.31:0/753519269 shutdown_connections 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- 172.21.15.31:0/753519269 wait complete. 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.212+0000 7fc645d95740 1 -- start start 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 Processor -- start 2024-06-02T22:50:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb6780 0x561581fc40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fbb8f0 0x561581fc4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1b1f20 con 0x561581fb6780 2024-06-02T22:50:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1b1850 con 0x561581fb5d90 2024-06-02T22:50:29.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c1aea90 con 0x561581fbb8f0 2024-06-02T22:50:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc645d95740 10 client.0 _ll_register_callbacks cb 0x7fc628009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc63b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc63b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:37348/0 (socket says 172.21.15.31:37348) 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc63b400640 1 -- 172.21.15.31:0/2049332546 learned_addr learned my addr 172.21.15.31:0/2049332546 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc63b400640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fbb8f0 0x561581fc4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.213+0000 7fc63be00640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb6780 0x561581fc40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 -- 172.21.15.31:0/2049332546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fbb8f0 msgr2=0x561581fc4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fbb8f0 0x561581fc4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 -- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb6780 msgr2=0x561581fc40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb6780 0x561581fc40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 -- 172.21.15.31:0/2049332546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615820349a0 con 0x561581fb5d90 2024-06-02T22:50:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc63b400640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc628009fd0 tx=0x7fc628017040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9834dc230beff2c9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc626000640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.214+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628034060 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c03ee50 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fc628013a30 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc62803b050 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 10 client.26144 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561582035d70 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c03ee50 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc628011440 con 0x561581fb5d90 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 10 client.26144 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 10 client.26144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 20 client.26144 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561582036620 0x561582038a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 4 client.26144 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:50:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.215+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561581f20ea0 con 0x561582036620 2024-06-02T22:50:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.216+0000 7fc63be00640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561582036620 0x561582038a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.217+0000 7fc63be00640 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561582036620 0x561582038a40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28476080ab045342 server_cookie=dd46b852a6c73475 in_seq=0 out_seq=0 2024-06-02T22:50:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.217+0000 7fc626000640 10 client.26144 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:29.282 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc626000640 1 -- 172.21.15.31:0/2049332546 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561581f20ea0 con 0x561582036620 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc626000640 10 client.26144 handle_command_reply: tid=0 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 client.26144 shutdown 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 msgr2=0x561581fc7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc628009fd0 tx=0x7fc628017040 comp rx=0 tx=0).stop 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 shutdown_connections 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x561582036620 0x561582038a40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561581fbb8f0 0x561581fc4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x561581fb6780 0x561581fc40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 --2- 172.21.15.31:0/2049332546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561581fb5d90 0x561581fc7650 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.283 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc626000640 0 client.26144 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 >> 172.21.15.31:0/2049332546 conn(0x561581f7df80 msgr2=0x561581fb46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.282+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 shutdown_connections 2024-06-02T22:50:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.283+0000 7fc645d95740 1 -- 172.21.15.31:0/2049332546 wait complete. 2024-06-02T22:50:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.283+0000 7fc645d95740 20 client.26144 trim_cache size 0 max 16384 2024-06-02T22:50:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:50:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:50:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:50:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 msgr2=0x7fc6200a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 0x7fc6200a50c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc634098540 tx=0x7fc634005850 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 msgr2=0x7fc63c1a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc63400eaa0 tx=0x7fc63400ef60 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 shutdown_connections 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fc6200a2c00 0x7fc6200a50c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc63c107560 0x7fc63c1a5720 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc63c104c30 0x7fc63c19e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 --2- 172.21.15.31:0/3213151284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc63c102300 0x7fc63c19e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 >> 172.21.15.31:0/3213151284 conn(0x7fc63c0fbc90 msgr2=0x7fc63c102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 shutdown_connections 2024-06-02T22:50:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:29.284+0000 7fc641800640 1 -- 172.21.15.31:0/3213151284 wait complete. 2024-06-02T22:50:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 785.0 s, 440.8 tps, lat 229.175 ms stddev 254.696 2024-06-02T22:50:30.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:30 smithi178 ceph-mon[36614]: pgmap v916: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:50:30.624 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:30 smithi031 ceph-mon[31767]: pgmap v916: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:50:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:30 smithi098 ceph-mon[36750]: pgmap v916: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:50:32.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:32 smithi031 ceph-mon[31767]: pgmap v917: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 460 op/s 2024-06-02T22:50:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:32 smithi098 ceph-mon[36750]: pgmap v917: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 460 op/s 2024-06-02T22:50:32.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:32 smithi178 ceph-mon[36614]: pgmap v917: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.2 MiB/s wr, 460 op/s 2024-06-02T22:50:34.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:34 smithi031 ceph-mon[31767]: pgmap v918: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-06-02T22:50:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:34 smithi098 ceph-mon[36750]: pgmap v918: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-06-02T22:50:34.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:34 smithi178 ceph-mon[36614]: pgmap v918: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.4 MiB/s wr, 485 op/s 2024-06-02T22:50:35.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 790.0 s, 559.0 tps, lat 180.481 ms stddev 207.875 2024-06-02T22:50:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:36 smithi031 ceph-mon[31767]: pgmap v919: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-06-02T22:50:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:36 smithi098 ceph-mon[36750]: pgmap v919: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-06-02T22:50:36.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:36 smithi178 ceph-mon[36614]: pgmap v919: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-06-02T22:50:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:38 smithi031 ceph-mon[31767]: pgmap v920: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2024-06-02T22:50:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:38 smithi098 ceph-mon[36750]: pgmap v920: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2024-06-02T22:50:38.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:38 smithi178 ceph-mon[36614]: pgmap v920: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 399 op/s 2024-06-02T22:50:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 795.0 s, 611.4 tps, lat 162.187 ms stddev 180.569 2024-06-02T22:50:40.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:40 smithi031 ceph-mon[31767]: pgmap v921: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:40 smithi098 ceph-mon[36750]: pgmap v921: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:40.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:40 smithi178 ceph-mon[36614]: pgmap v921: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.492+0000 7f166b200640 1 -- 172.21.15.31:0/2685584446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 msgr2=0x7f166409d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.492+0000 7f166b200640 1 --2- 172.21.15.31:0/2685584446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f166409d9e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f165c009900 tx=0x7f165c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 -- 172.21.15.31:0/2685584446 shutdown_connections 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 --2- 172.21.15.31:0/2685584446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f16640a47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 --2- 172.21.15.31:0/2685584446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f166409d9e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 --2- 172.21.15.31:0/2685584446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f166409c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 -- 172.21.15.31:0/2685584446 >> 172.21.15.31:0/2685584446 conn(0x7f166400b310 msgr2=0x7f166400b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 -- 172.21.15.31:0/2685584446 shutdown_connections 2024-06-02T22:50:42.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.496+0000 7f166b200640 1 -- 172.21.15.31:0/2685584446 wait complete. 2024-06-02T22:50:42.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.498+0000 7f166b200640 1 Processor -- start 2024-06-02T22:50:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.498+0000 7f166b200640 1 -- start start 2024-06-02T22:50:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.499+0000 7f166b200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f1664132710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.499+0000 7f166b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f1664132c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.500+0000 7f166b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f1664139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.500+0000 7f166b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16640a8090 con 0x7f166409df20 2024-06-02T22:50:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.500+0000 7f166b200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16640a7f10 con 0x7f166409c370 2024-06-02T22:50:42.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.500+0000 7f166b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f16640a8210 con 0x7f166409d560 2024-06-02T22:50:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.500+0000 7f166a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f1664139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.501+0000 7f166a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f1664139cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58806/0 (socket says 172.21.15.31:58806) 2024-06-02T22:50:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.501+0000 7f166a800640 1 -- 172.21.15.31:0/3453658698 learned_addr learned my addr 172.21.15.31:0/3453658698 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:42.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.501+0000 7f1669400640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f1664132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.501+0000 7f1669e00640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f1664132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669400640 1 -- 172.21.15.31:0/3453658698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 msgr2=0x7f1664132710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669400640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f1664132710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669400640 1 -- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 msgr2=0x7f1664139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669400640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f1664139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669400640 1 -- 172.21.15.31:0/3453658698 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166413a330 con 0x7f166409d560 2024-06-02T22:50:42.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.502+0000 7f1669e00640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f1664132710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:50:42.502 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.503+0000 7f1669400640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f1664132c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f165c02a910 tx=0x7f165c032e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.503+0000 7f1662a00640 1 -- 172.21.15.31:0/3453658698 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c03f030 con 0x7f166409d560 2024-06-02T22:50:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.503+0000 7f1662a00640 1 -- 172.21.15.31:0/3453658698 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c003ce0 con 0x7f166409d560 2024-06-02T22:50:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.503+0000 7f1662a00640 1 -- 172.21.15.31:0/3453658698 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c035070 con 0x7f166409d560 2024-06-02T22:50:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.503+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166413a5c0 con 0x7f166409d560 2024-06-02T22:50:42.503 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.504+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166413aa30 con 0x7f166409d560 2024-06-02T22:50:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.509+0000 7f1662a00640 1 -- 172.21.15.31:0/3453658698 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f165c042030 con 0x7f166409d560 2024-06-02T22:50:42.511 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.512+0000 7f1662a00640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 0x7f16500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.512+0000 7f1674199740 1 Processor -- start 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 -- start start 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.512+0000 7f1662a00640 1 -- 172.21.15.31:0/3453658698 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f165c0efa00 con 0x7f166409d560 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e64984da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564e648e0420 con 0x564e6497d7a0 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e64887c50 con 0x564e6497cdb0 2024-06-02T22:50:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.513+0000 7f1674199740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564e648dc3e0 con 0x564e64982910 2024-06-02T22:50:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.514+0000 7f1669e00640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 0x7f16500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.514+0000 7f1669400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.514+0000 7f1669400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58808/0 (socket says 172.21.15.31:58808) 2024-06-02T22:50:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.514+0000 7f1669400640 1 -- 172.21.15.31:0/3105422881 learned_addr learned my addr 172.21.15.31:0/3105422881 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669e00640 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 -- 172.21.15.31:0/3105422881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 msgr2=0x564e64984da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e64984da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 -- 172.21.15.31:0/3105422881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 msgr2=0x564e6497d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 -- 172.21.15.31:0/3105422881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e645f4210 con 0x564e6497d7a0 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.515+0000 7f1669400640 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c45b0 tx=0x7f165c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1072d907867321c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.516+0000 7f1657400640 1 -- 172.21.15.31:0/3105422881 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0c0220 con 0x564e6497d7a0 2024-06-02T22:50:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.516+0000 7f1657400640 1 -- 172.21.15.31:0/3105422881 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c0c4ae0 con 0x564e6497d7a0 2024-06-02T22:50:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.516+0000 7f1657400640 1 -- 172.21.15.31:0/3105422881 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0c48b0 con 0x564e6497d7a0 2024-06-02T22:50:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.516+0000 7f1669e00640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 0x7f16500a5150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f166c067180 tx=0x7f166c067e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.518+0000 7f1674199740 1 -- 172.21.15.31:0/3105422881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 msgr2=0x564e649822a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.518+0000 7f1674199740 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c45b0 tx=0x7f165c032f90 comp rx=0 tx=0).stop 2024-06-02T22:50:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 -- 172.21.15.31:0/3105422881 shutdown_connections 2024-06-02T22:50:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e64984da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e649822a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 --2- 172.21.15.31:0/3105422881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 -- 172.21.15.31:0/3105422881 >> 172.21.15.31:0/3105422881 conn(0x564e64944f80 msgr2=0x564e64978830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 -- 172.21.15.31:0/3105422881 shutdown_connections 2024-06-02T22:50:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.519+0000 7f1674199740 1 -- 172.21.15.31:0/3105422881 wait complete. 2024-06-02T22:50:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.520+0000 7f1674199740 1 -- start start 2024-06-02T22:50:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.520+0000 7f1674199740 1 Processor -- start 2024-06-02T22:50:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e64986e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e64987350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x564e64985680 con 0x564e6497d7a0 2024-06-02T22:50:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e6489b0b0 con 0x564e64982910 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x564e64985800 con 0x564e6497cdb0 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.522+0000 7f1674199740 10 client.0 _ll_register_callbacks cb 0x564e64886f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.523+0000 7f1669e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e64986e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.523+0000 7f1669e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e64986e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39782/0 (socket says 172.21.15.31:39782) 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.523+0000 7f1669e00640 1 -- 172.21.15.31:0/607775171 learned_addr learned my addr 172.21.15.31:0/607775171 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.523+0000 7f1669400640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e64987350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.524+0000 7f1669400640 1 -- 172.21.15.31:0/607775171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 msgr2=0x564e64986e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.524+0000 7f1669400640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e64986e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.524+0000 7f1669400640 1 -- 172.21.15.31:0/607775171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 msgr2=0x564e6498e390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.525+0000 7f166a800640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.526+0000 7f1669400640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.526+0000 7f1669400640 1 -- 172.21.15.31:0/607775171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e646c0620 con 0x564e6497d7a0 2024-06-02T22:50:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.526+0000 7f166a800640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.528+0000 7f1669400640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e64987350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c45b0 tx=0x7f165c0057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22e669f3ff00c91 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.528+0000 7f164be00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:50:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.528+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0d8070 con 0x564e6497d7a0 2024-06-02T22:50:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.528+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f165c0c4650 con 0x564e6497d7a0 2024-06-02T22:50:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.529+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f165c0c4ae0 con 0x564e6497d7a0 2024-06-02T22:50:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.529+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f165c0c4890 con 0x564e6497d7a0 2024-06-02T22:50:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.529+0000 7f1674199740 10 client.15768 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.529+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e64985680 con 0x564e6497d7a0 2024-06-02T22:50:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c0c4ae0 con 0x564e6497d7a0 2024-06-02T22:50:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f165c09ace0 con 0x564e6497d7a0 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 10 client.15768 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 20 client.15768 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649929d0 0x564e64994dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 4 client.15768 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:50:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.531+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e648edb50 con 0x564e649929d0 2024-06-02T22:50:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.532+0000 7f1669e00640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649929d0 0x564e64994dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.533+0000 7f164be00640 10 client.15768 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.533+0000 7f1669e00640 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649929d0 0x564e64994dc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0d06c3ba3d62db server_cookie=2e7f2c48846feef in_seq=0 out_seq=0 2024-06-02T22:50:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.537+0000 7f164be00640 1 -- 172.21.15.31:0/607775171 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564e648edb50 con 0x564e649929d0 2024-06-02T22:50:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.537+0000 7f164be00640 10 client.15768 handle_command_reply: tid=0 2024-06-02T22:50:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.538+0000 7f1674199740 1 client.15768 shutdown 2024-06-02T22:50:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.538+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 msgr2=0x564e64987350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.538+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e64987350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c45b0 tx=0x7f165c0057e0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 shutdown_connections 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649929d0 0x564e64994dc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e64987350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 --2- 172.21.15.31:0/607775171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e64986e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f164be00640 0 client.15768 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 >> 172.21.15.31:0/607775171 conn(0x564e64944f80 msgr2=0x564e64977970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 shutdown_connections 2024-06-02T22:50:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 1 -- 172.21.15.31:0/607775171 wait complete. 2024-06-02T22:50:42.542 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.542+0000 7f1674199740 20 client.15768 trim_cache size 0 max 16384 2024-06-02T22:50:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.583+0000 7f1674199740 1 Processor -- start 2024-06-02T22:50:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.583+0000 7f1674199740 1 -- start start 2024-06-02T22:50:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.583+0000 7f1674199740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.583+0000 7f1674199740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.583+0000 7f1674199740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e6497f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1674199740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f166413c7f0 con 0x564e6497d7a0 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1674199740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f166413e330 con 0x564e6497cdb0 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1674199740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f166413cec0 con 0x564e64982910 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1669e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1669400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f166a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e6497f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1669e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43412/0 (socket says 172.21.15.31:43412) 2024-06-02T22:50:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.584+0000 7f1669e00640 1 -- 172.21.15.31:0/3374806176 learned_addr learned my addr 172.21.15.31:0/3374806176 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.585+0000 7f166a800640 1 -- 172.21.15.31:0/3374806176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 msgr2=0x564e6497eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.585+0000 7f166a800640 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.585+0000 7f166a800640 1 -- 172.21.15.31:0/3374806176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 msgr2=0x564e6498e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.585+0000 7f166a800640 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.585+0000 7f166a800640 1 -- 172.21.15.31:0/3374806176 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e649825f0 con 0x564e64982910 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.586+0000 7f166a800640 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e6497f040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1658005fd0 tx=0x7f16580117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed3cd6ccb599060 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.586+0000 7f1656a00640 1 -- 172.21.15.31:0/3374806176 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658004020 con 0x564e64982910 2024-06-02T22:50:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.586+0000 7f1656a00640 1 -- 172.21.15.31:0/3374806176 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16580041c0 con 0x564e64982910 2024-06-02T22:50:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.587+0000 7f1674199740 1 -- 172.21.15.31:0/3374806176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 msgr2=0x564e6497f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.587+0000 7f1656a00640 1 -- 172.21.15.31:0/3374806176 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658004020 con 0x564e64982910 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.587+0000 7f1674199740 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e6497f040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1658005fd0 tx=0x7f16580117b0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 -- 172.21.15.31:0/3374806176 shutdown_connections 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e64982910 0x564e6497f040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 --2- 172.21.15.31:0/3374806176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e6497cdb0 0x564e6497eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 -- 172.21.15.31:0/3374806176 >> 172.21.15.31:0/3374806176 conn(0x564e64944f80 msgr2=0x564e649782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 -- 172.21.15.31:0/3374806176 shutdown_connections 2024-06-02T22:50:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 -- 172.21.15.31:0/3374806176 wait complete. 2024-06-02T22:50:42.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.588+0000 7f1674199740 1 -- start start 2024-06-02T22:50:42.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.589+0000 7f1674199740 1 Processor -- start 2024-06-02T22:50:42.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.590+0000 7f1674199740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e6498b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.589 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.590+0000 7f1674199740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1674199740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1669e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e6498b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43428/0 (socket says 172.21.15.31:43428) 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 -- 172.21.15.31:0/1349023855 learned_addr learned my addr 172.21.15.31:0/1349023855 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f166413dc60 con 0x564e6497d7a0 2024-06-02T22:50:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f166413d590 con 0x564e64982910 2024-06-02T22:50:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1664015690 con 0x564e6497cdb0 2024-06-02T22:50:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f1674199740 10 client.0 _ll_register_callbacks cb 0x7f165c0b81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 -- 172.21.15.31:0/1349023855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 msgr2=0x564e6498b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e6498b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 -- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 msgr2=0x564e6498b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.591+0000 7f166a800640 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6498cf80 con 0x564e64982910 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.592+0000 7f166a800640 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1658003fa0 tx=0x7f16580044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9709b77921b45a72 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.592+0000 7f164be00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.592+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658003a00 con 0x564e64982910 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.592+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16580041c0 con 0x564e64982910 2024-06-02T22:50:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.593+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f1658005050 con 0x564e64982910 2024-06-02T22:50:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.593+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1658032050 con 0x564e64982910 2024-06-02T22:50:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.593+0000 7f1674199740 10 client.26156 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.593+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e6498e270 con 0x564e64982910 2024-06-02T22:50:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.594+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16580041c0 con 0x564e64982910 2024-06-02T22:50:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.595+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1658004c60 con 0x564e64982910 2024-06-02T22:50:42.594 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.595+0000 7f1674199740 10 client.26156 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.595+0000 7f1674199740 10 client.26156 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.595+0000 7f1674199740 20 client.26156 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.595+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649fd8e0 0x564e649ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.596+0000 7f1674199740 4 client.26156 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.596+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e648e7ea0 con 0x564e649fd8e0 2024-06-02T22:50:42.595 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.596+0000 7f1669e00640 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649fd8e0 0x564e649ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.597+0000 7f1669e00640 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649fd8e0 0x564e649ffd00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a8eb932162a102 server_cookie=3abe4698d92172c8 in_seq=0 out_seq=0 2024-06-02T22:50:42.597 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.598+0000 7f164be00640 10 client.26156 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f164be00640 1 -- 172.21.15.31:0/1349023855 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564e648e7ea0 con 0x564e649fd8e0 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f164be00640 10 client.26156 handle_command_reply: tid=0 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 client.26156 shutdown 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 msgr2=0x564e6498c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1658003fa0 tx=0x7f16580044b0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 shutdown_connections 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x564e649fd8e0 0x564e649ffd00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e64982910 0x564e6498c990 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x564e6497d7a0 0x564e6498b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 --2- 172.21.15.31:0/1349023855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564e6497cdb0 0x564e6498b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 >> 172.21.15.31:0/1349023855 conn(0x564e64944f80 msgr2=0x564e64986dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.652+0000 7f164be00640 0 client.26156 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.653+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 shutdown_connections 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.653+0000 7f1674199740 1 -- 172.21.15.31:0/1349023855 wait complete. 2024-06-02T22:50:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.653+0000 7f1674199740 20 client.26156 trim_cache size 0 max 16384 2024-06-02T22:50:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:50:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:50:42.654 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 msgr2=0x7f16500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 0x7f16500a5150 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f166c067180 tx=0x7f166c067e40 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 msgr2=0x7f1664132c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f1664132c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f165c02a910 tx=0x7f165c032e20 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 shutdown_connections 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f16500a2c90 0x7f16500a5150 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f166409df20 0x7f1664139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f166409d560 0x7f1664132c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 --2- 172.21.15.31:0/3453658698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f166409c370 0x7f1664132710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 >> 172.21.15.31:0/3453658698 conn(0x7f166400b310 msgr2=0x7f16640a0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 shutdown_connections 2024-06-02T22:50:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:42.654+0000 7f166b200640 1 -- 172.21.15.31:0/3453658698 wait complete. 2024-06-02T22:50:42.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:42 smithi098 ceph-mon[36750]: pgmap v922: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-06-02T22:50:42.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:42 smithi178 ceph-mon[36614]: pgmap v922: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-06-02T22:50:42.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:42 smithi031 ceph-mon[31767]: pgmap v922: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 514 op/s 2024-06-02T22:50:44.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:44 smithi098 ceph-mon[36750]: pgmap v923: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 544 op/s 2024-06-02T22:50:44.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:44 smithi178 ceph-mon[36614]: pgmap v923: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 544 op/s 2024-06-02T22:50:44.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:44 smithi031 ceph-mon[31767]: pgmap v923: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.3 MiB/s wr, 544 op/s 2024-06-02T22:50:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 800.0 s, 511.2 tps, lat 186.301 ms stddev 214.820 2024-06-02T22:50:46.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:46 smithi098 ceph-mon[36750]: pgmap v924: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:46.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:46 smithi178 ceph-mon[36614]: pgmap v924: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:46.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:46 smithi031 ceph-mon[31767]: pgmap v924: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.4 MiB/s wr, 563 op/s 2024-06-02T22:50:47.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:47 smithi098 ceph-mon[36750]: pgmap v925: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2024-06-02T22:50:47.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:47 smithi178 ceph-mon[36614]: pgmap v925: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2024-06-02T22:50:47.870 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:47 smithi031 ceph-mon[31767]: pgmap v925: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.2 MiB/s wr, 450 op/s 2024-06-02T22:50:50.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:49 smithi031 ceph-mon[31767]: pgmap v926: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-06-02T22:50:50.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:49 smithi098 ceph-mon[36750]: pgmap v926: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-06-02T22:50:50.226 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 805.0 s, 499.8 tps, lat 201.622 ms stddev 268.202 2024-06-02T22:50:50.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:49 smithi178 ceph-mon[36614]: pgmap v926: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-06-02T22:50:52.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:51 smithi098 ceph-mon[36750]: pgmap v927: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-06-02T22:50:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:51 smithi178 ceph-mon[36614]: pgmap v927: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-06-02T22:50:52.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:51 smithi031 ceph-mon[31767]: pgmap v927: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.5 MiB/s wr, 503 op/s 2024-06-02T22:50:54.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:53 smithi098 ceph-mon[36750]: pgmap v928: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 524 op/s 2024-06-02T22:50:54.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:53 smithi178 ceph-mon[36614]: pgmap v928: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 524 op/s 2024-06-02T22:50:54.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:53 smithi031 ceph-mon[31767]: pgmap v928: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.7 MiB/s wr, 524 op/s 2024-06-02T22:50:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 810.0 s, 422.2 tps, lat 235.789 ms stddev 317.811 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 -- 172.21.15.31:0/3039532631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10b5d0 msgr2=0x7faa3c10da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 --2- 172.21.15.31:0/3039532631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10b5d0 0x7faa3c10da20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009860 tx=0x7faa2c02a340 comp rx=0 tx=0).stop 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 -- 172.21.15.31:0/3039532631 shutdown_connections 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 --2- 172.21.15.31:0/3039532631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10e0b0 0x7faa3c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 --2- 172.21.15.31:0/3039532631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10b5d0 0x7faa3c10da20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 --2- 172.21.15.31:0/3039532631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c10b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 -- 172.21.15.31:0/3039532631 >> 172.21.15.31:0/3039532631 conn(0x7faa3c06ebd0 msgr2=0x7faa3c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 -- 172.21.15.31:0/3039532631 shutdown_connections 2024-06-02T22:50:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.853+0000 7faa40e00640 1 -- 172.21.15.31:0/3039532631 wait complete. 2024-06-02T22:50:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.854+0000 7faa40e00640 1 Processor -- start 2024-06-02T22:50:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 -- start start 2024-06-02T22:50:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c1a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10e0b0 0x7faa3c1a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c113c90 con 0x7faa3c108c10 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c113b10 con 0x7faa3c10b5d0 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa40e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c113e10 con 0x7faa3c10e0b0 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa31400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10e0b0 0x7faa3c1a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa31400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:39778/0 (socket says 172.21.15.31:39778) 2024-06-02T22:50:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa31400640 1 -- 172.21.15.31:0/1508083441 learned_addr learned my addr 172.21.15.31:0/1508083441 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.855+0000 7faa39e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c1a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 -- 172.21.15.31:0/1508083441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10e0b0 msgr2=0x7faa3c1a9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10e0b0 0x7faa3c1a9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 -- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 msgr2=0x7faa3c1a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c1a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 -- 172.21.15.31:0/1508083441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c1aa2e0 con 0x7faa3c10b5d0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa39e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c1a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa31400640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa2c035040 tx=0x7faa2c033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa33400640 1 -- 172.21.15.31:0/1508083441 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c037040 con 0x7faa3c10b5d0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c1aa570 con 0x7faa3c10b5d0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa33400640 1 -- 172.21.15.31:0/1508083441 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa2c030850 con 0x7faa3c10b5d0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.856+0000 7faa33400640 1 -- 172.21.15.31:0/1508083441 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2c004920 con 0x7faa3c10b5d0 2024-06-02T22:50:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.857+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1aaab0 con 0x7faa3c10b5d0 2024-06-02T22:50:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.865+0000 7faa33400640 1 -- 172.21.15.31:0/1508083441 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7faa2c004050 con 0x7faa3c10b5d0 2024-06-02T22:50:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.868+0000 7faa33400640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 0x7faa200a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.868+0000 7faa33400640 1 -- 172.21.15.31:0/1508083441 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7faa2c0ef040 con 0x7faa3c10b5d0 2024-06-02T22:50:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.868+0000 7faa39e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 0x7faa200a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.871+0000 7faa43bc3740 1 Processor -- start 2024-06-02T22:50:55.871 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 -- start start 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 0x557a934ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a9342c420 con 0x557a934c95c0 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a933d3c50 con 0x557a934c8bd0 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.872+0000 7faa43bc3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557a934283e0 con 0x557a934ce730 2024-06-02T22:50:55.872 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa39e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa39e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:39788/0 (socket says 172.21.15.31:39788) 2024-06-02T22:50:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41198/0 (socket says 172.21.15.31:41198) 2024-06-02T22:50:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa3a800640 1 -- 172.21.15.31:0/3111721960 learned_addr learned my addr 172.21.15.31:0/3111721960 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:55.873 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.873+0000 7faa31400640 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 0x557a934ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.874+0000 7faa3a800640 1 -- 172.21.15.31:0/3111721960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 msgr2=0x557a934c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.874+0000 7faa39e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 0x7faa200a5170 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa2400b3c0 tx=0x7faa24017750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa3a800640 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa3a800640 1 -- 172.21.15.31:0/3111721960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 msgr2=0x557a934ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa3a800640 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 0x557a934ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.876 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa3a800640 1 -- 172.21.15.31:0/3111721960 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a93140210 con 0x557a934ce730 2024-06-02T22:50:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa31400640 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 0x557a934ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa3a800640 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa3400a590 tx=0x7faa3400aec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d174e335dc11b6f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.877+0000 7faa2b400640 1 -- 172.21.15.31:0/3111721960 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34019030 con 0x557a934ce730 2024-06-02T22:50:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.878+0000 7faa2b400640 1 -- 172.21.15.31:0/3111721960 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa34004830 con 0x557a934ce730 2024-06-02T22:50:55.877 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.878+0000 7faa2b400640 1 -- 172.21.15.31:0/3111721960 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34008b70 con 0x557a934ce730 2024-06-02T22:50:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.879+0000 7faa43bc3740 1 -- 172.21.15.31:0/3111721960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 msgr2=0x557a934d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.879+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faa3400a590 tx=0x7faa3400aec0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 -- 172.21.15.31:0/3111721960 shutdown_connections 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d0bc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c95c0 0x557a934ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3111721960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 -- 172.21.15.31:0/3111721960 >> 172.21.15.31:0/3111721960 conn(0x557a93490f80 msgr2=0x557a934c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:55.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 -- 172.21.15.31:0/3111721960 shutdown_connections 2024-06-02T22:50:55.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.880+0000 7faa43bc3740 1 -- 172.21.15.31:0/3111721960 wait complete. 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.881+0000 7faa43bc3740 1 -- start start 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.881+0000 7faa43bc3740 1 Processor -- start 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x557a934d9ef0 con 0x557a934c8bd0 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a933e70b0 con 0x557a934c95c0 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x557a934da070 con 0x557a934ce730 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa43bc3740 10 client.0 _ll_register_callbacks cb 0x557a933d2f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41206/0 (socket says 172.21.15.31:41206) 2024-06-02T22:50:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.882+0000 7faa3a800640 1 -- 172.21.15.31:0/3650088137 learned_addr learned my addr 172.21.15.31:0/3650088137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.885+0000 7faa39e00640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa31400640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 -- 172.21.15.31:0/3650088137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 msgr2=0x557a934d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 -- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 msgr2=0x557a934d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 -- 172.21.15.31:0/3650088137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9320c620 con 0x557a934ce730 2024-06-02T22:50:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa39e00640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa31400640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa3a800640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa3400ac30 tx=0x7faa34004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22108d495115d857 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.886+0000 7faa1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:50:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34023020 con 0x557a934ce730 2024-06-02T22:50:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa34004830 con 0x557a934ce730 2024-06-02T22:50:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7faa34008af0 con 0x557a934ce730 2024-06-02T22:50:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa3402e050 con 0x557a934ce730 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa43bc3740 10 client.26158 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.887+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a934db570 con 0x557a934ce730 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa34004830 con 0x557a934ce730 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7faa3401f750 con 0x557a934ce730 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 10 client.26158 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 20 client.26158 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a934dc920 0x557a934ded70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 4 client.26158 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:50:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.888+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a93439b50 con 0x557a934dc920 2024-06-02T22:50:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.890+0000 7faa39e00640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a934dc920 0x557a934ded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.891+0000 7faa39e00640 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a934dc920 0x557a934ded70 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc634673c1e9c43 server_cookie=473250d7d3eaf46b in_seq=0 out_seq=0 2024-06-02T22:50:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.891+0000 7faa1fe00640 10 client.26158 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.892+0000 7faa1fe00640 1 -- 172.21.15.31:0/3650088137 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557a93439b50 con 0x557a934dc920 2024-06-02T22:50:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.892+0000 7faa1fe00640 10 client.26158 handle_command_reply: tid=0 2024-06-02T22:50:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.892+0000 7faa43bc3740 1 client.26158 shutdown 2024-06-02T22:50:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 msgr2=0x557a934d8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faa3400ac30 tx=0x7faa34004c70 comp rx=0 tx=0).stop 2024-06-02T22:50:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 shutdown_connections 2024-06-02T22:50:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a934dc920 0x557a934ded70 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934d8cd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 --2- 172.21.15.31:0/3650088137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.893+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 >> 172.21.15.31:0/3650088137 conn(0x557a93490f80 msgr2=0x557a934c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.894+0000 7faa1fe00640 0 client.26158 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.894+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 shutdown_connections 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.894+0000 7faa43bc3740 1 -- 172.21.15.31:0/3650088137 wait complete. 2024-06-02T22:50:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.894+0000 7faa43bc3740 20 client.26158 trim_cache size 0 max 16384 2024-06-02T22:50:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.941+0000 7faa43bc3740 1 Processor -- start 2024-06-02T22:50:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.941+0000 7faa43bc3740 1 -- start start 2024-06-02T22:50:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934de930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1b0c40 con 0x557a934c8bd0 2024-06-02T22:50:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1b2780 con 0x557a934c95c0 2024-06-02T22:50:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa43bc3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1b1310 con 0x557a934ce730 2024-06-02T22:50:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41210/0 (socket says 172.21.15.31:41210) 2024-06-02T22:50:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 -- 172.21.15.31:0/1044740142 learned_addr learned my addr 172.21.15.31:0/1044740142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa31400640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 -- 172.21.15.31:0/1044740142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 msgr2=0x557a934d8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa3a800640 1 -- 172.21.15.31:0/1044740142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 msgr2=0x557a934de930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.942+0000 7faa39e00640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934de930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.943+0000 7faa3a800640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934de930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.943+0000 7faa3a800640 1 -- 172.21.15.31:0/1044740142 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a934c99a0 con 0x557a934ce730 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.943+0000 7faa31400640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.943+0000 7faa39e00640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934de930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:50:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.944+0000 7faa3a800640 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa3400d010 tx=0x7faa34005cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e470d7b14701a89f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.945+0000 7faa2aa00640 1 -- 172.21.15.31:0/1044740142 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34023070 con 0x557a934ce730 2024-06-02T22:50:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.945+0000 7faa2aa00640 1 -- 172.21.15.31:0/1044740142 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa3401f930 con 0x557a934ce730 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.945+0000 7faa2aa00640 1 -- 172.21.15.31:0/1044740142 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa34019040 con 0x557a934ce730 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 -- 172.21.15.31:0/1044740142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 msgr2=0x557a934ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faa3400d010 tx=0x7faa34005cb0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 -- 172.21.15.31:0/1044740142 shutdown_connections 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934ce730 0x557a934ca8e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c95c0 0x557a934d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 --2- 172.21.15.31:0/1044740142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934c8bd0 0x557a934de930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.946+0000 7faa43bc3740 1 -- 172.21.15.31:0/1044740142 >> 172.21.15.31:0/1044740142 conn(0x557a93490f80 msgr2=0x557a934cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.947+0000 7faa43bc3740 1 -- 172.21.15.31:0/1044740142 shutdown_connections 2024-06-02T22:50:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.947+0000 7faa43bc3740 1 -- 172.21.15.31:0/1044740142 wait complete. 2024-06-02T22:50:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.948+0000 7faa43bc3740 1 -- start start 2024-06-02T22:50:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.950+0000 7faa43bc3740 1 Processor -- start 2024-06-02T22:50:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.951+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934d4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.951+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 0x557a934d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa43bc3740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934ce730 0x557a934d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa43bc3740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1b20b0 con 0x557a934ce730 2024-06-02T22:50:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa43bc3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1b19e0 con 0x557a934c8bd0 2024-06-02T22:50:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa43bc3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1aec20 con 0x557a934c95c0 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa31400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 0x557a934d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa31400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 0x557a934d47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41212/0 (socket says 172.21.15.31:41212) 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.952+0000 7faa31400640 1 -- 172.21.15.31:0/203547351 learned_addr learned my addr 172.21.15.31:0/203547351 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa43bc3740 10 client.0 _ll_register_callbacks cb 0x7faa34003ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 -- 172.21.15.31:0/203547351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 msgr2=0x557a934d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 0x557a934d47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 -- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934ce730 msgr2=0x557a934d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934ce730 0x557a934d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.953+0000 7faa39e00640 1 -- 172.21.15.31:0/203547351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a934d7c00 con 0x557a934c8bd0 2024-06-02T22:50:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.955+0000 7faa39e00640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934d4290 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x557a934df580 tx=0x7faa24004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d46f0c363b75b59 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:50:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:50:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24034060 con 0x557a934c8bd0 2024-06-02T22:50:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7faa24009050 con 0x557a934c8bd0 2024-06-02T22:50:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3401f930 con 0x557a934c8bd0 2024-06-02T22:50:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa240285d0 con 0x557a934c8bd0 2024-06-02T22:50:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa43bc3740 10 client.26168 fetch_fsmap learned FSMap version 30 2024-06-02T22:50:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.956+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a934d8ef0 con 0x557a934c8bd0 2024-06-02T22:50:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.957+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa3401f930 con 0x557a934c8bd0 2024-06-02T22:50:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.957+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7faa24025040 con 0x557a934c8bd0 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 10 client.26168 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 10 client.26168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 20 client.26168 populate_metadata read hostname 'smithi031' 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a9356ae00 0x557a9356d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 4 client.26168 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:50:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.958+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a93433ea0 con 0x557a9356ae00 2024-06-02T22:50:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.961+0000 7faa31400640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a9356ae00 0x557a9356d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:50:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.962+0000 7faa31400640 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a9356ae00 0x557a9356d240 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c039f3a53895193 server_cookie=b93f110f51f8a830 in_seq=0 out_seq=0 2024-06-02T22:50:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:55.962+0000 7faa1fe00640 10 client.26168 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.031+0000 7faa1fe00640 1 -- 172.21.15.31:0/203547351 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557a93433ea0 con 0x557a9356ae00 2024-06-02T22:50:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.031+0000 7faa1fe00640 10 client.26168 handle_command_reply: tid=0 2024-06-02T22:50:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 client.26168 shutdown 2024-06-02T22:50:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 msgr2=0x557a934d4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934d4290 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x557a934df580 tx=0x7faa24004730 comp rx=0 tx=0).stop 2024-06-02T22:50:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 shutdown_connections 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x557a9356ae00 0x557a9356d240 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x557a934ce730 0x557a934d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557a934c95c0 0x557a934d47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 --2- 172.21.15.31:0/203547351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a934c8bd0 0x557a934d4290 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.032+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 >> 172.21.15.31:0/203547351 conn(0x557a93490f80 msgr2=0x557a934de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.033+0000 7faa1fe00640 0 client.26168 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.033+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 shutdown_connections 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.033+0000 7faa43bc3740 1 -- 172.21.15.31:0/203547351 wait complete. 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.033+0000 7faa43bc3740 20 client.26168 trim_cache size 0 max 16384 2024-06-02T22:50:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:50:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:50:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:50:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.034+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 msgr2=0x7faa200a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.034+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 0x7faa200a5170 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faa2400b3c0 tx=0x7faa24017750 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.034+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 msgr2=0x7faa3c1a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.034+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faa2c035040 tx=0x7faa2c033d90 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 shutdown_connections 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faa200a2cb0 0x7faa200a5170 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa3c10e0b0 0x7faa3c1a9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3c10b5d0 0x7faa3c1a2c00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 --2- 172.21.15.31:0/1508083441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa3c108c10 0x7faa3c1a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 >> 172.21.15.31:0/1508083441 conn(0x7faa3c06ebd0 msgr2=0x7faa3c109550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 shutdown_connections 2024-06-02T22:50:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:50:56.035+0000 7faa40e00640 1 -- 172.21.15.31:0/1508083441 wait complete. 2024-06-02T22:50:56.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:55 smithi098 ceph-mon[36750]: pgmap v929: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 598 op/s 2024-06-02T22:50:56.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:55 smithi178 ceph-mon[36614]: pgmap v929: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 598 op/s 2024-06-02T22:50:56.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:55 smithi031 ceph-mon[31767]: pgmap v929: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 598 op/s 2024-06-02T22:50:58.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:57 smithi098 ceph-mon[36750]: pgmap v930: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 495 op/s 2024-06-02T22:50:58.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:57 smithi178 ceph-mon[36614]: pgmap v930: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 495 op/s 2024-06-02T22:50:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:57 smithi031 ceph-mon[31767]: pgmap v930: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.8 MiB/s wr, 495 op/s 2024-06-02T22:51:00.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:50:59 smithi098 ceph-mon[36750]: pgmap v931: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-06-02T22:51:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 815.0 s, 451.4 tps, lat 227.612 ms stddev 274.101 2024-06-02T22:51:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:50:59 smithi178 ceph-mon[36614]: pgmap v931: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-06-02T22:51:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:50:59 smithi031 ceph-mon[31767]: pgmap v931: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-06-02T22:51:02.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:01 smithi098 ceph-mon[36750]: pgmap v932: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-06-02T22:51:02.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:01 smithi178 ceph-mon[36614]: pgmap v932: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-06-02T22:51:02.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:01 smithi031 ceph-mon[31767]: pgmap v932: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.3 MiB/s wr, 626 op/s 2024-06-02T22:51:04.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:03 smithi098 ceph-mon[36750]: pgmap v933: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-06-02T22:51:04.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:03 smithi178 ceph-mon[36614]: pgmap v933: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-06-02T22:51:04.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:03 smithi031 ceph-mon[31767]: pgmap v933: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-06-02T22:51:05.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:04 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:51:05.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 820.0 s, 465.2 tps, lat 214.097 ms stddev 286.812 2024-06-02T22:51:05.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:04 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:51:05.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:04 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:51:06.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:51:06.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:05 smithi098 ceph-mon[36750]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:51:06.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:51:06.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:51:06.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:51:06.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:05 smithi178 ceph-mon[36614]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:51:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.4 MiB/s wr, 639 op/s 2024-06-02T22:51:06.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi178 to 176.1M 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: Adjusting osd_memory_target on smithi098 to 176.2M 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi098 to 184782438: error parsing value: Value '184782438' is below minimum 939524096 2024-06-02T22:51:06.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:05 smithi031 ceph-mon[31767]: Unable to set osd_memory_target on smithi178 to 184755200: error parsing value: Value '184755200' is below minimum 939524096 2024-06-02T22:51:07.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:51:07.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:51:07.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:06 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:51:07.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:51:07.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:51:07.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:06 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:51:07.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:51:07.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:51:07.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:06 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:51:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:08 smithi098 ceph-mon[36750]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-06-02T22:51:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:08 smithi178 ceph-mon[36614]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-06-02T22:51:08.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:08 smithi031 ceph-mon[31767]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 -- 172.21.15.31:0/2646061122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980743a0 msgr2=0x7f9098074800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 --2- 172.21.15.31:0/2646061122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980743a0 0x7f9098074800 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9088009900 tx=0x7f908802a4b0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 -- 172.21.15.31:0/2646061122 shutdown_connections 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 --2- 172.21.15.31:0/2646061122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9098109890 0x7f909810bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 --2- 172.21.15.31:0/2646061122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980743a0 0x7f9098074800 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 --2- 172.21.15.31:0/2646061122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098075980 0x7f9098073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 -- 172.21.15.31:0/2646061122 >> 172.21.15.31:0/2646061122 conn(0x7f90980fcf90 msgr2=0x7f90980ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 -- 172.21.15.31:0/2646061122 shutdown_connections 2024-06-02T22:51:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.231+0000 7f90a0800640 1 -- 172.21.15.31:0/2646061122 wait complete. 2024-06-02T22:51:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.234+0000 7f90a0800640 1 Processor -- start 2024-06-02T22:51:09.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.234+0000 7f90a0800640 1 -- start start 2024-06-02T22:51:09.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90980743a0 0x7f9098199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.235 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 0x7f90981a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f909810f970 con 0x7f90980743a0 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f909810f7f0 con 0x7f9098075980 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f90a0800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f909810faf0 con 0x7f9098109890 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f909e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 0x7f90981a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.236 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f909d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f909d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40802/0 (socket says 172.21.15.31:40802) 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f909e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 0x7f90981a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57366/0 (socket says 172.21.15.31:57366) 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.235+0000 7f909d400640 1 -- 172.21.15.31:0/649573632 learned_addr learned my addr 172.21.15.31:0/649573632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.236+0000 7f909d400640 1 -- 172.21.15.31:0/649573632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 msgr2=0x7f90981a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.236+0000 7f909d400640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 0x7f90981a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.236+0000 7f909d400640 1 -- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90980743a0 msgr2=0x7f9098199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.236+0000 7f909d400640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90980743a0 0x7f9098199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.237 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.236+0000 7f909d400640 1 -- 172.21.15.31:0/649573632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90981a1bc0 con 0x7f9098075980 2024-06-02T22:51:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.237+0000 7f909d400640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9088009230 tx=0x7f9088004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.238 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.237+0000 7f9092a00640 1 -- 172.21.15.31:0/649573632 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908803f030 con 0x7f9098075980 2024-06-02T22:51:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.237+0000 7f9092a00640 1 -- 172.21.15.31:0/649573632 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9088003ce0 con 0x7f9098075980 2024-06-02T22:51:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.237+0000 7f9092a00640 1 -- 172.21.15.31:0/649573632 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088035070 con 0x7f9098075980 2024-06-02T22:51:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.239+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90981a1e50 con 0x7f9098075980 2024-06-02T22:51:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.239+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90981a2280 con 0x7f9098075980 2024-06-02T22:51:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.245+0000 7f90a3789740 1 Processor -- start 2024-06-02T22:51:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.245+0000 7f9092a00640 1 -- 172.21.15.31:0/649573632 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f9088042030 con 0x7f9098075980 2024-06-02T22:51:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.247+0000 7f9092a00640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 0x7f90800a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.248+0000 7f909e800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 0x7f90800a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 -- start start 2024-06-02T22:51:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f4890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f489730 0x55c57f48bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c57f3e7420 con 0x55c57f4845c0 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c57f38ec50 con 0x55c57f483bd0 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.249+0000 7f90a3789740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c57f3e33e0 con 0x55c57f489730 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.250+0000 7f909de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.250+0000 7f909de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40810/0 (socket says 172.21.15.31:40810) 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.250+0000 7f909de00640 1 -- 172.21.15.31:0/1896395640 learned_addr learned my addr 172.21.15.31:0/1896395640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.250+0000 7f909e800640 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f489730 0x55c57f48bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909d400640 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f4890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909de00640 1 -- 172.21.15.31:0/1896395640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f489730 msgr2=0x55c57f48bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909de00640 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f489730 0x55c57f48bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909de00640 1 -- 172.21.15.31:0/1896395640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 msgr2=0x55c57f4890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909de00640 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f4890c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f909de00640 1 -- 172.21.15.31:0/1896395640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57f0fb210 con 0x55c57f483bd0 2024-06-02T22:51:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.251+0000 7f9092a00640 1 -- 172.21.15.31:0/649573632 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f90880efe80 con 0x7f9098075980 2024-06-02T22:51:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.253+0000 7f909e800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 0x7f90800a5170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9094009fd0 tx=0x7f909400ab80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.254+0000 7f909de00640 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f908c0097c0 tx=0x7f908c009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25345bc28c42073 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.255+0000 7f9087000640 1 -- 172.21.15.31:0/1896395640 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c015020 con 0x55c57f483bd0 2024-06-02T22:51:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.255+0000 7f9087000640 1 -- 172.21.15.31:0/1896395640 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f908c011420 con 0x55c57f483bd0 2024-06-02T22:51:09.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.255+0000 7f9087000640 1 -- 172.21.15.31:0/1896395640 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c0105e0 con 0x55c57f483bd0 2024-06-02T22:51:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 -- 172.21.15.31:0/1896395640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 msgr2=0x55c57f483ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f908c0097c0 tx=0x7f908c009c80 comp rx=0 tx=0).stop 2024-06-02T22:51:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 -- 172.21.15.31:0/1896395640 shutdown_connections 2024-06-02T22:51:09.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f489730 0x55c57f48bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f4890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 --2- 172.21.15.31:0/1896395640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f483ff0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 -- 172.21.15.31:0/1896395640 >> 172.21.15.31:0/1896395640 conn(0x55c57f44bf80 msgr2=0x55c57f47f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 -- 172.21.15.31:0/1896395640 shutdown_connections 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.256+0000 7f90a3789740 1 -- 172.21.15.31:0/1896395640 wait complete. 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.257+0000 7f90a3789740 1 -- start start 2024-06-02T22:51:09.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.257+0000 7f90a3789740 1 Processor -- start 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f48df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f4954f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c57f48c6e0 con 0x55c57f489730 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c57f3a20b0 con 0x55c57f483bd0 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.259+0000 7f90a3789740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c57f48c860 con 0x55c57f4845c0 2024-06-02T22:51:09.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f90a3789740 10 client.0 _ll_register_callbacks cb 0x55c57f38df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f48df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f48df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40822/0 (socket says 172.21.15.31:40822) 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57384/0 (socket says 172.21.15.31:57384) 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909de00640 1 -- 172.21.15.31:0/654210011 learned_addr learned my addr 172.21.15.31:0/654210011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 -- 172.21.15.31:0/654210011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 msgr2=0x55c57f48df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f48df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 -- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 msgr2=0x55c57f4954f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f4954f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.261 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.260+0000 7f909d400640 1 -- 172.21.15.31:0/654210011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57f1c7620 con 0x55c57f4845c0 2024-06-02T22:51:09.264 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.264+0000 7f909d400640 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f908802e040 tx=0x7f90880bbf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db8111b87f7cda6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.264+0000 7f907b400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:51:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.264+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880b6e60 con 0x55c57f4845c0 2024-06-02T22:51:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.264+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f90880c0430 con 0x55c57f4845c0 2024-06-02T22:51:09.265 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.265+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908c011420 con 0x55c57f4845c0 2024-06-02T22:51:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.265+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90880bc9f0 con 0x55c57f4845c0 2024-06-02T22:51:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.265+0000 7f90a3789740 10 client.26173 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.265+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c57f48c750 con 0x55c57f4845c0 2024-06-02T22:51:09.266 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.265+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90880bc2f0 con 0x55c57f4845c0 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f90880b8960 con 0x55c57f4845c0 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 10 client.26173 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 10 client.26173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 20 client.26173 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f49a170 0x55c57f49c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 4 client.26173 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:51:09.267 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.266+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f908c011420 con 0x55c57f49a170 2024-06-02T22:51:09.268 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.268+0000 7f909de00640 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f49a170 0x55c57f49c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.269+0000 7f907b400640 10 client.26173 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:09.269 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.269+0000 7f909de00640 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f49a170 0x55c57f49c5e0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ffc1f3882ef73c server_cookie=36d832a6fc6ad4d4 in_seq=0 out_seq=0 2024-06-02T22:51:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.270+0000 7f907b400640 1 -- 172.21.15.31:0/654210011 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f908c011420 con 0x55c57f49a170 2024-06-02T22:51:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.270+0000 7f907b400640 10 client.26173 handle_command_reply: tid=0 2024-06-02T22:51:09.270 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.270+0000 7f90a3789740 1 client.26173 shutdown 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.270+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 msgr2=0x55c57f48e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.270+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f908802e040 tx=0x7f90880bbf10 comp rx=0 tx=0).stop 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 shutdown_connections 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f49a170 0x55c57f49c5e0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f4954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f4845c0 0x55c57f48e4b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f907b400640 0 client.26173 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:09.271 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 --2- 172.21.15.31:0/654210011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f483bd0 0x55c57f48df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 >> 172.21.15.31:0/654210011 conn(0x55c57f44bf80 msgr2=0x55c57f47e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.271+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 shutdown_connections 2024-06-02T22:51:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.272+0000 7f90a3789740 1 -- 172.21.15.31:0/654210011 wait complete. 2024-06-02T22:51:09.272 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.272+0000 7f90a3789740 20 client.26173 trim_cache size 0 max 16384 2024-06-02T22:51:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.333+0000 7f90a3789740 1 Processor -- start 2024-06-02T22:51:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.333+0000 7f90a3789740 1 -- start start 2024-06-02T22:51:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f47f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f484db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ac8a0 con 0x55c57f489730 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ae3e0 con 0x55c57f4845c0 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f90a3789740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90981acf70 con 0x55c57f483bd0 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f909d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.335+0000 7f909d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40826/0 (socket says 172.21.15.31:40826) 2024-06-02T22:51:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.335+0000 7f909d400640 1 -- 172.21.15.31:0/3508259407 learned_addr learned my addr 172.21.15.31:0/3508259407 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.334+0000 7f909de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f47f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.335+0000 7f909de00640 1 -- 172.21.15.31:0/3508259407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 msgr2=0x55c57f495410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.336+0000 7f909e800640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f484db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909de00640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909de00640 1 -- 172.21.15.31:0/3508259407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 msgr2=0x55c57f484db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909de00640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f484db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909de00640 1 -- 172.21.15.31:0/3508259407 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57f49cc60 con 0x55c57f483bd0 2024-06-02T22:51:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909d400640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909e800640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f484db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.337+0000 7f909de00640 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f47f7e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c57f49ce30 tx=0x7f908c009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d59164512266059 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.338+0000 7f9086600640 1 -- 172.21.15.31:0/3508259407 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c015040 con 0x55c57f483bd0 2024-06-02T22:51:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.338+0000 7f9086600640 1 -- 172.21.15.31:0/3508259407 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f908c011420 con 0x55c57f483bd0 2024-06-02T22:51:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.338+0000 7f9086600640 1 -- 172.21.15.31:0/3508259407 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c00bea0 con 0x55c57f483bd0 2024-06-02T22:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.339+0000 7f90a3789740 1 -- 172.21.15.31:0/3508259407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 msgr2=0x55c57f47f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f47f7e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c57f49ce30 tx=0x7f908c009c80 comp rx=0 tx=0).stop 2024-06-02T22:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 -- 172.21.15.31:0/3508259407 shutdown_connections 2024-06-02T22:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f489730 0x55c57f484db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f4845c0 0x55c57f495410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 --2- 172.21.15.31:0/3508259407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f47f7e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.340+0000 7f90a3789740 1 -- 172.21.15.31:0/3508259407 >> 172.21.15.31:0/3508259407 conn(0x55c57f44bf80 msgr2=0x55c57f47f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.342+0000 7f90a3789740 1 -- 172.21.15.31:0/3508259407 shutdown_connections 2024-06-02T22:51:09.343 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.343+0000 7f90a3789740 1 -- 172.21.15.31:0/3508259407 wait complete. 2024-06-02T22:51:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.343+0000 7f90a3789740 1 -- start start 2024-06-02T22:51:09.344 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.344+0000 7f90a3789740 1 Processor -- start 2024-06-02T22:51:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f492ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f489730 0x55c57f493b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f90981add10 con 0x55c57f4845c0 2024-06-02T22:51:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ad640 con 0x55c57f489730 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90981aa840 con 0x55c57f483bd0 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f909de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f90a3789740 10 client.0 _ll_register_callbacks cb 0x7f90880bc1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.345+0000 7f909de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:57410/0 (socket says 172.21.15.31:57410) 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 -- 172.21.15.31:0/554765185 learned_addr learned my addr 172.21.15.31:0/554765185 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 -- 172.21.15.31:0/554765185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f489730 msgr2=0x55c57f493b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f489730 0x55c57f493b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 -- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 msgr2=0x55c57f492ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909d400640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f492ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f492ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909de00640 1 -- 172.21.15.31:0/554765185 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57f494150 con 0x55c57f483bd0 2024-06-02T22:51:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.346+0000 7f909d400640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f492ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.347+0000 7f909de00640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f908c025fd0 tx=0x7f908c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea211e40a01dd19 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.347+0000 7f907b400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:51:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.349+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c034060 con 0x55c57f483bd0 2024-06-02T22:51:09.350 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.349+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f908c00bc20 con 0x55c57f483bd0 2024-06-02T22:51:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.351+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908c011420 con 0x55c57f483bd0 2024-06-02T22:51:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.352+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f908c03b050 con 0x55c57f483bd0 2024-06-02T22:51:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.352+0000 7f90a3789740 10 client.26179 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:09.352 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.352+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c57f4953d0 con 0x55c57f483bd0 2024-06-02T22:51:09.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.352+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f908c011420 con 0x55c57f483bd0 2024-06-02T22:51:09.353 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.353+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f908c025870 con 0x55c57f483bd0 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 10 client.26179 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 10 client.26179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 20 client.26179 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f50d870 0x55c57f50fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 4 client.26179 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:51:09.355 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c57f3f4b50 con 0x55c57f50d870 2024-06-02T22:51:09.356 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.355+0000 7f909d400640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f50d870 0x55c57f50fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.357+0000 7f909d400640 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f50d870 0x55c57f50fc60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57f71e2f61e2690f server_cookie=955ff998ca79d5fe in_seq=0 out_seq=0 2024-06-02T22:51:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.357+0000 7f907b400640 10 client.26179 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.516+0000 7f907b400640 1 -- 172.21.15.31:0/554765185 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c57f3f4b50 con 0x55c57f50d870 2024-06-02T22:51:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.517+0000 7f907b400640 10 client.26179 handle_command_reply: tid=0 2024-06-02T22:51:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.517+0000 7f90a3789740 1 client.26179 shutdown 2024-06-02T22:51:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 msgr2=0x55c57f492660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f908c025fd0 tx=0x7f908c009f60 comp rx=0 tx=0).stop 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 shutdown_connections 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55c57f50d870 0x55c57f50fc60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c57f489730 0x55c57f493b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c57f4845c0 0x55c57f492ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 --2- 172.21.15.31:0/554765185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c57f483bd0 0x55c57f492660 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 >> 172.21.15.31:0/554765185 conn(0x55c57f44bf80 msgr2=0x55c57f47df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.518+0000 7f907b400640 0 client.26179 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.519+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 shutdown_connections 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.519+0000 7f90a3789740 1 -- 172.21.15.31:0/554765185 wait complete. 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.519+0000 7f90a3789740 20 client.26179 trim_cache size 0 max 16384 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:51:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:51:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 msgr2=0x7f90800a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 0x7f90800a5170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9094009fd0 tx=0x7f909400ab80 comp rx=0 tx=0).stop 2024-06-02T22:51:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 msgr2=0x7f909819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9088009230 tx=0x7f9088004430 comp rx=0 tx=0).stop 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 shutdown_connections 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90800a2cb0 0x7f90800a5170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9098109890 0x7f90981a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9098075980 0x7f909819a4e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 --2- 172.21.15.31:0/649573632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90980743a0 0x7f9098199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 >> 172.21.15.31:0/649573632 conn(0x7f90980fcf90 msgr2=0x7f9098105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 shutdown_connections 2024-06-02T22:51:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:09.521+0000 7f90a0800640 1 -- 172.21.15.31:0/649573632 wait complete. 2024-06-02T22:51:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 825.0 s, 475.6 tps, lat 205.067 ms stddev 240.275 2024-06-02T22:51:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:10 smithi098 ceph-mon[36750]: pgmap v936: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.6 MiB/s wr, 579 op/s 2024-06-02T22:51:10.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:10 smithi178 ceph-mon[36614]: pgmap v936: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.6 MiB/s wr, 579 op/s 2024-06-02T22:51:10.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:10 smithi031 ceph-mon[31767]: pgmap v936: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.6 MiB/s wr, 579 op/s 2024-06-02T22:51:12.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:12 smithi098 ceph-mon[36750]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:51:12.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:12 smithi178 ceph-mon[36614]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:51:12.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:12 smithi031 ceph-mon[31767]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-06-02T22:51:14.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:14 smithi098 ceph-mon[36750]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-06-02T22:51:14.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:14 smithi178 ceph-mon[36614]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-06-02T22:51:14.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:14 smithi031 ceph-mon[31767]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.1 MiB/s wr, 476 op/s 2024-06-02T22:51:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 830.0 s, 527.8 tps, lat 196.802 ms stddev 246.298 2024-06-02T22:51:16.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:16 smithi098 ceph-mon[36750]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.1 MiB/s wr, 477 op/s 2024-06-02T22:51:16.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:16 smithi178 ceph-mon[36614]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.1 MiB/s wr, 477 op/s 2024-06-02T22:51:16.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:16 smithi031 ceph-mon[31767]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.1 MiB/s wr, 477 op/s 2024-06-02T22:51:18.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:18 smithi178 ceph-mon[36614]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-06-02T22:51:18.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:18 smithi031 ceph-mon[31767]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-06-02T22:51:18.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:18 smithi098 ceph-mon[36750]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-06-02T22:51:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 835.0 s, 666.6 tps, lat 148.582 ms stddev 164.670 2024-06-02T22:51:20.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:20 smithi178 ceph-mon[36614]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.7 MiB/s wr, 516 op/s 2024-06-02T22:51:20.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:20 smithi031 ceph-mon[31767]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.7 MiB/s wr, 516 op/s 2024-06-02T22:51:20.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:20 smithi098 ceph-mon[36750]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 4.7 MiB/s wr, 516 op/s 2024-06-02T22:51:22.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:22 smithi178 ceph-mon[36614]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.5 MiB/s wr, 514 op/s 2024-06-02T22:51:22.624 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:22 smithi031 ceph-mon[31767]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.5 MiB/s wr, 514 op/s 2024-06-02T22:51:22.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:22 smithi098 ceph-mon[36750]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 4.5 MiB/s wr, 514 op/s 2024-06-02T22:51:22.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.718+0000 7f36a3200640 1 -- 172.21.15.31:0/1078146326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c0991f0 msgr2=0x7f369c09b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.718 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.718+0000 7f36a3200640 1 --2- 172.21.15.31:0/1078146326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c0991f0 0x7f369c09b5e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3694009900 tx=0x7f369402a410 comp rx=0 tx=0).stop 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.718+0000 7f36a3200640 1 -- 172.21.15.31:0/1078146326 shutdown_connections 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 --2- 172.21.15.31:0/1078146326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369c09bb20 0x7f369c09df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 --2- 172.21.15.31:0/1078146326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c0991f0 0x7f369c09b5e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 --2- 172.21.15.31:0/1078146326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0968c0 0x7f369c098cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 -- 172.21.15.31:0/1078146326 >> 172.21.15.31:0/1078146326 conn(0x7f369c0901d0 msgr2=0x7f369c092630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 -- 172.21.15.31:0/1078146326 shutdown_connections 2024-06-02T22:51:22.719 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.719+0000 7f36a3200640 1 -- 172.21.15.31:0/1078146326 wait complete. 2024-06-02T22:51:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.721+0000 7f36a3200640 1 Processor -- start 2024-06-02T22:51:22.722 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.722+0000 7f36a3200640 1 -- start start 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369c0968c0 0x7f369c12e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 0x7f369c12e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0a1b10 con 0x7f369c0991f0 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0a1990 con 0x7f369c09bb20 2024-06-02T22:51:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.723+0000 7f36a3200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0a1c90 con 0x7f369c0968c0 2024-06-02T22:51:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.724+0000 7f36a2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.724+0000 7f36a2800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40484/0 (socket says 172.21.15.31:40484) 2024-06-02T22:51:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.724+0000 7f36a2800640 1 -- 172.21.15.31:0/647310888 learned_addr learned my addr 172.21.15.31:0/647310888 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.724+0000 7f36a1400640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 0x7f369c12e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.725+0000 7f36a2800640 1 -- 172.21.15.31:0/647310888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369c0968c0 msgr2=0x7f369c12e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.725+0000 7f36a2800640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369c0968c0 0x7f369c12e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.725+0000 7f36a2800640 1 -- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 msgr2=0x7f369c12e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.725+0000 7f36a2800640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 0x7f369c12e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.726+0000 7f36a2800640 1 -- 172.21.15.31:0/647310888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c135fa0 con 0x7f369c09bb20 2024-06-02T22:51:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.726+0000 7f36a1400640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 0x7f369c12e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:22.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.727+0000 7f36a2800640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36a40651f0 tx=0x7f36a406ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.731+0000 7f369aa00640 1 -- 172.21.15.31:0/647310888 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a407e590 con 0x7f369c09bb20 2024-06-02T22:51:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.731+0000 7f369aa00640 1 -- 172.21.15.31:0/647310888 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a407ec10 con 0x7f369c09bb20 2024-06-02T22:51:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.731+0000 7f369aa00640 1 -- 172.21.15.31:0/647310888 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a407fdd0 con 0x7f369c09bb20 2024-06-02T22:51:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.731+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c136290 con 0x7f369c09bb20 2024-06-02T22:51:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.731+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1367e0 con 0x7f369c09bb20 2024-06-02T22:51:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.736+0000 7f36abbaa740 1 Processor -- start 2024-06-02T22:51:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.742+0000 7f36abbaa740 1 -- start start 2024-06-02T22:51:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593365910 0x556593367da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5565932c3420 con 0x556593365910 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55659326ac50 con 0x55659335fdb0 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36abbaa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5565932bf3e0 con 0x5565933607a0 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:59816/0 (socket says 172.21.15.31:59816) 2024-06-02T22:51:22.744 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.743+0000 7f36a1e00640 1 -- 172.21.15.31:0/1846266528 learned_addr learned my addr 172.21.15.31:0/1846266528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 -- 172.21.15.31:0/1846266528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 msgr2=0x5565933601d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933601d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 -- 172.21.15.31:0/1846266528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593365910 msgr2=0x556593367da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593365910 0x556593367da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 -- 172.21.15.31:0/1846266528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556592fd7210 con 0x5565933607a0 2024-06-02T22:51:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3690009820 tx=0x7f3690009ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b70c6e97c63288e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.744+0000 7f368f400640 1 -- 172.21.15.31:0/1846266528 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690015020 con 0x5565933607a0 2024-06-02T22:51:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.745+0000 7f368f400640 1 -- 172.21.15.31:0/1846266528 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690011420 con 0x5565933607a0 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 -- 172.21.15.31:0/1846266528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 msgr2=0x5565933652a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f368f400640 1 -- 172.21.15.31:0/1846266528 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36900105a0 con 0x5565933607a0 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3690009820 tx=0x7f3690009ce0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f369aa00640 1 -- 172.21.15.31:0/647310888 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f36a4086030 con 0x7f369c09bb20 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 -- 172.21.15.31:0/1846266528 shutdown_connections 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593365910 0x556593367da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x5565933652a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1846266528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.746+0000 7f36abbaa740 1 -- 172.21.15.31:0/1846266528 >> 172.21.15.31:0/1846266528 conn(0x556593327f80 msgr2=0x55659335b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.747+0000 7f36abbaa740 1 -- 172.21.15.31:0/1846266528 shutdown_connections 2024-06-02T22:51:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.747+0000 7f36abbaa740 1 -- 172.21.15.31:0/1846266528 wait complete. 2024-06-02T22:51:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.747+0000 7f36abbaa740 1 -- start start 2024-06-02T22:51:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.748+0000 7f36abbaa740 1 Processor -- start 2024-06-02T22:51:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.749+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.750+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.750+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x556593379e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.750+0000 7f36abbaa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x556593368910 con 0x5565933607a0 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.750+0000 7f36abbaa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55659327e0b0 con 0x55659335fdb0 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.750+0000 7f36abbaa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556593368a90 con 0x556593365910 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.751+0000 7f36abbaa740 10 client.0 _ll_register_callbacks cb 0x556593269f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.751+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.751+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54008/0 (socket says 172.21.15.31:54008) 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.751+0000 7f36a1e00640 1 -- 172.21.15.31:0/362647344 learned_addr learned my addr 172.21.15.31:0/362647344 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.752+0000 7f36a1400640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.753+0000 7f36a1e00640 1 -- 172.21.15.31:0/362647344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 msgr2=0x556593379e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.753+0000 7f36a1400640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x556593379e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f36a1e00640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x556593379e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f369aa00640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 0x7f36880a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f36a1e00640 1 -- 172.21.15.31:0/362647344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 msgr2=0x5565933728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f36a1e00640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f369aa00640 1 -- 172.21.15.31:0/647310888 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f36a413a170 con 0x7f369c09bb20 2024-06-02T22:51:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f36a2800640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 0x7f36880a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.754+0000 7f36a1e00640 1 -- 172.21.15.31:0/362647344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565930a3620 con 0x5565933607a0 2024-06-02T22:51:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.755+0000 7f36a1400640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x556593379e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.755+0000 7f36a2800640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 0x7f36880a5010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36a4102b60 tx=0x7f36a4062f20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.756+0000 7f36a1e00640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f369000bb80 tx=0x7f369000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a3c783c471a910 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.756+0000 7f3683e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:51:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.758+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690026480 con 0x5565933607a0 2024-06-02T22:51:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.758+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3690026620 con 0x5565933607a0 2024-06-02T22:51:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.759+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690011420 con 0x5565933607a0 2024-06-02T22:51:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.764+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3690026860 con 0x5565933607a0 2024-06-02T22:51:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.764+0000 7f36abbaa740 10 client.15786 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.764+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55659337d020 con 0x5565933607a0 2024-06-02T22:51:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.765+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690011420 con 0x5565933607a0 2024-06-02T22:51:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.765+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f369001ab50 con 0x5565933607a0 2024-06-02T22:51:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 10 client.15786 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 20 client.15786 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659337e440 0x5565933808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 4 client.15786 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:51:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.766+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565932d0b50 con 0x55659337e440 2024-06-02T22:51:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.767+0000 7f36a1400640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659337e440 0x5565933808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.770+0000 7f36a1400640 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659337e440 0x5565933808a0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c16078a4c3a263e5 server_cookie=a9cd8fc6c600de3e in_seq=0 out_seq=0 2024-06-02T22:51:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.770+0000 7f3683e00640 10 client.15786 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.774+0000 7f3683e00640 1 -- 172.21.15.31:0/362647344 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5565932d0b50 con 0x55659337e440 2024-06-02T22:51:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.774+0000 7f3683e00640 10 client.15786 handle_command_reply: tid=0 2024-06-02T22:51:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.774+0000 7f36abbaa740 1 client.15786 shutdown 2024-06-02T22:51:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.775+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 msgr2=0x556593372e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.775+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f369000bb80 tx=0x7f369000bbb0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.776+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 shutdown_connections 2024-06-02T22:51:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.777+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659337e440 0x5565933808a0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.777+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x556593379e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.777+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5565933607a0 0x556593372e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.777+0000 7f3683e00640 0 client.15786 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.777+0000 7f36abbaa740 1 --2- 172.21.15.31:0/362647344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x5565933728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.780+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 >> 172.21.15.31:0/362647344 conn(0x556593327f80 msgr2=0x55659335a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.781+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 shutdown_connections 2024-06-02T22:51:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.781+0000 7f36abbaa740 1 -- 172.21.15.31:0/362647344 wait complete. 2024-06-02T22:51:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.782+0000 7f36abbaa740 20 client.15786 trim_cache size 0 max 16384 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.825+0000 7f36abbaa740 1 Processor -- start 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.825+0000 7f36abbaa740 1 -- start start 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x55659335b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x55659335b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13c9d0 con 0x556593327f80 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13e510 con 0x55659335fdb0 2024-06-02T22:51:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36abbaa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13d0a0 con 0x5565933607a0 2024-06-02T22:51:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40494/0 (socket says 172.21.15.31:40494) 2024-06-02T22:51:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36a1e00640 1 -- 172.21.15.31:0/1396379399 learned_addr learned my addr 172.21.15.31:0/1396379399 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.826+0000 7f36a1400640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x55659335b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.827+0000 7f36a1400640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x55659335b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1e00640 1 -- 172.21.15.31:0/1396379399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 msgr2=0x55659335b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x55659335b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1e00640 1 -- 172.21.15.31:0/1396379399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 msgr2=0x55659335b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x55659335b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1e00640 1 -- 172.21.15.31:0/1396379399 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556593364c70 con 0x55659335fdb0 2024-06-02T22:51:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.828+0000 7f36a1400640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x55659335b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.829+0000 7f36a1e00640 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3690001eb0 tx=0x7f3690011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bbd2a19d13ade37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.830+0000 7f368ea00640 1 -- 172.21.15.31:0/1396379399 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690015040 con 0x55659335fdb0 2024-06-02T22:51:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.830+0000 7f368ea00640 1 -- 172.21.15.31:0/1396379399 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690056030 con 0x55659335fdb0 2024-06-02T22:51:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.831+0000 7f368ea00640 1 -- 172.21.15.31:0/1396379399 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690015040 con 0x55659335fdb0 2024-06-02T22:51:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.831+0000 7f36abbaa740 1 -- 172.21.15.31:0/1396379399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 msgr2=0x556593379e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.831+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3690001eb0 tx=0x7f3690011a00 comp rx=0 tx=0).stop 2024-06-02T22:51:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.832+0000 7f36abbaa740 1 -- 172.21.15.31:0/1396379399 shutdown_connections 2024-06-02T22:51:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.832+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5565933607a0 0x55659335b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.832+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659335fdb0 0x556593379e10 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3690001eb0 tx=0x7f3690011a00 comp rx=0 tx=0).stop 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.832+0000 7f36abbaa740 1 --2- 172.21.15.31:0/1396379399 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x55659335b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.832+0000 7f36abbaa740 1 -- 172.21.15.31:0/1396379399 >> 172.21.15.31:0/1396379399 conn(0x556593371ae0 msgr2=0x556593361980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.833+0000 7f36abbaa740 1 -- 172.21.15.31:0/1396379399 shutdown_connections 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.833+0000 7f36abbaa740 1 -- 172.21.15.31:0/1396379399 wait complete. 2024-06-02T22:51:22.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.834+0000 7f36abbaa740 1 -- start start 2024-06-02T22:51:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.834+0000 7f36abbaa740 1 Processor -- start 2024-06-02T22:51:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x556593376940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x55659336cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13de40 con 0x556593327f80 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13d770 con 0x5565933607a0 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f369c13a9f0 con 0x556593365910 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36abbaa740 10 client.0 _ll_register_callbacks cb 0x7f3690009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.835+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:40500/0 (socket says 172.21.15.31:40500) 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 -- 172.21.15.31:0/379441502 learned_addr learned my addr 172.21.15.31:0/379441502 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1400640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x556593376940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 -- 172.21.15.31:0/379441502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 msgr2=0x55659336cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x55659336cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 -- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 msgr2=0x556593376940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x556593376940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:22.837 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.836+0000 7f36a1e00640 1 -- 172.21.15.31:0/379441502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556593379f00 con 0x5565933607a0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.837+0000 7f36a1e00640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f369001b480 tx=0x7f36900264f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d7e03a6424d0a99 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.837+0000 7f3683e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.838+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369005f020 con 0x5565933607a0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.838+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f369001bcc0 con 0x5565933607a0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.838+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3690056030 con 0x5565933607a0 2024-06-02T22:51:22.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.839+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3690015070 con 0x5565933607a0 2024-06-02T22:51:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.839+0000 7f36abbaa740 10 client.26198 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:22.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.839+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55659336e300 con 0x5565933607a0 2024-06-02T22:51:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.840+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690056030 con 0x5565933607a0 2024-06-02T22:51:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.840+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f369001a800 con 0x5565933607a0 2024-06-02T22:51:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 10 client.26198 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 10 client.26198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 20 client.26198 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659336ebf0 0x556593371010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 4 client.26198 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:51:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.841+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565933726c0 con 0x55659336ebf0 2024-06-02T22:51:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.842+0000 7f36a1400640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659336ebf0 0x556593371010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.843+0000 7f36a1400640 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659336ebf0 0x556593371010 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25dc046f07debf38 server_cookie=85ea45aa9760b7b1 in_seq=0 out_seq=0 2024-06-02T22:51:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:22.843+0000 7f3683e00640 10 client.26198 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f3683e00640 1 -- 172.21.15.31:0/379441502 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5565933726c0 con 0x55659336ebf0 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f3683e00640 10 client.26198 handle_command_reply: tid=0 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 client.26198 shutdown 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 msgr2=0x556593376e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f369001b480 tx=0x7f36900264f0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 shutdown_connections 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55659336ebf0 0x556593371010 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556593365910 0x55659336cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f3683e00640 0 client.26198 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565933607a0 0x556593376e80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 --2- 172.21.15.31:0/379441502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556593327f80 0x556593376940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 >> 172.21.15.31:0/379441502 conn(0x556593371ae0 msgr2=0x55659335b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 shutdown_connections 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.224+0000 7f36abbaa740 1 -- 172.21.15.31:0/379441502 wait complete. 2024-06-02T22:51:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.225+0000 7f36abbaa740 20 client.26198 trim_cache size 0 max 16384 2024-06-02T22:51:23.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:51:23.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:51:23.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:51:23.227 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.225+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 msgr2=0x7f36880a5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.225+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 0x7f36880a5010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36a4102b60 tx=0x7f36a4062f20 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.225+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 msgr2=0x7f369c135930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.225+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f36a40651f0 tx=0x7f36a406ad80 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 shutdown_connections 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f36880a2b50 0x7f36880a5010 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f369c09bb20 0x7f369c135930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f369c0991f0 0x7f369c12e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 --2- 172.21.15.31:0/647310888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369c0968c0 0x7f369c12e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 >> 172.21.15.31:0/647310888 conn(0x7f369c0901d0 msgr2=0x7f369c096040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 shutdown_connections 2024-06-02T22:51:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:23.226+0000 7f36a3200640 1 -- 172.21.15.31:0/647310888 wait complete. 2024-06-02T22:51:24.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:24 smithi178 ceph-mon[36614]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 4.5 MiB/s wr, 521 op/s 2024-06-02T22:51:24.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:24 smithi031 ceph-mon[31767]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 4.5 MiB/s wr, 521 op/s 2024-06-02T22:51:24.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:24 smithi098 ceph-mon[36750]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 4.5 MiB/s wr, 521 op/s 2024-06-02T22:51:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 840.0 s, 457.0 tps, lat 224.632 ms stddev 291.382 2024-06-02T22:51:26.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:26 smithi178 ceph-mon[36614]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-06-02T22:51:26.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:26 smithi031 ceph-mon[31767]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-06-02T22:51:26.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:26 smithi098 ceph-mon[36750]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 4.9 MiB/s wr, 545 op/s 2024-06-02T22:51:28.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:28 smithi178 ceph-mon[36614]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-06-02T22:51:28.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:28 smithi031 ceph-mon[31767]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-06-02T22:51:28.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:28 smithi098 ceph-mon[36750]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-06-02T22:51:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 845.0 s, 512.1 tps, lat 191.893 ms stddev 221.858 2024-06-02T22:51:30.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:30 smithi178 ceph-mon[36614]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-06-02T22:51:30.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:30 smithi031 ceph-mon[31767]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-06-02T22:51:30.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:30 smithi098 ceph-mon[36750]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 5.6 MiB/s wr, 567 op/s 2024-06-02T22:51:32.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:32 smithi178 ceph-mon[36614]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-06-02T22:51:32.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:32 smithi031 ceph-mon[31767]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-06-02T22:51:32.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:32 smithi098 ceph-mon[36750]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-06-02T22:51:34.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:34 smithi178 ceph-mon[36614]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-06-02T22:51:34.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:34 smithi031 ceph-mon[31767]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-06-02T22:51:34.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:34 smithi098 ceph-mon[36750]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.3 MiB/s wr, 710 op/s 2024-06-02T22:51:35.223 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 850.0 s, 484.4 tps, lat 206.668 ms stddev 259.080 2024-06-02T22:51:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 -- 172.21.15.31:0/1105344531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4102bf0 msgr2=0x7f90f4103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 --2- 172.21.15.31:0/1105344531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4102bf0 0x7f90f4103070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009860 tx=0x7f90e802a340 comp rx=0 tx=0).stop 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 -- 172.21.15.31:0/1105344531 shutdown_connections 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 --2- 172.21.15.31:0/1105344531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 0x7f90f4109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 --2- 172.21.15.31:0/1105344531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4102bf0 0x7f90f4103070 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 --2- 172.21.15.31:0/1105344531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4101a00 0x7f90f4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 -- 172.21.15.31:0/1105344531 >> 172.21.15.31:0/1105344531 conn(0x7f90f40fcf90 msgr2=0x7f90f40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 -- 172.21.15.31:0/1105344531 shutdown_connections 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.435+0000 7f90fc400640 1 -- 172.21.15.31:0/1105344531 wait complete. 2024-06-02T22:51:36.436 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.436+0000 7f90fc400640 1 Processor -- start 2024-06-02T22:51:36.437 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 -- start start 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 0x7f90f4075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 0x7f90f4073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 0x7f90f40742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f90f410d660 con 0x7f90f4102bf0 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90f410d4e0 con 0x7f90f41035b0 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90fc400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90f410d7e0 con 0x7f90f4101a00 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90f9a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 0x7f90f4075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90f9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 0x7f90f4073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90f9a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 0x7f90f4075750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49162/0 (socket says 172.21.15.31:49162) 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.437+0000 7f90f9a00640 1 -- 172.21.15.31:0/382276318 learned_addr learned my addr 172.21.15.31:0/382276318 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90fa400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 0x7f90f40742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 -- 172.21.15.31:0/382276318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 msgr2=0x7f90f4075750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 0x7f90f4075750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 -- 172.21.15.31:0/382276318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 msgr2=0x7f90f40742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 0x7f90f40742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 -- 172.21.15.31:0/382276318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f4074b60 con 0x7f90f4102bf0 2024-06-02T22:51:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.438+0000 7f90f9000640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 0x7f90f4073d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f90e8035040 tx=0x7f90e8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.440+0000 7f90f2000640 1 -- 172.21.15.31:0/382276318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8037040 con 0x7f90f4102bf0 2024-06-02T22:51:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.440+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f41a1cd0 con 0x7f90f4102bf0 2024-06-02T22:51:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.440+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f41a2190 con 0x7f90f4102bf0 2024-06-02T22:51:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.440+0000 7f90f2000640 1 -- 172.21.15.31:0/382276318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e8030850 con 0x7f90f4102bf0 2024-06-02T22:51:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.440+0000 7f90f2000640 1 -- 172.21.15.31:0/382276318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e80046c0 con 0x7f90f4102bf0 2024-06-02T22:51:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.445+0000 7f90ff1ec740 1 Processor -- start 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.445+0000 7f90ff1ec740 1 -- start start 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932a980c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 0x558932a9abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5589329f6420 con 0x558932a935c0 2024-06-02T22:51:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55893299dc50 con 0x558932a98730 2024-06-02T22:51:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5589329f23e0 con 0x558932a92bd0 2024-06-02T22:51:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90f2000640 1 -- 172.21.15.31:0/382276318 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f90e8004050 con 0x7f90f4102bf0 2024-06-02T22:51:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90fa400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90fa400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49164/0 (socket says 172.21.15.31:49164) 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.446+0000 7f90fa400640 1 -- 172.21.15.31:0/1500156976 learned_addr learned my addr 172.21.15.31:0/1500156976 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90f9000640 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 0x558932a9abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 -- 172.21.15.31:0/1500156976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 msgr2=0x558932a9abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 0x558932a9abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 -- 172.21.15.31:0/1500156976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 msgr2=0x558932a980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932a980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 -- 172.21.15.31:0/1500156976 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893270a210 con 0x558932a92bd0 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90f9000640 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 0x558932a9abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90fa400640 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00e580 tx=0x7f90ec0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6101bd766e75d1db server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90e2a00640 1 -- 172.21.15.31:0/1500156976 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec003970 con 0x558932a92bd0 2024-06-02T22:51:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90e2a00640 1 -- 172.21.15.31:0/1500156976 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ec00d830 con 0x558932a92bd0 2024-06-02T22:51:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.447+0000 7f90e2a00640 1 -- 172.21.15.31:0/1500156976 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0045a0 con 0x558932a92bd0 2024-06-02T22:51:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90f2000640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 0x7f90dc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90f2000640 1 -- 172.21.15.31:0/382276318 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f90e80eee40 con 0x7f90f4102bf0 2024-06-02T22:51:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90f9a00640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 0x7f90dc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1500156976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 msgr2=0x558932a92ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00e580 tx=0x7f90ec0095c0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.448+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1500156976 shutdown_connections 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a98730 0x558932a9abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932a980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1500156976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a92bd0 0x558932a92ff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1500156976 >> 172.21.15.31:0/1500156976 conn(0x558932a5af80 msgr2=0x558932a8e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1500156976 shutdown_connections 2024-06-02T22:51:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1500156976 wait complete. 2024-06-02T22:51:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.449+0000 7f90ff1ec740 1 -- start start 2024-06-02T22:51:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.450+0000 7f90ff1ec740 1 Processor -- start 2024-06-02T22:51:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.450+0000 7f90f9a00640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 0x7f90dc0a5170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x558932a8f500 tx=0x7f90e40046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.453+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932aa5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.453+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aa5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.453+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.453+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558932a9b6e0 con 0x558932a935c0 2024-06-02T22:51:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.454+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5589329b10b0 con 0x558932a92bd0 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.454+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558932a9b860 con 0x558932a98730 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.454+0000 7f90ff1ec740 10 client.0 _ll_register_callbacks cb 0x55893299cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.454+0000 7f90fa400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.454+0000 7f90fa400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:49180/0 (socket says 172.21.15.31:49180) 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 -- 172.21.15.31:0/3858180475 learned_addr learned my addr 172.21.15.31:0/3858180475 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90f9000640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aa5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90f9a00640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932aa5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 -- 172.21.15.31:0/3858180475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 msgr2=0x558932aa5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932aa5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 -- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 msgr2=0x558932aa5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aa5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.455+0000 7f90fa400640 1 -- 172.21.15.31:0/3858180475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589327d6620 con 0x558932a98730 2024-06-02T22:51:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90f9000640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aa5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:51:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90fa400640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097f0 tx=0x7f90ec00ddd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89087a0772e774c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90d7400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec027070 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f90ec003c00 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.456+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ec00d830 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.457+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90ec033050 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.457+0000 7f90ff1ec740 10 client.26197 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.457+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558932aaff70 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.457+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ec00d830 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f90ec00b040 con 0x558932a98730 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 10 client.26197 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 10 client.26197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 20 client.26197 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932ab1380 0x558932ab3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 4 client.26197 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558932a03b50 con 0x558932ab1380 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.458+0000 7f90f9a00640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932ab1380 0x558932ab3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.460+0000 7f90f9a00640 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932ab1380 0x558932ab3790 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92611ea902c5b98b server_cookie=5ef7d683c66af62b in_seq=0 out_seq=0 2024-06-02T22:51:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.460+0000 7f90d7400640 10 client.26197 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.461+0000 7f90d7400640 1 -- 172.21.15.31:0/3858180475 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558932a03b50 con 0x558932ab1380 2024-06-02T22:51:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.461+0000 7f90d7400640 10 client.26197 handle_command_reply: tid=0 2024-06-02T22:51:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 client.26197 shutdown 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 msgr2=0x558932aacc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097f0 tx=0x7f90ec00ddd0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 shutdown_connections 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932ab1380 0x558932ab3790 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a98730 0x558932aacc90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aa5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90d7400640 0 client.26197 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/3858180475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932aa5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 >> 172.21.15.31:0/3858180475 conn(0x558932a5af80 msgr2=0x558932a8d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.462+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 shutdown_connections 2024-06-02T22:51:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.463+0000 7f90ff1ec740 1 -- 172.21.15.31:0/3858180475 wait complete. 2024-06-02T22:51:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.463+0000 7f90ff1ec740 20 client.26197 trim_cache size 0 max 16384 2024-06-02T22:51:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.490+0000 7f90ff1ec740 1 Processor -- start 2024-06-02T22:51:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.490+0000 7f90ff1ec740 1 -- start start 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.490+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a5af80 0x558932ab3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.490+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aacc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f90d800fc40 con 0x558932a935c0 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90d8011780 con 0x558932a92bd0 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90d8010310 con 0x558932a5af80 2024-06-02T22:51:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48528/0 (socket says 172.21.15.31:48528) 2024-06-02T22:51:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 -- 172.21.15.31:0/1261223150 learned_addr learned my addr 172.21.15.31:0/1261223150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9a00640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a5af80 0x558932ab3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 -- 172.21.15.31:0/1261223150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a5af80 msgr2=0x558932ab3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a5af80 0x558932ab3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 -- 172.21.15.31:0/1261223150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 msgr2=0x558932aacc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90fa400640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aacc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aacc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90f9000640 1 -- 172.21.15.31:0/1261223150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558932ab3e10 con 0x558932a92bd0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.491+0000 7f90fa400640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aacc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.492+0000 7f90f9000640 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90e80bb010 tx=0x7f90e80057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc4cdd27c3673a7f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.492+0000 7f90e2000640 1 -- 172.21.15.31:0/1261223150 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e80bac70 con 0x558932a92bd0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.492+0000 7f90e2000640 1 -- 172.21.15.31:0/1261223150 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e80bba10 con 0x558932a92bd0 2024-06-02T22:51:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.492+0000 7f90e2000640 1 -- 172.21.15.31:0/1261223150 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8004340 con 0x558932a92bd0 2024-06-02T22:51:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1261223150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 msgr2=0x558932a8e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90e80bb010 tx=0x7f90e80057e0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1261223150 shutdown_connections 2024-06-02T22:51:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a935c0 0x558932aacc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a92bd0 0x558932a8e7e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/1261223150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a5af80 0x558932ab3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1261223150 >> 172.21.15.31:0/1261223150 conn(0x558932a98200 msgr2=0x558932a8e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.493+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1261223150 shutdown_connections 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.494+0000 7f90ff1ec740 1 -- 172.21.15.31:0/1261223150 wait complete. 2024-06-02T22:51:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.494+0000 7f90ff1ec740 1 -- start start 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.494+0000 7f90ff1ec740 1 Processor -- start 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 0x558932aaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a935c0 0x558932aab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80110b0 con 0x558932a92bd0 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80109e0 con 0x558932a5af80 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f90d800dc20 con 0x558932a935c0 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.495+0000 7f90ff1ec740 10 client.0 _ll_register_callbacks cb 0x7f90ec00e450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:48544/0 (socket says 172.21.15.31:48544) 2024-06-02T22:51:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 -- 172.21.15.31:0/687708963 learned_addr learned my addr 172.21.15.31:0/687708963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90fa400640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a935c0 0x558932aab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9000640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 0x558932aaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 -- 172.21.15.31:0/687708963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a935c0 msgr2=0x558932aab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a935c0 0x558932aab840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.496+0000 7f90f9a00640 1 -- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 msgr2=0x558932aaa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.497+0000 7f90f9a00640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 0x558932aaa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.497+0000 7f90f9a00640 1 -- 172.21.15.31:0/687708963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558932a9bfc0 con 0x558932a5af80 2024-06-02T22:51:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.497+0000 7f90f9000640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 0x558932aaa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.497+0000 7f90f9a00640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009ee0 tx=0x7f90e4005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=616f13900122d60 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90d7400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:51:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e402d070 con 0x558932a5af80 2024-06-02T22:51:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90e80bba10 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f90e4005020 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90e4038050 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90ff1ec740 10 client.26213 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.498+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558932aad030 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90e80bba10 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f90e4026320 con 0x558932a5af80 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 10 client.26213 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 10 client.26213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 20 client.26213 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932a98730 0x558932b1e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 4 client.26213 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:51:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.499+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589329fdea0 con 0x558932a98730 2024-06-02T22:51:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.500+0000 7f90f9000640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932a98730 0x558932b1e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.501+0000 7f90f9000640 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932a98730 0x558932b1e860 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bec3e0b160a4088 server_cookie=65c3070ab6fc1929 in_seq=0 out_seq=0 2024-06-02T22:51:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.501+0000 7f90d7400640 10 client.26213 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90d7400640 1 -- 172.21.15.31:0/687708963 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5589329fdea0 con 0x558932a98730 2024-06-02T22:51:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90d7400640 10 client.26213 handle_command_reply: tid=0 2024-06-02T22:51:36.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90ff1ec740 1 client.26213 shutdown 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 msgr2=0x558932aaa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009ee0 tx=0x7f90e4005f90 comp rx=0 tx=0).stop 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 shutdown_connections 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.533+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x558932a98730 0x558932b1e860 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558932a935c0 0x558932aab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558932a92bd0 0x558932aaa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.534 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 --2- 172.21.15.31:0/687708963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558932a5af80 0x558932aaa340 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 >> 172.21.15.31:0/687708963 conn(0x558932a98200 msgr2=0x558932a91620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90d7400640 0 client.26213 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 shutdown_connections 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 1 -- 172.21.15.31:0/687708963 wait complete. 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.534+0000 7f90ff1ec740 20 client.26213 trim_cache size 0 max 16384 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:51:36.535 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:51:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:51:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 msgr2=0x7f90dc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 0x7f90dc0a5170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x558932a8f500 tx=0x7f90e40046c0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 msgr2=0x7f90f4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:36.536 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 0x7f90f4073d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f90e8035040 tx=0x7f90e8033d90 comp rx=0 tx=0).stop 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 shutdown_connections 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f90dc0a2cb0 0x7f90dc0a5170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f41035b0 0x7f90f40742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90f4102bf0 0x7f90f4073d90 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f90e8035040 tx=0x7f90e8033d90 comp rx=0 tx=0).stop 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 --2- 172.21.15.31:0/382276318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f4101a00 0x7f90f4075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.536+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 >> 172.21.15.31:0/382276318 conn(0x7f90f40fcf90 msgr2=0x7f90f4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:36.537 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.537+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 shutdown_connections 2024-06-02T22:51:36.538 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:36.537+0000 7f90fc400640 1 -- 172.21.15.31:0/382276318 wait complete. 2024-06-02T22:51:36.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:36 smithi178 ceph-mon[36614]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-06-02T22:51:36.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:36 smithi031 ceph-mon[31767]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-06-02T22:51:36.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:36 smithi098 ceph-mon[36750]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 7.2 MiB/s wr, 689 op/s 2024-06-02T22:51:38.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:38 smithi178 ceph-mon[36614]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-06-02T22:51:38.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:38 smithi031 ceph-mon[31767]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-06-02T22:51:38.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:38 smithi098 ceph-mon[36750]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.8 MiB/s wr, 655 op/s 2024-06-02T22:51:40.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 855.0 s, 421.0 tps, lat 237.342 ms stddev 246.827 2024-06-02T22:51:40.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:40 smithi031 ceph-mon[31767]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 8.1 MiB/s wr, 790 op/s 2024-06-02T22:51:40.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:40 smithi098 ceph-mon[36750]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 8.1 MiB/s wr, 790 op/s 2024-06-02T22:51:40.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:40 smithi178 ceph-mon[36614]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 8.1 MiB/s wr, 790 op/s 2024-06-02T22:51:42.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:42 smithi031 ceph-mon[31767]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 777 op/s 2024-06-02T22:51:42.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:42 smithi098 ceph-mon[36750]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 777 op/s 2024-06-02T22:51:42.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:42 smithi178 ceph-mon[36614]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 777 op/s 2024-06-02T22:51:44.623 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:44 smithi031 ceph-mon[31767]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.5 MiB/s wr, 695 op/s 2024-06-02T22:51:44.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:44 smithi098 ceph-mon[36750]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.5 MiB/s wr, 695 op/s 2024-06-02T22:51:44.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:44 smithi178 ceph-mon[36614]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 6.5 MiB/s wr, 695 op/s 2024-06-02T22:51:45.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 860.0 s, 528.8 tps, lat 190.549 ms stddev 222.814 2024-06-02T22:51:46.613 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:46 smithi178 ceph-mon[36614]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-06-02T22:51:46.620 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:46 smithi031 ceph-mon[31767]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-06-02T22:51:46.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:46 smithi098 ceph-mon[36750]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-06-02T22:51:48.621 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:48 smithi031 ceph-mon[31767]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-06-02T22:51:48.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:48 smithi098 ceph-mon[36750]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-06-02T22:51:48.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:48 smithi178 ceph-mon[36614]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.7 MiB/s wr, 527 op/s 2024-06-02T22:51:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.756+0000 7f6afd800640 1 -- 172.21.15.31:0/3162637113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af810b5d0 msgr2=0x7f6af810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.756+0000 7f6afd800640 1 --2- 172.21.15.31:0/3162637113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af810b5d0 0x7f6af810da20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009900 tx=0x7f6ae402a410 comp rx=0 tx=0).stop 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 -- 172.21.15.31:0/3162637113 shutdown_connections 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 --2- 172.21.15.31:0/3162637113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af8110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 --2- 172.21.15.31:0/3162637113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af810b5d0 0x7f6af810da20 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009900 tx=0x7f6ae402a410 comp rx=0 tx=0).stop 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 --2- 172.21.15.31:0/3162637113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af8108c10 0x7f6af810b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 -- 172.21.15.31:0/3162637113 >> 172.21.15.31:0/3162637113 conn(0x7f6af806ea10 msgr2=0x7f6af8070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 -- 172.21.15.31:0/3162637113 shutdown_connections 2024-06-02T22:51:49.757 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.757+0000 7f6afd800640 1 -- 172.21.15.31:0/3162637113 wait complete. 2024-06-02T22:51:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.758+0000 7f6afd800640 1 Processor -- start 2024-06-02T22:51:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 -- start start 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af8108c10 0x7f6af81a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af81a7f00 0x7f6af81aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8113d40 con 0x7f6af81a7f00 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8113bc0 con 0x7f6af810e0b0 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.760+0000 7f6afd800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8113ec0 con 0x7f6af8108c10 2024-06-02T22:51:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57128/0 (socket says 172.21.15.31:57128) 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 -- 172.21.15.31:0/902490475 learned_addr learned my addr 172.21.15.31:0/902490475 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6a00640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af8108c10 0x7f6af81a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af7400640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af81a7f00 0x7f6af81aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 -- 172.21.15.31:0/902490475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af8108c10 msgr2=0x7f6af81a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af8108c10 0x7f6af81a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 -- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af81a7f00 msgr2=0x7f6af81aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af81a7f00 0x7f6af81aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.761+0000 7f6af6000640 1 -- 172.21.15.31:0/902490475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af81aa960 con 0x7f6af810e0b0 2024-06-02T22:51:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.762+0000 7f6af6000640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4006010 tx=0x7f6ae4032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.762+0000 7f6aef400640 1 -- 172.21.15.31:0/902490475 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae403f030 con 0x7f6af810e0b0 2024-06-02T22:51:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.762+0000 7f6aef400640 1 -- 172.21.15.31:0/902490475 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae4003ce0 con 0x7f6af810e0b0 2024-06-02T22:51:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.762+0000 7f6aef400640 1 -- 172.21.15.31:0/902490475 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4035070 con 0x7f6af810e0b0 2024-06-02T22:51:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.763+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af8199420 con 0x7f6af810e0b0 2024-06-02T22:51:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.763+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af8199910 con 0x7f6af810e0b0 2024-06-02T22:51:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.767+0000 7f6b0057d740 1 Processor -- start 2024-06-02T22:51:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 -- start start 2024-06-02T22:51:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a254010c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a25403bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560a2535f420 con 0x560a253fbbd0 2024-06-02T22:51:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a25306c50 con 0x560a25401730 2024-06-02T22:51:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.768+0000 7f6b0057d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560a2535b3e0 con 0x560a253fc5c0 2024-06-02T22:51:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.770+0000 7f6af6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a254010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.770+0000 7f6af6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a254010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54642/0 (socket says 172.21.15.31:54642) 2024-06-02T22:51:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.770+0000 7f6af6a00640 1 -- 172.21.15.31:0/721280059 learned_addr learned my addr 172.21.15.31:0/721280059 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.770+0000 7f6af7400640 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6af7400640 1 -- 172.21.15.31:0/721280059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 msgr2=0x560a254010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6af7400640 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a254010c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6af7400640 1 -- 172.21.15.31:0/721280059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 msgr2=0x560a25403bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6af7400640 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a25403bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6af7400640 1 -- 172.21.15.31:0/721280059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a25073210 con 0x560a253fbbd0 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.771+0000 7f6aef400640 1 -- 172.21.15.31:0/902490475 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6ae4042030 con 0x7f6af810e0b0 2024-06-02T22:51:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.772+0000 7f6af7400640 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fbff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6af0005fd0 tx=0x7f6af000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04e9a132f940b1f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.772+0000 7f6ae3e00640 1 -- 172.21.15.31:0/721280059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00092d0 con 0x560a253fbbd0 2024-06-02T22:51:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.772+0000 7f6ae3e00640 1 -- 172.21.15.31:0/721280059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6af0009470 con 0x560a253fbbd0 2024-06-02T22:51:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.772+0000 7f6ae3e00640 1 -- 172.21.15.31:0/721280059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00075e0 con 0x560a253fbbd0 2024-06-02T22:51:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.773+0000 7f6aef400640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 0x7f6adc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.774+0000 7f6aef400640 1 -- 172.21.15.31:0/902490475 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6ae40ef3e0 con 0x7f6af810e0b0 2024-06-02T22:51:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.774+0000 7f6af6a00640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 0x7f6adc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.777+0000 7f6b0057d740 1 -- 172.21.15.31:0/721280059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 msgr2=0x560a253fbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.777+0000 7f6b0057d740 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fbff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6af0005fd0 tx=0x7f6af000aea0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.777+0000 7f6b0057d740 1 -- 172.21.15.31:0/721280059 shutdown_connections 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.777+0000 7f6b0057d740 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a25403bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.777+0000 7f6b0057d740 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a254010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.778+0000 7f6b0057d740 1 --2- 172.21.15.31:0/721280059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fbff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.778+0000 7f6b0057d740 1 -- 172.21.15.31:0/721280059 >> 172.21.15.31:0/721280059 conn(0x560a253c3f80 msgr2=0x560a253f7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.778+0000 7f6b0057d740 1 -- 172.21.15.31:0/721280059 shutdown_connections 2024-06-02T22:51:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.779+0000 7f6b0057d740 1 -- 172.21.15.31:0/721280059 wait complete. 2024-06-02T22:51:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.779+0000 7f6b0057d740 1 -- start start 2024-06-02T22:51:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.779+0000 7f6b0057d740 1 Processor -- start 2024-06-02T22:51:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.780+0000 7f6af6a00640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 0x7f6adc0a5170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006a30 tx=0x7f6ae8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fbbd0 0x560a25405f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 0x560a254064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560a254046e0 con 0x560a253fc5c0 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a2531a0b0 con 0x560a253fbbd0 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6b0057d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560a25404860 con 0x560a25401730 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6af7400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6af7400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:54648/0 (socket says 172.21.15.31:54648) 2024-06-02T22:51:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.781+0000 7f6af7400640 1 -- 172.21.15.31:0/1230722184 learned_addr learned my addr 172.21.15.31:0/1230722184 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af6000640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 0x560a254064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af7400640 1 -- 172.21.15.31:0/1230722184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fbbd0 msgr2=0x560a25405f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af7400640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fbbd0 0x560a25405f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af7400640 1 -- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 msgr2=0x560a254064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af7400640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 0x560a254064b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af7400640 1 -- 172.21.15.31:0/1230722184 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2513f620 con 0x560a25401730 2024-06-02T22:51:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6af6000640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 0x560a254064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.782+0000 7f6b0057d740 10 client.0 _ll_register_callbacks cb 0x560a25305f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.783+0000 7f6ae0c00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:51:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.783+0000 7f6af7400640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6af00049a0 tx=0x7f6af0009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7e6acfc9335efe7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.783+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6af0009470 con 0x560a25401730 2024-06-02T22:51:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.785+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1230722184 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af002f050 con 0x560a25401730 2024-06-02T22:51:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.785+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1230722184 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6af0003970 con 0x560a25401730 2024-06-02T22:51:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.786+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1230722184 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6af0024030 con 0x560a25401730 2024-06-02T22:51:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.787+0000 7f6b0057d740 10 client.26215 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.787+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560a25410670 con 0x560a25401730 2024-06-02T22:51:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1230722184 <== mon.1 v2:172.21.15.178:3300/0 4 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6af0003b70 con 0x560a25401730 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 10 client.26215 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 10 client.26215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 20 client.26215 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a25413db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 4 client.26215 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:51:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.788+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a2536cb50 con 0x560a254119c0 2024-06-02T22:51:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.789+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a25413db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.790+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a25413db0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5b3887004e2a02 server_cookie=dac801df16c95a03 in_seq=0 out_seq=0 2024-06-02T22:51:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.790+0000 7f6ae0c00640 10 client.26215 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.792+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1230722184 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560a2536cb50 con 0x560a254119c0 2024-06-02T22:51:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.792+0000 7f6ae0c00640 10 client.26215 handle_command_reply: tid=0 2024-06-02T22:51:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.792+0000 7f6b0057d740 1 client.26215 shutdown 2024-06-02T22:51:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 msgr2=0x560a2540d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.796 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6af00049a0 tx=0x7f6af0009850 comp rx=0 tx=0).stop 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 shutdown_connections 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a25413db0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6ae0c00640 0 client.26215 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a2540d4f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fc5c0 0x560a254064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1230722184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fbbd0 0x560a25405f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.797+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 >> 172.21.15.31:0/1230722184 conn(0x560a253c3f80 msgr2=0x560a253f6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.799+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 shutdown_connections 2024-06-02T22:51:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.799+0000 7f6b0057d740 1 -- 172.21.15.31:0/1230722184 wait complete. 2024-06-02T22:51:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.799+0000 7f6b0057d740 20 client.26215 trim_cache size 0 max 16384 2024-06-02T22:51:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.832+0000 7f6b0057d740 1 Processor -- start 2024-06-02T22:51:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.832+0000 7f6b0057d740 1 -- start start 2024-06-02T22:51:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.832+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.832 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 0x560a2540d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a25418610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6b0057d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81b9b10 con 0x560a253fbbd0 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6b0057d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81bb650 con 0x560a253fc5c0 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6b0057d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81ba1e0 con 0x560a25401730 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 0x560a2540d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 0x560a2540d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57152/0 (socket says 172.21.15.31:57152) 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6000640 1 -- 172.21.15.31:0/4000084138 learned_addr learned my addr 172.21.15.31:0/4000084138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af7400640 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a25418610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6a00640 1 -- 172.21.15.31:0/4000084138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 msgr2=0x560a25418610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.833+0000 7f6af6a00640 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a25418610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.834+0000 7f6af6a00640 1 -- 172.21.15.31:0/4000084138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 msgr2=0x560a2540d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.834+0000 7f6af6a00640 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 0x560a2540d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.834+0000 7f6af6a00640 1 -- 172.21.15.31:0/4000084138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a25414390 con 0x560a253fbbd0 2024-06-02T22:51:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.834+0000 7f6af6a00640 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fac20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560a25414590 tx=0x7f6ae8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d7af88912f6230 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.835+0000 7f6ae3400640 1 -- 172.21.15.31:0/4000084138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8030070 con 0x560a253fbbd0 2024-06-02T22:51:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.835+0000 7f6ae3400640 1 -- 172.21.15.31:0/4000084138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae801d040 con 0x560a253fbbd0 2024-06-02T22:51:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.835+0000 7f6ae3400640 1 -- 172.21.15.31:0/4000084138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae801c030 con 0x560a253fbbd0 2024-06-02T22:51:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- 172.21.15.31:0/4000084138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 msgr2=0x560a253fac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fac20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560a25414590 tx=0x7f6ae8013000 comp rx=0 tx=0).stop 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- 172.21.15.31:0/4000084138 shutdown_connections 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a25401730 0x560a25418610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a253fc5c0 0x560a2540d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 --2- 172.21.15.31:0/4000084138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a253fac20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- 172.21.15.31:0/4000084138 >> 172.21.15.31:0/4000084138 conn(0x560a253c3f80 msgr2=0x560a253fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- 172.21.15.31:0/4000084138 shutdown_connections 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- 172.21.15.31:0/4000084138 wait complete. 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.836+0000 7f6b0057d740 1 -- start start 2024-06-02T22:51:49.836 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 Processor -- start 2024-06-02T22:51:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a2540a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a2540ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81baf80 con 0x560a253fbbd0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81ba8b0 con 0x560a25401730 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81b7af0 con 0x560a253fc5c0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6b0057d740 10 client.0 _ll_register_callbacks cb 0x7f6ae800b220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.837+0000 7f6af7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57156/0 (socket says 172.21.15.31:57156) 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 -- 172.21.15.31:0/1216875749 learned_addr learned my addr 172.21.15.31:0/1216875749 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af6000640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a2540ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 -- 172.21.15.31:0/1216875749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 msgr2=0x560a2540ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a2540ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a2540a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 -- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 msgr2=0x560a2540a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a2540a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af7400640 1 -- 172.21.15.31:0/1216875749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2540c320 con 0x560a25401730 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.838+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a2540a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.839+0000 7f6af7400640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6af00049a0 tx=0x7f6af000c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa9d8c69107e740 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.839+0000 7f6ae0c00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:51:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.839+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af002f070 con 0x560a25401730 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.839+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae801d040 con 0x560a25401730 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.840+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6af0007840 con 0x560a25401730 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.841+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6af0007a40 con 0x560a25401730 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.841+0000 7f6b0057d740 10 client.26225 fetch_fsmap learned FSMap version 30 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.841+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560a2540d630 con 0x560a25401730 2024-06-02T22:51:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ae801d040 con 0x560a25401730 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6af0020440 con 0x560a25401730 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 10 client.26225 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 10 client.26225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 20 client.26225 populate_metadata read hostname 'smithi031' 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a2547ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 4 client.26225 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.842+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a25405d60 con 0x560a254119c0 2024-06-02T22:51:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.843+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a2547ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:51:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.844+0000 7f6af6a00640 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a2547ec00 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39490122eae44b8 server_cookie=476937ef7c0e5f1 in_seq=0 out_seq=0 2024-06-02T22:51:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.844+0000 7f6ae0c00640 10 client.26225 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6ae0c00640 1 -- 172.21.15.31:0/1216875749 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560a25405d60 con 0x560a254119c0 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6ae0c00640 10 client.26225 handle_command_reply: tid=0 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 client.26225 shutdown 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 msgr2=0x560a2540bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6af00049a0 tx=0x7f6af000c040 comp rx=0 tx=0).stop 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 shutdown_connections 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x560a254119c0 0x560a2547ec00 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a25401730 0x560a2540bd30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a253fc5c0 0x560a2540ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 --2- 172.21.15.31:0/1216875749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560a253fbbd0 0x560a2540a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 >> 172.21.15.31:0/1216875749 conn(0x560a253c3f80 msgr2=0x560a253fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6ae0c00640 0 client.26225 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 shutdown_connections 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 1 -- 172.21.15.31:0/1216875749 wait complete. 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.878+0000 7f6b0057d740 20 client.26225 trim_cache size 0 max 16384 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:51:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 msgr2=0x7f6adc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 0x7f6adc0a5170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006a30 tx=0x7f6ae8008040 comp rx=0 tx=0).stop 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 msgr2=0x7f6af81a2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4006010 tx=0x7f6ae4032ce0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 shutdown_connections 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6adc0a2cb0 0x7f6adc0a5170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6af81a7f00 0x7f6af81aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6af810e0b0 0x7f6af81a2ea0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 --2- 172.21.15.31:0/902490475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6af8108c10 0x7f6af81a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:51:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 >> 172.21.15.31:0/902490475 conn(0x7f6af806ea10 msgr2=0x7f6af810ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:51:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 shutdown_connections 2024-06-02T22:51:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:51:49.879+0000 7f6afd800640 1 -- 172.21.15.31:0/902490475 wait complete. 2024-06-02T22:51:50.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 865.0 s, 488.0 tps, lat 200.605 ms stddev 225.944 2024-06-02T22:51:50.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:50 smithi098 ceph-mon[36750]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:51:50.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:50 smithi178 ceph-mon[36614]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:51:50.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:50 smithi031 ceph-mon[31767]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.1 MiB/s wr, 566 op/s 2024-06-02T22:51:52.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:52 smithi098 ceph-mon[36750]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 519 op/s 2024-06-02T22:51:52.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:52 smithi178 ceph-mon[36614]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 519 op/s 2024-06-02T22:51:52.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:52 smithi031 ceph-mon[31767]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 4.6 MiB/s wr, 519 op/s 2024-06-02T22:51:54.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:54 smithi098 ceph-mon[36750]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 506 op/s 2024-06-02T22:51:54.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:54 smithi178 ceph-mon[36614]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 506 op/s 2024-06-02T22:51:54.874 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:54 smithi031 ceph-mon[31767]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.3 MiB/s wr, 506 op/s 2024-06-02T22:51:55.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 870.0 s, 471.6 tps, lat 212.210 ms stddev 240.064 2024-06-02T22:51:56.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:56 smithi098 ceph-mon[36750]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 479 op/s 2024-06-02T22:51:56.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:56 smithi178 ceph-mon[36614]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 479 op/s 2024-06-02T22:51:56.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:56 smithi031 ceph-mon[31767]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.1 MiB/s wr, 479 op/s 2024-06-02T22:51:58.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:51:58 smithi098 ceph-mon[36750]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-06-02T22:51:58.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:51:58 smithi178 ceph-mon[36614]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-06-02T22:51:58.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:51:58 smithi031 ceph-mon[31767]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.1 MiB/s wr, 468 op/s 2024-06-02T22:52:00.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 875.0 s, 493.6 tps, lat 203.467 ms stddev 249.839 2024-06-02T22:52:00.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:00 smithi098 ceph-mon[36750]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:52:00.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:00 smithi178 ceph-mon[36614]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:52:00.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:00 smithi031 ceph-mon[31767]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.4 MiB/s wr, 510 op/s 2024-06-02T22:52:02.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:02 smithi098 ceph-mon[36750]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.2 MiB/s wr, 496 op/s 2024-06-02T22:52:02.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:02 smithi178 ceph-mon[36614]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.2 MiB/s wr, 496 op/s 2024-06-02T22:52:02.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:02 smithi031 ceph-mon[31767]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.2 MiB/s wr, 496 op/s 2024-06-02T22:52:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.101+0000 7f3c07200640 1 -- 172.21.15.31:0/1817467802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08102a50 msgr2=0x7f3c08102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.101 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.101+0000 7f3c07200640 1 --2- 172.21.15.31:0/1817467802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08102a50 0x7f3c08102ed0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009900 tx=0x7f3bf402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 -- 172.21.15.31:0/1817467802 shutdown_connections 2024-06-02T22:52:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 --2- 172.21.15.31:0/1817467802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c08109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 --2- 172.21.15.31:0/1817467802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08102a50 0x7f3c08102ed0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 --2- 172.21.15.31:0/1817467802 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08101860 0x7f3c08101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.105 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 -- 172.21.15.31:0/1817467802 >> 172.21.15.31:0/1817467802 conn(0x7f3c080fcdd0 msgr2=0x7f3c080ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 -- 172.21.15.31:0/1817467802 shutdown_connections 2024-06-02T22:52:03.106 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.106+0000 7f3c07200640 1 -- 172.21.15.31:0/1817467802 wait complete. 2024-06-02T22:52:03.107 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.108+0000 7f3c07200640 1 Processor -- start 2024-06-02T22:52:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.108+0000 7f3c07200640 1 -- start start 2024-06-02T22:52:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 0x7f3c08195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08102a50 0x7f3c08195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c081ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0810d510 con 0x7f3c08102a50 2024-06-02T22:52:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0810d390 con 0x7f3c08101860 2024-06-02T22:52:03.109 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c07200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0810d690 con 0x7f3c08103410 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.109+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 0x7f3c08195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 0x7f3c08195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:58598/0 (socket says 172.21.15.31:58598) 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c05e00640 1 -- 172.21.15.31:0/3335591074 learned_addr learned my addr 172.21.15.31:0/3335591074 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c081ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c05400640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08102a50 0x7f3c08195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c06800640 1 -- 172.21.15.31:0/3335591074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 msgr2=0x7f3c08195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 0x7f3c08195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.110+0000 7f3c06800640 1 -- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08102a50 msgr2=0x7f3c08195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.111+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08102a50 0x7f3c08195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.111+0000 7f3c06800640 1 -- 172.21.15.31:0/3335591074 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0819b010 con 0x7f3c08103410 2024-06-02T22:52:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.111+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c081ae420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000e970 tx=0x7f3c0000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.113+0000 7f3bfea00640 1 -- 172.21.15.31:0/3335591074 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000ccc0 con 0x7f3c08103410 2024-06-02T22:52:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.113+0000 7f3bfea00640 1 -- 172.21.15.31:0/3335591074 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c00005020 con 0x7f3c08103410 2024-06-02T22:52:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.113+0000 7f3bfea00640 1 -- 172.21.15.31:0/3335591074 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004a00 con 0x7f3c08103410 2024-06-02T22:52:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.113+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c081ae960 con 0x7f3c08103410 2024-06-02T22:52:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.113+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081aed70 con 0x7f3c08103410 2024-06-02T22:52:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.118+0000 7f3c0f817740 1 Processor -- start 2024-06-02T22:52:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.124+0000 7f3bfea00640 1 -- 172.21.15.31:0/3335591074 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f3c000051d0 con 0x7f3c08103410 2024-06-02T22:52:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.124+0000 7f3c0f817740 1 -- start start 2024-06-02T22:52:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd79137d90 0x55bd791381b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd7913d8f0 0x55bd7913fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bd7909b420 con 0x55bd7913d8f0 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd79042c50 con 0x55bd79137d90 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.125+0000 7f3c0f817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bd790973e0 con 0x55bd79138780 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41376/0 (socket says 172.21.15.31:41376) 2024-06-02T22:52:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 -- 172.21.15.31:0/2212867469 learned_addr learned my addr 172.21.15.31:0/2212867469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3bfea00640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 0x7f3bec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 -- 172.21.15.31:0/2212867469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd79137d90 msgr2=0x55bd791381b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd79137d90 0x55bd791381b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.126+0000 7f3c05e00640 1 -- 172.21.15.31:0/2212867469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd7913d8f0 msgr2=0x55bd7913fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:52:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.127+0000 7f3bfea00640 1 -- 172.21.15.31:0/3335591074 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3c000cf370 con 0x7f3c08103410 2024-06-02T22:52:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.128+0000 7f3c05e00640 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd7913d8f0 0x55bd7913fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.128+0000 7f3c05e00640 1 -- 172.21.15.31:0/2212867469 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd78daf210 con 0x55bd79138780 2024-06-02T22:52:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.128+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 0x7f3bec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.128+0000 7f3c05e00640 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fa0 tx=0x7f3bf800f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ab1a0ca5ccf859 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.128 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.128+0000 7f3bf3000640 1 -- 172.21.15.31:0/2212867469 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8003b70 con 0x55bd79138780 2024-06-02T22:52:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.129+0000 7f3bf3000640 1 -- 172.21.15.31:0/2212867469 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8003d10 con 0x55bd79138780 2024-06-02T22:52:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.130+0000 7f3bf3000640 1 -- 172.21.15.31:0/2212867469 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8004650 con 0x55bd79138780 2024-06-02T22:52:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.130+0000 7f3c0f817740 1 -- 172.21.15.31:0/2212867469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 msgr2=0x55bd7913d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.129 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.130+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fa0 tx=0x7f3bf800f850 comp rx=0 tx=0).stop 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c06800640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 0x7f3bec0a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c00097ca0 tx=0x7f3c00005750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 -- 172.21.15.31:0/2212867469 shutdown_connections 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd7913d8f0 0x55bd7913fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd7913d280 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2212867469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd79137d90 0x55bd791381b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 -- 172.21.15.31:0/2212867469 >> 172.21.15.31:0/2212867469 conn(0x55bd790fff80 msgr2=0x55bd79133810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.131+0000 7f3c0f817740 1 -- 172.21.15.31:0/2212867469 shutdown_connections 2024-06-02T22:52:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.133+0000 7f3c0f817740 1 -- 172.21.15.31:0/2212867469 wait complete. 2024-06-02T22:52:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.133+0000 7f3c0f817740 1 -- start start 2024-06-02T22:52:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.134+0000 7f3c0f817740 1 Processor -- start 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79149650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55bd791408f0 con 0x55bd79138780 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bd790560b0 con 0x55bd7913d8f0 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55bd79140a70 con 0x55bd79137d90 2024-06-02T22:52:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.135+0000 7f3c0f817740 10 client.0 _ll_register_callbacks cb 0x55bd79041f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.137+0000 7f3c05400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.137+0000 7f3c05400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.137+0000 7f3c05400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41386/0 (socket says 172.21.15.31:41386) 2024-06-02T22:52:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.137+0000 7f3c05400640 1 -- 172.21.15.31:0/2813586246 learned_addr learned my addr 172.21.15.31:0/2813586246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.138+0000 7f3c05400640 1 -- 172.21.15.31:0/2813586246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 msgr2=0x55bd79149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.138+0000 7f3c05400640 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.138+0000 7f3c05400640 1 -- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 msgr2=0x55bd79142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.138+0000 7f3c05400640 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.138+0000 7f3c05400640 1 -- 172.21.15.31:0/2813586246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd78e7b620 con 0x55bd79137d90 2024-06-02T22:52:03.139 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.140+0000 7f3c05400640 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005c40 tx=0x7f3bf4031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290904c2fa0bd6c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.140+0000 7f3be7400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:52:03.140 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.141+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4045070 con 0x55bd79137d90 2024-06-02T22:52:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.143+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3bf40035f0 con 0x55bd79137d90 2024-06-02T22:52:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.144+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf8003d10 con 0x55bd79137d90 2024-06-02T22:52:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.144+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3bf4035040 con 0x55bd79137d90 2024-06-02T22:52:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.144+0000 7f3c0f817740 10 client.26233 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.144+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bd7914ca30 con 0x55bd79137d90 2024-06-02T22:52:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.147+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8003d10 con 0x55bd79137d90 2024-06-02T22:52:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.147+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3bf4048020 con 0x55bd79137d90 2024-06-02T22:52:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.147+0000 7f3c0f817740 10 client.26233 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.147+0000 7f3c0f817740 10 client.26233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.148+0000 7f3c0f817740 20 client.26233 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.148+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd7914e170 0x55bd791505c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.148+0000 7f3c0f817740 4 client.26233 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:52:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.148+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd790a8b50 con 0x55bd7914e170 2024-06-02T22:52:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.153+0000 7f3c05e00640 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd7914e170 0x55bd791505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.155+0000 7f3be7400640 10 client.26233 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.155+0000 7f3c05e00640 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd7914e170 0x55bd791505c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27b6695bd2d2da1 server_cookie=7720873d949d52b7 in_seq=0 out_seq=0 2024-06-02T22:52:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.156+0000 7f3be7400640 1 -- 172.21.15.31:0/2813586246 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bd790a8b50 con 0x55bd7914e170 2024-06-02T22:52:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.156+0000 7f3be7400640 10 client.26233 handle_command_reply: tid=0 2024-06-02T22:52:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.156+0000 7f3c0f817740 1 client.26233 shutdown 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.156+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 msgr2=0x55bd791420d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.156+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005c40 tx=0x7f3bf4031400 comp rx=0 tx=0).stop 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 shutdown_connections 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd7914e170 0x55bd791505c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 --2- 172.21.15.31:0/2813586246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791420d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3be7400640 0 client.26233 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 >> 172.21.15.31:0/2813586246 conn(0x55bd790fff80 msgr2=0x55bd79132970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 shutdown_connections 2024-06-02T22:52:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 1 -- 172.21.15.31:0/2813586246 wait complete. 2024-06-02T22:52:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.157+0000 7f3c0f817740 20 client.26233 trim_cache size 0 max 16384 2024-06-02T22:52:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.202+0000 7f3c0f817740 1 Processor -- start 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.202+0000 7f3c0f817740 1 -- start start 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.202+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79137d90 0x55bd791339a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.202+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.203+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.203+0000 7f3c0f817740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081b9330 con 0x55bd79137d90 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.203+0000 7f3c0f817740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081bae70 con 0x55bd7913d8f0 2024-06-02T22:52:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.203+0000 7f3c0f817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081b9a00 con 0x55bd79138780 2024-06-02T22:52:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41390/0 (socket says 172.21.15.31:41390) 2024-06-02T22:52:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 -- 172.21.15.31:0/856227692 learned_addr learned my addr 172.21.15.31:0/856227692 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05400640 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05400640 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79137d90 0x55bd791339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 -- 172.21.15.31:0/856227692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 msgr2=0x55bd79141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 -- 172.21.15.31:0/856227692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79137d90 msgr2=0x55bd791339a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79137d90 0x55bd791339a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.204+0000 7f3c05e00640 1 -- 172.21.15.31:0/856227692 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd79138520 con 0x55bd79138780 2024-06-02T22:52:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.205+0000 7f3c05e00640 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fa0 tx=0x7f3bf8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f77e69c73e491f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.206+0000 7f3bf2600640 1 -- 172.21.15.31:0/856227692 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf801d040 con 0x55bd79138780 2024-06-02T22:52:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.206+0000 7f3bf2600640 1 -- 172.21.15.31:0/856227692 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8027070 con 0x55bd79138780 2024-06-02T22:52:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.206+0000 7f3bf2600640 1 -- 172.21.15.31:0/856227692 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8010b70 con 0x55bd79138780 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 -- 172.21.15.31:0/856227692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 msgr2=0x55bd79149610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007fa0 tx=0x7f3bf8005fd0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 -- 172.21.15.31:0/856227692 shutdown_connections 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79138780 0x55bd79149610 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 --2- 172.21.15.31:0/856227692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79137d90 0x55bd791339a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.207+0000 7f3c0f817740 1 -- 172.21.15.31:0/856227692 >> 172.21.15.31:0/856227692 conn(0x55bd790fff80 msgr2=0x55bd79133290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.208+0000 7f3c0f817740 1 -- 172.21.15.31:0/856227692 shutdown_connections 2024-06-02T22:52:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.209+0000 7f3c0f817740 1 -- 172.21.15.31:0/856227692 wait complete. 2024-06-02T22:52:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.209+0000 7f3c0f817740 1 -- start start 2024-06-02T22:52:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.210+0000 7f3c0f817740 1 Processor -- start 2024-06-02T22:52:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.210+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c05400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79146310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081ba7a0 con 0x55bd79138780 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081ba0d0 con 0x55bd7913d8f0 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081b7310 con 0x55bd79137d90 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c05400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:41394/0 (socket says 172.21.15.31:41394) 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c05400640 1 -- 172.21.15.31:0/3810304144 learned_addr learned my addr 172.21.15.31:0/3810304144 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.211+0000 7f3c0f817740 10 client.0 _ll_register_callbacks cb 0x7f3c00005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.213+0000 7f3c05400640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.213+0000 7f3c05400640 1 -- 172.21.15.31:0/3810304144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 msgr2=0x55bd79146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.213+0000 7f3c05400640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.214+0000 7f3c05400640 1 -- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 msgr2=0x55bd79145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.214+0000 7f3c05400640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.215+0000 7f3c05400640 1 -- 172.21.15.31:0/3810304144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd79146900 con 0x55bd79137d90 2024-06-02T22:52:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.218+0000 7f3c05400640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4004650 tx=0x7f3bf4009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52aeccb7d94ab099 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.218+0000 7f3be7400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:52:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.218+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4045040 con 0x55bd79137d90 2024-06-02T22:52:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.219+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3bf4032040 con 0x55bd79137d90 2024-06-02T22:52:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.219+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf8027070 con 0x55bd79137d90 2024-06-02T22:52:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.220+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3bf4032240 con 0x55bd79137d90 2024-06-02T22:52:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.220+0000 7f3c0f817740 10 client.26239 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.220+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bd791b7ef0 con 0x55bd79137d90 2024-06-02T22:52:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.220+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf8027070 con 0x55bd79137d90 2024-06-02T22:52:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.221+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3bf4052040 con 0x55bd79137d90 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.222+0000 7f3c0f817740 10 client.26239 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.222+0000 7f3c0f817740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.222+0000 7f3c0f817740 20 client.26239 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.223+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd791b87f0 0x55bd791bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.223+0000 7f3c0f817740 4 client.26239 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:52:03.222 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.223+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bd790a2ea0 con 0x55bd791b87f0 2024-06-02T22:52:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.223+0000 7f3c05e00640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd791b87f0 0x55bd791bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.225+0000 7f3be7400640 10 client.26239 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.225+0000 7f3c05e00640 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd791b87f0 0x55bd791bac10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ddf1ab12d27a0a3 server_cookie=9e34fc0ad84cea01 in_seq=0 out_seq=0 2024-06-02T22:52:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3be7400640 1 -- 172.21.15.31:0/3810304144 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bd790a2ea0 con 0x55bd791b87f0 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3be7400640 10 client.26239 handle_command_reply: tid=0 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 client.26239 shutdown 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 msgr2=0x55bd791492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4004650 tx=0x7f3bf4009560 comp rx=0 tx=0).stop 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 shutdown_connections 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55bd791b87f0 0x55bd791bac10 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bd7913d8f0 0x55bd79146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bd79138780 0x55bd79145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 --2- 172.21.15.31:0/3810304144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bd79137d90 0x55bd791492e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 >> 172.21.15.31:0/3810304144 conn(0x55bd790fff80 msgr2=0x55bd79141ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3be7400640 0 client.26239 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 shutdown_connections 2024-06-02T22:52:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.256+0000 7f3c0f817740 1 -- 172.21.15.31:0/3810304144 wait complete. 2024-06-02T22:52:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c0f817740 20 client.26239 trim_cache size 0 max 16384 2024-06-02T22:52:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:52:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:52:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 msgr2=0x7f3bec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 0x7f3bec0a50c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c00097ca0 tx=0x7f3c00005750 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 msgr2=0x7f3c081ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c081ae420 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000e970 tx=0x7f3c0000ee30 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 shutdown_connections 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3bec0a2c00 0x7f3bec0a50c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08103410 0x7f3c081ae420 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c08102a50 0x7f3c08195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 --2- 172.21.15.31:0/3335591074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c08101860 0x7f3c08195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.257+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 >> 172.21.15.31:0/3335591074 conn(0x7f3c080fcdd0 msgr2=0x7f3c08073bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.258+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 shutdown_connections 2024-06-02T22:52:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:03.258+0000 7f3c07200640 1 -- 172.21.15.31:0/3335591074 wait complete. 2024-06-02T22:52:04.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:04 smithi098 ceph-mon[36750]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:52:04.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:04 smithi178 ceph-mon[36614]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:52:04.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:04 smithi031 ceph-mon[31767]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.0 MiB/s wr, 477 op/s 2024-06-02T22:52:05.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 880.0 s, 418.4 tps, lat 229.843 ms stddev 325.705 2024-06-02T22:52:06.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:06 smithi098 ceph-mon[36750]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-06-02T22:52:06.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:06 smithi178 ceph-mon[36614]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-06-02T22:52:06.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:06 smithi031 ceph-mon[31767]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 470 op/s 2024-06-02T22:52:07.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:07 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:52:07.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:07 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:52:07.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:07 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:52:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:08 smithi098 ceph-mon[36750]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 447 op/s 2024-06-02T22:52:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:52:08.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:52:08.713 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:08 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:52:08.773 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:08 smithi031 ceph-mon[31767]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 447 op/s 2024-06-02T22:52:08.773 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:52:08.773 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:52:08.773 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:08 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:52:08.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:08 smithi178 ceph-mon[36614]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.0 MiB/s wr, 447 op/s 2024-06-02T22:52:08.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:52:08.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:52:08.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:08 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:52:09.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:09 smithi098 ceph-mon[36750]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 505 op/s 2024-06-02T22:52:09.811 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:09 smithi178 ceph-mon[36614]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 505 op/s 2024-06-02T22:52:09.873 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:09 smithi031 ceph-mon[31767]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 505 op/s 2024-06-02T22:52:10.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 885.0 s, 425.4 tps, lat 245.105 ms stddev 275.045 2024-06-02T22:52:12.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:11 smithi098 ceph-mon[36750]: pgmap v967: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-06-02T22:52:12.314 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:11 smithi178 ceph-mon[36614]: pgmap v967: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-06-02T22:52:12.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:11 smithi031 ceph-mon[31767]: pgmap v967: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.6 MiB/s wr, 511 op/s 2024-06-02T22:52:14.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:13 smithi098 ceph-mon[36750]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-06-02T22:52:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:13 smithi178 ceph-mon[36614]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-06-02T22:52:14.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:13 smithi031 ceph-mon[31767]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-06-02T22:52:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 890.0 s, 446.0 tps, lat 216.361 ms stddev 263.808 2024-06-02T22:52:16.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:15 smithi098 ceph-mon[36750]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2024-06-02T22:52:16.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:15 smithi178 ceph-mon[36614]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2024-06-02T22:52:16.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:15 smithi031 ceph-mon[31767]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 453 op/s 2024-06-02T22:52:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.449+0000 7efe43200640 1 -- 172.21.15.31:0/2990741412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe44100a50 msgr2=0x7efe44100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.449+0000 7efe43200640 1 --2- 172.21.15.31:0/2990741412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe44100a50 0x7efe44100eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efe30009860 tx=0x7efe3002a340 comp rx=0 tx=0).stop 2024-06-02T22:52:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 -- 172.21.15.31:0/2990741412 shutdown_connections 2024-06-02T22:52:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 --2- 172.21.15.31:0/2990741412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe441013f0 0x7efe44101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 --2- 172.21.15.31:0/2990741412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe44100a50 0x7efe44100eb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.450 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 --2- 172.21.15.31:0/2990741412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 -- 172.21.15.31:0/2990741412 >> 172.21.15.31:0/2990741412 conn(0x7efe440fbc90 msgr2=0x7efe440fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 -- 172.21.15.31:0/2990741412 shutdown_connections 2024-06-02T22:52:16.451 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.450+0000 7efe43200640 1 -- 172.21.15.31:0/2990741412 wait complete. 2024-06-02T22:52:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 Processor -- start 2024-06-02T22:52:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 -- start start 2024-06-02T22:52:16.453 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 0x7efe4419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe441013f0 0x7efe441a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe4410f660 con 0x7efe441013f0 2024-06-02T22:52:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efe4410f4e0 con 0x7efe441000f0 2024-06-02T22:52:16.454 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.453+0000 7efe43200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe4410f7e0 con 0x7efe44100a50 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 0x7efe4419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57422/0 (socket says 172.21.15.31:57422) 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 -- 172.21.15.31:0/1894528936 learned_addr learned my addr 172.21.15.31:0/1894528936 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 0x7efe4419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:44220/0 (socket says 172.21.15.31:44220) 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe42800640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe441013f0 0x7efe441a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 -- 172.21.15.31:0/1894528936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 msgr2=0x7efe4419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 0x7efe4419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 -- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe441013f0 msgr2=0x7efe441a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe441013f0 0x7efe441a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.454+0000 7efe41e00640 1 -- 172.21.15.31:0/1894528936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe441a18e0 con 0x7efe441000f0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.455+0000 7efe41e00640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d950 tx=0x7efe3400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.455+0000 7efe3aa00640 1 -- 172.21.15.31:0/1894528936 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34017030 con 0x7efe441000f0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.455+0000 7efe3aa00640 1 -- 172.21.15.31:0/1894528936 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe34004020 con 0x7efe441000f0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.455+0000 7efe3aa00640 1 -- 172.21.15.31:0/1894528936 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003d80 con 0x7efe441000f0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.455+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe441a1bd0 con 0x7efe441000f0 2024-06-02T22:52:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.456+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe441a20f0 con 0x7efe441000f0 2024-06-02T22:52:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.461+0000 7efe4bdcb740 1 Processor -- start 2024-06-02T22:52:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.461+0000 7efe4bdcb740 1 -- start start 2024-06-02T22:52:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efb3106420 con 0x55efb31b4790 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efb30adc50 con 0x55efb31b3da0 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55efb31023e0 con 0x55efb31b9900 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe41400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe41400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:44236/0 (socket says 172.21.15.31:44236) 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe42800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.462+0000 7efe41400640 1 -- 172.21.15.31:0/777795750 learned_addr learned my addr 172.21.15.31:0/777795750 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 -- 172.21.15.31:0/777795750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 msgr2=0x55efb31b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 -- 172.21.15.31:0/777795750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 msgr2=0x55efb31b9290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:52:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 -- 172.21.15.31:0/777795750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb2e1a210 con 0x55efb31b9900 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe41400640 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe30009780 tx=0x7efe30005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcdee4672785986 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe2f400640 1 -- 172.21.15.31:0/777795750 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30030650 con 0x55efb31b9900 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe2f400640 1 -- 172.21.15.31:0/777795750 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe30063070 con 0x55efb31b9900 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.463+0000 7efe2f400640 1 -- 172.21.15.31:0/777795750 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300046c0 con 0x55efb31b9900 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.464+0000 7efe3aa00640 1 -- 172.21.15.31:0/1894528936 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7efe3401a070 con 0x7efe441000f0 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.464+0000 7efe4bdcb740 1 -- 172.21.15.31:0/777795750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 msgr2=0x55efb31bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.464+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe30009780 tx=0x7efe30005dc0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.465+0000 7efe4bdcb740 1 -- 172.21.15.31:0/777795750 shutdown_connections 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.465+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31bbd90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.465+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.465+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/777795750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.465+0000 7efe4bdcb740 1 -- 172.21.15.31:0/777795750 >> 172.21.15.31:0/777795750 conn(0x55efb316af80 msgr2=0x55efb319e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.467+0000 7efe3aa00640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 0x7efe280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.467+0000 7efe3aa00640 1 -- 172.21.15.31:0/1894528936 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efe340ce8a0 con 0x7efe441000f0 2024-06-02T22:52:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.468+0000 7efe4bdcb740 1 -- 172.21.15.31:0/777795750 shutdown_connections 2024-06-02T22:52:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.468+0000 7efe4bdcb740 1 -- 172.21.15.31:0/777795750 wait complete. 2024-06-02T22:52:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.469+0000 7efe4bdcb740 1 -- start start 2024-06-02T22:52:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.469+0000 7efe4bdcb740 1 Processor -- start 2024-06-02T22:52:16.470 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.469+0000 7efe41400640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 0x7efe280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.472 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55efb31a2c90 con 0x55efb31b4790 2024-06-02T22:52:16.473 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efb30c10b0 con 0x55efb31b3da0 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55efb31a2e10 con 0x55efb31b9900 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe42800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe42800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:44248/0 (socket says 172.21.15.31:44248) 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe42800640 1 -- 172.21.15.31:0/1604268177 learned_addr learned my addr 172.21.15.31:0/1604268177 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.470+0000 7efe4bdcb740 10 client.0 _ll_register_callbacks cb 0x55efb30acf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.471+0000 7efe42800640 1 -- 172.21.15.31:0/1604268177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 msgr2=0x55efb31a45a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.471+0000 7efe42800640 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31a45a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.471+0000 7efe42800640 1 -- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 msgr2=0x55efb31a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.471+0000 7efe42800640 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.471+0000 7efe42800640 1 -- 172.21.15.31:0/1604268177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb2ee6620 con 0x55efb31b9900 2024-06-02T22:52:16.474 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe42800640 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe3c007ea0 tx=0x7efe3c007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45dc72c200ae383 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe23e00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe41400640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 0x7efe280a50c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe30006010 tx=0x7efe30005120 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c014070 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efe3c0109c0 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe30063070 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe3c010bc0 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.472+0000 7efe4bdcb740 10 client.26248 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55efb31aef60 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe30063070 con 0x55efb31b9900 2024-06-02T22:52:16.475 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7efe3c00f6c0 con 0x55efb31b9900 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe4bdcb740 10 client.26248 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe4bdcb740 10 client.26248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe4bdcb740 20 client.26248 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.473+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb31b0ae0 0x55efb31b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.474+0000 7efe4bdcb740 4 client.26248 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.474+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efb3113b50 con 0x55efb31b0ae0 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.474+0000 7efe41e00640 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb31b0ae0 0x55efb31b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.475+0000 7efe41e00640 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb31b0ae0 0x55efb31b2f80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7465f9a7d4781f0 server_cookie=8a2ba8b5c7f5fe3c in_seq=0 out_seq=0 2024-06-02T22:52:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.475+0000 7efe23e00640 10 client.26248 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.477+0000 7efe23e00640 1 -- 172.21.15.31:0/1604268177 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55efb3113b50 con 0x55efb31b0ae0 2024-06-02T22:52:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.477+0000 7efe23e00640 10 client.26248 handle_command_reply: tid=0 2024-06-02T22:52:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.478+0000 7efe4bdcb740 1 client.26248 shutdown 2024-06-02T22:52:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.479+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 msgr2=0x55efb31abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.479 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.479+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe3c007ea0 tx=0x7efe3c007f90 comp rx=0 tx=0).stop 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.479+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 shutdown_connections 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.479+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb31b0ae0 0x55efb31b2f80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.480+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b9900 0x55efb31abb20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.480+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.480+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/1604268177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b3da0 0x55efb31a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.480+0000 7efe23e00640 0 client.26248 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:16.480 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.480+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 >> 172.21.15.31:0/1604268177 conn(0x55efb316af80 msgr2=0x55efb319d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.481+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 shutdown_connections 2024-06-02T22:52:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.481+0000 7efe4bdcb740 1 -- 172.21.15.31:0/1604268177 wait complete. 2024-06-02T22:52:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.481+0000 7efe4bdcb740 20 client.26248 trim_cache size 0 max 16384 2024-06-02T22:52:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.521+0000 7efe4bdcb740 1 Processor -- start 2024-06-02T22:52:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.521+0000 7efe4bdcb740 1 -- start start 2024-06-02T22:52:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.521+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.521+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.521+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe44071230 con 0x55efb31b4790 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efe44072d70 con 0x55efb31b9900 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe44071900 con 0x55efb31b3da0 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe41400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe42800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe42800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57440/0 (socket says 172.21.15.31:57440) 2024-06-02T22:52:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.522+0000 7efe42800640 1 -- 172.21.15.31:0/2653627646 learned_addr learned my addr 172.21.15.31:0/2653627646 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.523+0000 7efe42800640 1 -- 172.21.15.31:0/2653627646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 msgr2=0x55efb31abae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.523+0000 7efe42800640 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31abae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.523+0000 7efe42800640 1 -- 172.21.15.31:0/2653627646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 msgr2=0x55efb31b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.523+0000 7efe42800640 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.524 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.523+0000 7efe42800640 1 -- 172.21.15.31:0/2653627646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb319f4c0 con 0x55efb31b9900 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.524+0000 7efe42800640 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efe3c000f80 tx=0x7efe3c018fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf8e5f4b59ee93b7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.524+0000 7efe2ea00640 1 -- 172.21.15.31:0/2653627646 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c014040 con 0x55efb31b9900 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.524+0000 7efe2ea00640 1 -- 172.21.15.31:0/2653627646 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe3c00fdd0 con 0x55efb31b9900 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.524+0000 7efe2ea00640 1 -- 172.21.15.31:0/2653627646 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c00f820 con 0x55efb31b9900 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.525+0000 7efe4bdcb740 1 -- 172.21.15.31:0/2653627646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 msgr2=0x55efb31a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.525+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efe3c000f80 tx=0x7efe3c018fa0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 -- 172.21.15.31:0/2653627646 shutdown_connections 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b9900 0x55efb31a45a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b4790 0x55efb31b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/2653627646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 -- 172.21.15.31:0/2653627646 >> 172.21.15.31:0/2653627646 conn(0x55efb316af80 msgr2=0x55efb319e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 -- 172.21.15.31:0/2653627646 shutdown_connections 2024-06-02T22:52:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.526+0000 7efe4bdcb740 1 -- 172.21.15.31:0/2653627646 wait complete. 2024-06-02T22:52:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.527+0000 7efe4bdcb740 1 -- start start 2024-06-02T22:52:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.527+0000 7efe4bdcb740 1 Processor -- start 2024-06-02T22:52:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.527+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.527+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe4bdcb740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b9900 0x55efb31c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe440726a0 con 0x55efb31b9900 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efe44071fd0 con 0x55efb31b4790 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe4bdcb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe4406f210 con 0x55efb31b3da0 2024-06-02T22:52:16.528 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe4bdcb740 10 client.0 _ll_register_callbacks cb 0x7efe3c017bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:57454/0 (socket says 172.21.15.31:57454) 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 -- 172.21.15.31:0/803617831 learned_addr learned my addr 172.21.15.31:0/803617831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 -- 172.21.15.31:0/803617831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 msgr2=0x55efb31c0a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41e00640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.528+0000 7efe41400640 1 -- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b9900 msgr2=0x55efb31c14c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T22:52:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe42800640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b9900 0x55efb31c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe41400640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b9900 0x55efb31c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe41400640 1 -- 172.21.15.31:0/803617831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb3222900 con 0x55efb31b4790 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe41400640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efe30009780 tx=0x7efe30005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b13a2efa00fafde server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe41e00640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.529+0000 7efe23e00640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.530+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30078070 con 0x55efb31b4790 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.530+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7efe30004450 con 0x55efb31b4790 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.530+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe3c00fdd0 con 0x55efb31b4790 2024-06-02T22:52:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.531+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efe300035f0 con 0x55efb31b4790 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.531+0000 7efe4bdcb740 10 client.26255 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.531+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55efb3223c90 con 0x55efb31b4790 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.531+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe3c00fdd0 con 0x55efb31b4790 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.531+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7efe30004aa0 con 0x55efb31b4790 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 10 client.26255 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 10 client.26255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 20 client.26255 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb32242d0 0x55efb32266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 4 client.26255 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:52:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55efb310dea0 con 0x55efb32242d0 2024-06-02T22:52:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.532+0000 7efe41e00640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb32242d0 0x55efb32266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.533+0000 7efe41e00640 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb32242d0 0x55efb32266c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=391e2ade72a8fdb4 server_cookie=99045457f26bd1f0 in_seq=0 out_seq=0 2024-06-02T22:52:16.533 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.533+0000 7efe23e00640 10 client.26255 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.926+0000 7efe23e00640 1 -- 172.21.15.31:0/803617831 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55efb310dea0 con 0x55efb32242d0 2024-06-02T22:52:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.926+0000 7efe23e00640 10 client.26255 handle_command_reply: tid=0 2024-06-02T22:52:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.926+0000 7efe4bdcb740 1 client.26255 shutdown 2024-06-02T22:52:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 msgr2=0x55efb31c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efe30009780 tx=0x7efe30005dc0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 shutdown_connections 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x55efb32242d0 0x55efb32266c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55efb31b9900 0x55efb31c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efb31b4790 0x55efb31c0f80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 --2- 172.21.15.31:0/803617831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55efb31b3da0 0x55efb31c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 >> 172.21.15.31:0/803617831 conn(0x55efb316af80 msgr2=0x55efb319e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe23e00640 0 client.26255 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 shutdown_connections 2024-06-02T22:52:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.927+0000 7efe4bdcb740 1 -- 172.21.15.31:0/803617831 wait complete. 2024-06-02T22:52:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.928+0000 7efe4bdcb740 20 client.26255 trim_cache size 0 max 16384 2024-06-02T22:52:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:52:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:52:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 msgr2=0x7efe280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 0x7efe280a50c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe30006010 tx=0x7efe30005120 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 msgr2=0x7efe44199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efe3400d950 tx=0x7efe3400de10 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 shutdown_connections 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7efe280a2c00 0x7efe280a50c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe441013f0 0x7efe441a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe44100a50 0x7efe4419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 --2- 172.21.15.31:0/1894528936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efe441000f0 0x7efe44199ca0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 >> 172.21.15.31:0/1894528936 conn(0x7efe440fbc90 msgr2=0x7efe440fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 shutdown_connections 2024-06-02T22:52:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:16.929+0000 7efe43200640 1 -- 172.21.15.31:0/1894528936 wait complete. 2024-06-02T22:52:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:17 smithi098 ceph-mon[36750]: pgmap v970: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-06-02T22:52:18.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:17 smithi178 ceph-mon[36614]: pgmap v970: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-06-02T22:52:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:17 smithi031 ceph-mon[31767]: pgmap v970: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-06-02T22:52:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:19 smithi098 ceph-mon[36750]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-06-02T22:52:20.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 895.0 s, 443.2 tps, lat 221.265 ms stddev 295.883 2024-06-02T22:52:20.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:19 smithi178 ceph-mon[36614]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-06-02T22:52:20.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:19 smithi031 ceph-mon[31767]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 507 op/s 2024-06-02T22:52:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:21 smithi098 ceph-mon[36750]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 509 op/s 2024-06-02T22:52:22.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:21 smithi178 ceph-mon[36614]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 509 op/s 2024-06-02T22:52:22.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:21 smithi031 ceph-mon[31767]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.1 MiB/s wr, 509 op/s 2024-06-02T22:52:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:23 smithi098 ceph-mon[36750]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 506 op/s 2024-06-02T22:52:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:23 smithi178 ceph-mon[36614]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 506 op/s 2024-06-02T22:52:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:23 smithi031 ceph-mon[31767]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.4 MiB/s wr, 506 op/s 2024-06-02T22:52:25.222 INFO:teuthology.orchestra.run.smithi031.stderr:progress: 900.0 s, 460.2 tps, lat 223.125 ms stddev 291.287 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi031.stdout:transaction type: 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi031.stdout:scaling factor: 32 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi031.stdout:query mode: simple 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi031.stdout:number of clients: 100 2024-06-02T22:52:25.564 INFO:teuthology.orchestra.run.smithi031.stdout:number of threads: 4 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:duration: 900 s 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:number of transactions actually processed: 767253 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:latency average = 117.282 ms 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:latency stddev = 175.557 ms 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:tps = 852.179562 (including connections establishing) 2024-06-02T22:52:25.565 INFO:teuthology.orchestra.run.smithi031.stdout:tps = 852.186204 (excluding connections establishing) 2024-06-02T22:52:25.624 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-06-02T22:52:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:25 smithi098 ceph-mon[36750]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2024-06-02T22:52:26.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:25 smithi178 ceph-mon[36614]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2024-06-02T22:52:26.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:25 smithi031 ceph-mon[31767]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 432 op/s 2024-06-02T22:52:28.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:27 smithi098 ceph-mon[36750]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 476 op/s 2024-06-02T22:52:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:27 smithi178 ceph-mon[36614]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 476 op/s 2024-06-02T22:52:28.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:27 smithi031 ceph-mon[31767]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 476 op/s 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.154+0000 7f3d7f200640 1 -- 172.21.15.31:0/944724848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80108fb0 msgr2=0x7f3d80109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.154+0000 7f3d7f200640 1 --2- 172.21.15.31:0/944724848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80108fb0 0x7f3d80109430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 -- 172.21.15.31:0/944724848 shutdown_connections 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 --2- 172.21.15.31:0/944724848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d8010a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 --2- 172.21.15.31:0/944724848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80108fb0 0x7f3d80109430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.155 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 --2- 172.21.15.31:0/944724848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80072cd0 0x7f3d800730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 -- 172.21.15.31:0/944724848 >> 172.21.15.31:0/944724848 conn(0x7f3d8006e840 msgr2=0x7f3d80070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 -- 172.21.15.31:0/944724848 shutdown_connections 2024-06-02T22:52:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.155+0000 7f3d7f200640 1 -- 172.21.15.31:0/944724848 wait complete. 2024-06-02T22:52:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.157+0000 7f3d7f200640 1 Processor -- start 2024-06-02T22:52:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.157+0000 7f3d7f200640 1 -- start start 2024-06-02T22:52:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80072cd0 0x7f3d8010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.158 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d80115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80117f20 con 0x7f3d80109970 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80117da0 con 0x7f3d80072cd0 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801180a0 con 0x7f3d80108fb0 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:33194/0 (socket says 172.21.15.31:33194) 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7d400640 1 -- 172.21.15.31:0/3393495072 learned_addr learned my addr 172.21.15.31:0/3393495072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.158+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d80115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 -- 172.21.15.31:0/3393495072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80072cd0 msgr2=0x7f3d8010e4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T22:52:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80072cd0 0x7f3d8010e4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 -- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 msgr2=0x7f3d80115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d80115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 -- 172.21.15.31:0/3393495072 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d801b6de0 con 0x7f3d80108fb0 2024-06-02T22:52:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d80115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.159+0000 7f3d7d400640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c031530 tx=0x7f3d6c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.160+0000 7f3d76a00640 1 -- 172.21.15.31:0/3393495072 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c03f070 con 0x7f3d80108fb0 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.160+0000 7f3d76a00640 1 -- 172.21.15.31:0/3393495072 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6c031cc0 con 0x7f3d80108fb0 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.160+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d801b7070 con 0x7f3d80108fb0 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.160+0000 7f3d76a00640 1 -- 172.21.15.31:0/3393495072 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c035030 con 0x7f3d80108fb0 2024-06-02T22:52:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.161+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d801b7560 con 0x7f3d80108fb0 2024-06-02T22:52:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.165+0000 7f3d76a00640 1 -- 172.21.15.31:0/3393495072 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f3d6c042070 con 0x7f3d80108fb0 2024-06-02T22:52:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.165+0000 7f3d877da740 1 Processor -- start 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.168+0000 7f3d877da740 1 -- start start 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedde1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dede5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5606ded41420 con 0x5606dedddd90 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5606dece8c50 con 0x5606dedde780 2024-06-02T22:52:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d877da740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5606ded3d3e0 con 0x5606dede38f0 2024-06-02T22:52:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d7de00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46882/0 (socket says 172.21.15.31:46882) 2024-06-02T22:52:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d7de00640 1 -- 172.21.15.31:0/3957371899 learned_addr learned my addr 172.21.15.31:0/3957371899 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.169+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedde1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.170+0000 7f3d7d400640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dede5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.170+0000 7f3d7e800640 1 -- 172.21.15.31:0/3957371899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 msgr2=0x5606dede5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dede5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d7e800640 1 -- 172.21.15.31:0/3957371899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 msgr2=0x5606dede3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d7e800640 1 -- 172.21.15.31:0/3957371899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dea55210 con 0x5606dedddd90 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d7d400640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dede5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.171+0000 7f3d76a00640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 0x7f3d640a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.172+0000 7f3d76a00640 1 -- 172.21.15.31:0/3393495072 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3d6c0efd90 con 0x7f3d80108fb0 2024-06-02T22:52:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.173+0000 7f3d7de00640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 0x7f3d640a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.174+0000 7f3d7e800640 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedde1b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000dba0 tx=0x7f3d7000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8a5b714af4669 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.175+0000 7f3d6b000640 1 -- 172.21.15.31:0/3957371899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000de90 con 0x5606dedddd90 2024-06-02T22:52:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.175+0000 7f3d6b000640 1 -- 172.21.15.31:0/3957371899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d700035f0 con 0x5606dedddd90 2024-06-02T22:52:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.175+0000 7f3d6b000640 1 -- 172.21.15.31:0/3957371899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70011680 con 0x5606dedddd90 2024-06-02T22:52:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.176+0000 7f3d877da740 1 -- 172.21.15.31:0/3957371899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 msgr2=0x5606dedde1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.176+0000 7f3d7de00640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 0x7f3d640a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5606deddeb80 tx=0x7f3d780097a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.176+0000 7f3d877da740 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedde1b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000dba0 tx=0x7f3d7000f730 comp rx=0 tx=0).stop 2024-06-02T22:52:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 -- 172.21.15.31:0/3957371899 shutdown_connections 2024-06-02T22:52:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dede5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 --2- 172.21.15.31:0/3957371899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedde1b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 -- 172.21.15.31:0/3957371899 >> 172.21.15.31:0/3957371899 conn(0x5606deda5f80 msgr2=0x5606dedd9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 -- 172.21.15.31:0/3957371899 shutdown_connections 2024-06-02T22:52:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.177+0000 7f3d877da740 1 -- 172.21.15.31:0/3957371899 wait complete. 2024-06-02T22:52:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.178+0000 7f3d877da740 1 -- start start 2024-06-02T22:52:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.178+0000 7f3d877da740 1 Processor -- start 2024-06-02T22:52:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d877da740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d877da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d877da740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46886/0 (socket says 172.21.15.31:46886) 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d7e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d7e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:33216/0 (socket says 172.21.15.31:33216) 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.180+0000 7f3d7de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d7de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41822/0 (socket says 172.21.15.31:41822) 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d877da740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5606dede68a0 con 0x5606dedddd90 2024-06-02T22:52:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d877da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5606decfc0b0 con 0x5606dedde780 2024-06-02T22:52:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d877da740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5606dede6a20 con 0x5606dede38f0 2024-06-02T22:52:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d877da740 10 client.0 _ll_register_callbacks cb 0x5606dece7f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.181+0000 7f3d7de00640 1 -- 172.21.15.31:0/1647214891 learned_addr learned my addr 172.21.15.31:0/1647214891 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.182+0000 7f3d7de00640 1 -- 172.21.15.31:0/1647214891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 msgr2=0x5606dedef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7de00640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7de00640 1 -- 172.21.15.31:0/1647214891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 msgr2=0x5606dede8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7de00640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7de00640 1 -- 172.21.15.31:0/1647214891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606deb21620 con 0x5606dedddd90 2024-06-02T22:52:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7e800640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.183+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.184+0000 7f3d7de00640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005c10 tx=0x7f3d78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243a29fcbc4d00f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.184+0000 7f3d5f400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-06-02T22:52:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.185+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7801cb50 con 0x5606dedddd90 2024-06-02T22:52:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.186+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3d7801ccf0 con 0x5606dedddd90 2024-06-02T22:52:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.186+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d700035f0 con 0x5606dedddd90 2024-06-02T22:52:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.187+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d7802b480 con 0x5606dedddd90 2024-06-02T22:52:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.187+0000 7f3d877da740 10 client.15834 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.187+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606dedf2ab0 con 0x5606dedddd90 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d700035f0 con 0x5606dedddd90 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3d7801e420 con 0x5606dedddd90 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 10 client.15834 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 20 client.15834 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dedf4180 0x5606dedf65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 4 client.15834 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.188+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606ded4eb50 con 0x5606dedf4180 2024-06-02T22:52:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.189+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dedf4180 0x5606dedf65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.190+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dedf4180 0x5606dedf65b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf1e567bc52a182 server_cookie=6e604da3af92d539 in_seq=0 out_seq=0 2024-06-02T22:52:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.191+0000 7f3d5f400640 10 client.15834 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.192+0000 7f3d5f400640 1 -- 172.21.15.31:0/1647214891 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5606ded4eb50 con 0x5606dedf4180 2024-06-02T22:52:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.192+0000 7f3d5f400640 10 client.15834 handle_command_reply: tid=0 2024-06-02T22:52:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.192+0000 7f3d877da740 1 client.15834 shutdown 2024-06-02T22:52:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.194+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 msgr2=0x5606dede80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.194+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005c10 tx=0x7f3d78004ab0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 shutdown_connections 2024-06-02T22:52:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dedf4180 0x5606dedf65b0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dedef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dede8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 --2- 172.21.15.31:0/1647214891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede80f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d5f400640 0 client.15834 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 >> 172.21.15.31:0/1647214891 conn(0x5606deda5f80 msgr2=0x5606dedd8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 shutdown_connections 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 1 -- 172.21.15.31:0/1647214891 wait complete. 2024-06-02T22:52:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.195+0000 7f3d877da740 20 client.15834 trim_cache size 0 max 16384 2024-06-02T22:52:30.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:29 smithi098 ceph-mon[36750]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 527 op/s 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 Processor -- start 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 -- start start 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 0x5606dede8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801c1af0 con 0x5606dedddd90 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801c3630 con 0x5606dede38f0 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.238+0000 7f3d877da740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801c21c0 con 0x5606dedde780 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:33218/0 (socket says 172.21.15.31:33218) 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 -- 172.21.15.31:0/2419898379 learned_addr learned my addr 172.21.15.31:0/2419898379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7de00640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7e800640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 0x5606dede8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 -- 172.21.15.31:0/2419898379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 msgr2=0x5606dede8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 0x5606dede8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 -- 172.21.15.31:0/2419898379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 msgr2=0x5606dede7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.239+0000 7f3d7d400640 1 -- 172.21.15.31:0/2419898379 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606dedda4c0 con 0x5606dedde780 2024-06-02T22:52:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.240+0000 7f3d7e800640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 0x5606dede8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.241+0000 7f3d7d400640 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c005ec0 tx=0x7f3d6c0ed370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857ec24c7413a417 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.241+0000 7f3d6a600640 1 -- 172.21.15.31:0/2419898379 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c049040 con 0x5606dedde780 2024-06-02T22:52:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.242+0000 7f3d6a600640 1 -- 172.21.15.31:0/2419898379 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6c0bc900 con 0x5606dedde780 2024-06-02T22:52:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.242+0000 7f3d6a600640 1 -- 172.21.15.31:0/2419898379 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0c4e70 con 0x5606dedde780 2024-06-02T22:52:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 -- 172.21.15.31:0/2419898379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 msgr2=0x5606dedef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c005ec0 tx=0x7f3d6c0ed370 comp rx=0 tx=0).stop 2024-06-02T22:52:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 -- 172.21.15.31:0/2419898379 shutdown_connections 2024-06-02T22:52:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dede38f0 0x5606dede8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dedde780 0x5606dedef630 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.244+0000 7f3d877da740 1 --2- 172.21.15.31:0/2419898379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dede7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.245+0000 7f3d877da740 1 -- 172.21.15.31:0/2419898379 >> 172.21.15.31:0/2419898379 conn(0x5606deda5f80 msgr2=0x5606dede30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.248+0000 7f3d877da740 1 -- 172.21.15.31:0/2419898379 shutdown_connections 2024-06-02T22:52:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.248+0000 7f3d877da740 1 -- 172.21.15.31:0/2419898379 wait complete. 2024-06-02T22:52:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.249+0000 7f3d877da740 1 -- start start 2024-06-02T22:52:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.249+0000 7f3d877da740 1 Processor -- start 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dee5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801c2f60 con 0x5606dedddd90 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801c2890 con 0x5606dedde780 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d801bfad0 con 0x5606dede38f0 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d877da740 10 client.0 _ll_register_callbacks cb 0x7f3d78009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d7d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:46898/0 (socket says 172.21.15.31:46898) 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d7d400640 1 -- 172.21.15.31:0/1787400004 learned_addr learned my addr 172.21.15.31:0/1787400004 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.250+0000 7f3d7e800640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dee5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.251+0000 7f3d7d400640 1 -- 172.21.15.31:0/1787400004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 msgr2=0x5606dee5ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.251+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dee5ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.251+0000 7f3d7d400640 1 -- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 msgr2=0x5606dedec210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.251+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.251+0000 7f3d7d400640 1 -- 172.21.15.31:0/1787400004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606dedef820 con 0x5606dedde780 2024-06-02T22:52:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.252+0000 7f3d5f400640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-06-02T22:52:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.254+0000 7f3d7d400640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c5030 tx=0x7f3d6c02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79acf1a2abce4a0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.254+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c049040 con 0x5606dedde780 2024-06-02T22:52:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.254+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6c0bc900 con 0x5606dedde780 2024-06-02T22:52:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.254+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mon.2 v2:172.21.15.98:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f3d6c0ba500 con 0x5606dedde780 2024-06-02T22:52:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.254+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3d6c049040 con 0x5606dedde780 2024-06-02T22:52:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 10 client.26270 fetch_fsmap learned FSMap version 30 2024-06-02T22:52:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5606dee5e3c0 con 0x5606dedde780 2024-06-02T22:52:30.255 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mon.2 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6c0bc900 con 0x5606dedde780 2024-06-02T22:52:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mon.2 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3d6c0f5070 con 0x5606dedde780 2024-06-02T22:52:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 10 client.26270 fetch_fsmap finished waiting for FSMap version 30 2024-06-02T22:52:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 10 client.26270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-06-02T22:52:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 20 client.26270 populate_metadata read hostname 'smithi031' 2024-06-02T22:52:30.256 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dee5ec60 0x5606dee61080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 4 client.26270 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-02T22:52:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.255+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 --> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5606ded48ea0 con 0x5606dee5ec60 2024-06-02T22:52:30.257 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.257+0000 7f3d7de00640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dee5ec60 0x5606dee61080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.260+0000 7f3d7de00640 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dee5ec60 0x5606dee61080 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6001b874a4a6d6 server_cookie=58ddf6abc564b379 in_seq=0 out_seq=0 2024-06-02T22:52:30.260 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.260+0000 7f3d5f400640 10 client.26270 ms_handle_connect on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:29 smithi178 ceph-mon[36614]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 527 op/s 2024-06-02T22:52:30.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:29 smithi031 ceph-mon[31767]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 527 op/s 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d5f400640 1 -- 172.21.15.31:0/1787400004 <== mds.0 v2:172.21.15.31:6840/3282614730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5606ded48ea0 con 0x5606dee5ec60 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d5f400640 10 client.26270 handle_command_reply: tid=0 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 client.26270 shutdown 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 msgr2=0x5606dedec750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c5030 tx=0x7f3d6c02a3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 shutdown_connections 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:6840/3282614730,v1:172.21.15.31:6841/3282614730] conn(0x5606dee5ec60 0x5606dee61080 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5606dede38f0 0x5606dee5ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5606dedde780 0x5606dedec750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.724 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 --2- 172.21.15.31:0/1787400004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5606dedddd90 0x5606dedec210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d5f400640 0 client.26270 ms_handle_reset on v2:172.21.15.31:6840/3282614730 2024-06-02T22:52:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.723+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 >> 172.21.15.31:0/1787400004 conn(0x5606deda5f80 msgr2=0x5606deddc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.724+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 shutdown_connections 2024-06-02T22:52:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.724+0000 7f3d877da740 1 -- 172.21.15.31:0/1787400004 wait complete. 2024-06-02T22:52:30.725 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.724+0000 7f3d877da740 20 client.26270 trim_cache size 0 max 16384 2024-06-02T22:52:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:{ 2024-06-02T22:52:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout: "return_code": 0 2024-06-02T22:52:30.726 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stdout:} 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 msgr2=0x7f3d640a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 0x7f3d640a50c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5606deddeb80 tx=0x7f3d780097a0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 msgr2=0x7f3d8010e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c031530 tx=0x7f3d6c003c10 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 shutdown_connections 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f3d640a2c00 0x7f3d640a50c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d80109970 0x7f3d80115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d80108fb0 0x7f3d8010e9f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 --2- 172.21.15.31:0/3393495072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d80072cd0 0x7f3d8010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.725+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 >> 172.21.15.31:0/3393495072 conn(0x7f3d8006e840 msgr2=0x7f3d80070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.726+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 shutdown_connections 2024-06-02T22:52:30.727 INFO:teuthology.task.background_exec.ubuntu@smithi031.front.sepia.ceph.com.smithi031.stderr:2024-06-02T22:52:30.726+0000 7f3d7f200640 1 -- 172.21.15.31:0/3393495072 wait complete. 2024-06-02T22:52:32.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:31 smithi178 ceph-mon[36614]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-06-02T22:52:32.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:31 smithi031 ceph-mon[31767]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-06-02T22:52:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:31 smithi098 ceph-mon[36750]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 644 op/s 2024-06-02T22:52:34.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:33 smithi178 ceph-mon[36614]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 632 op/s 2024-06-02T22:52:34.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:33 smithi031 ceph-mon[31767]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 632 op/s 2024-06-02T22:52:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:33 smithi098 ceph-mon[36750]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.2 MiB/s wr, 632 op/s 2024-06-02T22:52:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:35 smithi178 ceph-mon[36614]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 702 op/s 2024-06-02T22:52:36.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:35 smithi031 ceph-mon[31767]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 702 op/s 2024-06-02T22:52:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:35 smithi098 ceph-mon[36750]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 702 op/s 2024-06-02T22:52:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:37 smithi178 ceph-mon[36614]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.5 MiB/s wr, 866 op/s 2024-06-02T22:52:38.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:37 smithi031 ceph-mon[31767]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.5 MiB/s wr, 866 op/s 2024-06-02T22:52:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:37 smithi098 ceph-mon[36750]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.5 MiB/s wr, 866 op/s 2024-06-02T22:52:40.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:39 smithi178 ceph-mon[36614]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 976 op/s 2024-06-02T22:52:40.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:39 smithi031 ceph-mon[31767]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 976 op/s 2024-06-02T22:52:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:39 smithi098 ceph-mon[36750]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.3 MiB/s wr, 976 op/s 2024-06-02T22:52:40.574 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/: 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 data 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.791 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data: 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:total 36 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 . 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 .. 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 base 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Jun 2 22:37 current_logfiles 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Jun 2 22:37 global 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:37 log 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_commit_ts 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_dynshmem 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Jun 2 22:36 pg_hba.conf 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 22:36 pg_ident.conf 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 pg_logical 2024-06-02T22:52:40.792 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 pg_multixact 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_notify 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_replslot 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_serial 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_snapshots 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 pg_stat 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:52 pg_stat_tmp 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:52 pg_subtrans 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_tblspc 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 pg_twophase 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:36 PG_VERSION 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Jun 2 22:52 pg_wal 2024-06-02T22:52:40.793 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 pg_xact 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 22:36 postgresql.auto.conf 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 Jun 2 22:36 postgresql.conf 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Jun 2 22:37 postmaster.opts 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 . 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 1 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 13493 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Jun 2 22:43 13494 2024-06-02T22:52:40.794 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 pgsql_tmp 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:total 7777 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 . 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 .. 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 112 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 113 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:52:40.795 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:37 1259 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:52:40.796 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 1417 2024-06-02T22:52:40.797 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 1418 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 174 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 175 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2187 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2224 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2328 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2336 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2337 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:52:40.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2604 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:52:40.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2611 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:52:40.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2613 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:52:40.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Jun 2 22:37 2619 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2619_fsm 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2620 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2650 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2651 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2652 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2653 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2654 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2655 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2656 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2657 2024-06-02T22:52:40.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2660 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2661 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2668 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2669 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2670 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:52:40.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2680 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2683 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2686 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2687 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:36 2688 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:36 2689 2024-06-02T22:52:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2696 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2699 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2701 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2702 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2754 2024-06-02T22:52:40.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2755 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2756 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:36 2757 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2830 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2831 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2832 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2833 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2834 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2835 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2836 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2837 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:52:40.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2995 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2996 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3118 2024-06-02T22:52:40.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3119 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3256 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3257 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3258 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3350 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3351 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3379 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3380 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3381 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:52:40.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3429 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3430 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3431 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3433 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3439 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3440 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3466 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3467 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3468 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3501 2024-06-02T22:52:40.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3502 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3503 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3534 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3542 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3574 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3575 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3576 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3596 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3597 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3598 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3599 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:52:40.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:52:40.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3606 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 3607 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3997 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4143 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4144 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4145 2024-06-02T22:52:40.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4146 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4147 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4148 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4149 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4150 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4151 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4152 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4153 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4154 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4155 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4156 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4157 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4158 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4159 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4160 2024-06-02T22:52:40.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4161 2024-06-02T22:52:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4162 2024-06-02T22:52:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4163 2024-06-02T22:52:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4164 2024-06-02T22:52:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4165 2024-06-02T22:52:40.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4166 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4167 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4168 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4169 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4170 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4171 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4172 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4173 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4174 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 5002 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 548 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 549 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6102 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6104 2024-06-02T22:52:40.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6106 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6110 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6111 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6112 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6113 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6117 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 826 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 827 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 828 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:36 pg_filenode.map 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:36 PG_VERSION 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:total 7777 2024-06-02T22:52:40.816 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Jun 2 22:37 . 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 .. 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 112 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 113 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:37 1259 2024-06-02T22:52:40.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:52:40.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1417 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1418 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 174 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 175 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2187 2024-06-02T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2224 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2328 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2336 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2337 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2604 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2611 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2613 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Jun 2 22:37 2619 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2619_fsm 2024-06-02T22:52:40.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2620 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2650 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2651 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2652 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2653 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2654 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2655 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2656 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2657 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2660 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2661 2024-06-02T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2668 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2669 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2670 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2680 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2683 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2686 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2687 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2688 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2689 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2696 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2699 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2701 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2702 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2754 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2755 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2756 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2757 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2830 2024-06-02T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2831 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2832 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2833 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2834 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2835 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2836 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2837 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:52:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2995 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2996 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3118 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3119 2024-06-02T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3256 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3257 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3258 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3350 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3351 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3379 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3380 2024-06-02T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3381 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3429 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3430 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3431 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3433 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3439 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3440 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3466 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3467 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3468 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3501 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3502 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3503 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3534 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3542 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3574 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3575 2024-06-02T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3576 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3596 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3597 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3598 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3599 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3606 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3607 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:52:40.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3997 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4143 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4144 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4145 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4146 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4147 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4148 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4149 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4150 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4151 2024-06-02T22:52:40.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4152 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4153 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4154 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4155 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4156 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4157 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4158 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4159 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4160 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4161 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4162 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4163 2024-06-02T22:52:40.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4164 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4165 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4166 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4167 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4168 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4169 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4170 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4171 2024-06-02T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4172 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4173 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4174 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 5002 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 548 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 549 2024-06-02T22:52:40.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6102 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6104 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6106 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6110 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6111 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6112 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6113 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6117 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 826 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 827 2024-06-02T22:52:40.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 828 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:37 pg_filenode.map 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 PG_VERSION 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:total 548758 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Jun 2 22:43 . 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 .. 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 112 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 113 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 1247 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1247_fsm 2024-06-02T22:52:40.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1247_vm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Jun 2 22:37 1249 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1249_fsm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1249_vm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Jun 2 22:37 1255 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1255_fsm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1255_vm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 22:52 1259 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1259_fsm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1259_vm 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Jun 2 22:37 13344 2024-06-02T22:52:40.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13344_fsm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13344_vm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13346 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13348 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13349_fsm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13349_vm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13351 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13353 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13354_fsm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13354_vm 2024-06-02T22:52:40.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13356 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13358 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 13359_fsm 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13359_vm 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 13361 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 13363 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1417 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 1418 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 440057856 Jun 2 22:52 16396 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 22:51 16396_fsm 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:45 16396_vm 2024-06-02T22:52:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 876544 Jun 2 22:52 16397 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:52 16397_fsm 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:52 16397_vm 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 540672 Jun 2 22:52 16399 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:52 16399_fsm 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:48 16399_vm 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:52 16400 2024-06-02T22:52:40.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:52 16402 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Jun 2 22:52 16404 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40083456 Jun 2 22:52 16406 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:52 16406_fsm 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:51 16406_vm 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 174 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 175 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2187 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2224 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2328 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2336 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2337 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2579 2024-06-02T22:52:40.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2600 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2600_fsm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2600_vm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2601_fsm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2601_vm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2602 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2602_fsm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2602_vm 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2603 2024-06-02T22:52:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2603_fsm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2603_vm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2604 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2605 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2605_fsm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2605_vm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2606_fsm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2606_vm 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2607 2024-06-02T22:52:40.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2607_fsm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2607_vm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Jun 2 22:37 2608 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2608_fsm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2608_vm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Jun 2 22:37 2609 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2609_fsm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2609_vm 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2610 2024-06-02T22:52:40.879 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2610_fsm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2610_vm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2611 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2612_fsm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2612_vm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2613 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2615_fsm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2615_vm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2616 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2616_fsm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2616_vm 2024-06-02T22:52:40.880 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 22:37 2617 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2617_fsm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2617_vm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 22:37 2618 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2618_fsm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2618_vm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Jun 2 22:52 2619 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:40 2619_fsm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2619_vm 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2620 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2650 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2651 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2652 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2653 2024-06-02T22:52:40.881 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2654 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2655 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2656 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2657 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 22:37 2658 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 22:37 2659 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2660 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2661 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2662 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2663 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2664 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2665 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2666 2024-06-02T22:52:40.882 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2667 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2668 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2669 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2670 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Jun 2 22:37 2673 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Jun 2 22:37 2674 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:37 2675 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2678 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2679 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2680 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2681 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2682 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2683 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2684 2024-06-02T22:52:40.883 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2685 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2686 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2687 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2688 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 22:37 2689 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 22:37 2690 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Jun 2 22:37 2691 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2692 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2693 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:41 2696 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2699 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2701 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2702 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2703 2024-06-02T22:52:40.884 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 2704 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2753 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2753_fsm 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2753_vm 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2754 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2755 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2756 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 2757 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2830 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2831 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2832 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2833 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2834 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2835 2024-06-02T22:52:40.885 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2836 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2837 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Jun 2 22:37 2838 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2838_fsm 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2838_vm 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2839 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2840_fsm 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2840_vm 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2841 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 2995 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2996 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3079_fsm 2024-06-02T22:52:40.886 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3079_vm 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3080 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3081 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3085 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3118 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3119 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 22:37 3164 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3256 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3257 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3258 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3350 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3351 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3379 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3380 2024-06-02T22:52:40.887 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3381 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3394 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3394_fsm 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3394_vm 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3395 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3429 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3430 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3431 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3433 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3439 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3440 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 22:37 3455 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Jun 2 22:37 3456 2024-06-02T22:52:40.888 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3456_fsm 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3456_vm 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3466 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3467 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3468 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3501 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3502 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3503 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3534 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3541_fsm 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3541_vm 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3542 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3574 2024-06-02T22:52:40.889 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3575 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3576 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3596 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3597 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 3598 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3599 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3600_fsm 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3600_vm 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3601_fsm 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3601_vm 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3602_fsm 2024-06-02T22:52:40.890 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3602_vm 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3603_fsm 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3603_vm 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3604 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3605 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3606 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3607 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3608 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 22:37 3609 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3712 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 3764_fsm 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3764_vm 2024-06-02T22:52:40.891 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3766 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 3767 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 3997 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4143 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4144 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4145 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4146 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4147 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4148 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4149 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4150 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4151 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4152 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4153 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4154 2024-06-02T22:52:40.892 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4155 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4156 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4157 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4158 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4159 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4160 2024-06-02T22:52:40.893 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4161 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4162 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4163 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4164 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4165 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4166 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4167 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4168 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4169 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4170 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4171 2024-06-02T22:52:40.894 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4172 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 4173 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 4174 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 5002 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 548 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 549 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6102 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6104 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 6106 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6110 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6111 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6112 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6113 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 6117 2024-06-02T22:52:40.895 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 826 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 827 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 828 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:37 pg_filenode.map 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Jun 2 22:37 pg_internal.init 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:37 PG_VERSION 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:37 . 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 22:37 .. 2024-06-02T22:52:40.896 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:total 560 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Jun 2 22:37 . 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1213 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1213_fsm 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1213_vm 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1214 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1214_fsm 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1214_vm 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 1232 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 1233 2024-06-02T22:52:40.897 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1260 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1260_fsm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1260_vm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1261 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1261_fsm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1261_vm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1262 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 1262_fsm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 1262_vm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2396 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 22:37 2396_fsm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:37 2396_vm 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2397 2024-06-02T22:52:40.898 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2671 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2672 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2676 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2677 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2694 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:37 2695 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2697 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 22:36 2698 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2846 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2847 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2964 2024-06-02T22:52:40.899 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2965 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 2966 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 2967 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 3592 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 3593 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4060 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4061 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4175 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4176 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4177 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4178 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4181 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4182 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4183 2024-06-02T22:52:40.900 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4184 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 4185 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 4186 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6000 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6001 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6002 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 6100 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6114 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 6115 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:52 pg_control 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 22:36 pg_filenode.map 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Jun 2 22:37 pg_internal.init 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T22:52:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:total 2 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:37 . 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Jun 2 22:52 postgresql-Sun.log 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.902 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:total 1 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 . 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 mappings 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 22:52 replorigin_checkpoint 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 snapshots 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 .. 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.903 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 .. 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 . 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 members 2024-06-02T22:52:40.904 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 offsets 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 .. 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:36 0000 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:total 8 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 22:36 .. 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 22:42 0000 2024-06-02T22:52:40.905 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.906 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.907 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:total 15 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 22:52 . 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.908 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Jun 2 22:52 db_0.stat 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Jun 2 22:52 db_13494.stat 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Jun 2 22:52 global.stat 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:52 . 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.909 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:total 184 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:52 . 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 188416 Jun 2 22:52 000B 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T22:52:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:total 901120 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Jun 2 22:52 . 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:52 000000010000000000000066 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000067 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 000000010000000000000068 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 000000010000000000000069 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 00000001000000000000006A 2024-06-02T22:52:40.911 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:45 00000001000000000000006B 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:46 00000001000000000000006C 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 00000001000000000000006D 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 00000001000000000000006E 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:45 00000001000000000000006F 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:44 000000010000000000000070 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:44 000000010000000000000071 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000072 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000073 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000074 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 000000010000000000000075 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000076 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:46 000000010000000000000077 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 000000010000000000000078 2024-06-02T22:52:40.912 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 000000010000000000000079 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 00000001000000000000007A 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 00000001000000000000007B 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:44 00000001000000000000007C 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:43 00000001000000000000007D 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 00000001000000000000007E 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:42 00000001000000000000007F 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000080 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 000000010000000000000081 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000082 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 000000010000000000000083 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:49 000000010000000000000084 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:49 000000010000000000000085 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000086 2024-06-02T22:52:40.913 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 000000010000000000000087 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:51 000000010000000000000088 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:50 000000010000000000000089 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 00000001000000000000008A 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:50 00000001000000000000008B 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 00000001000000000000008C 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:49 00000001000000000000008D 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 00000001000000000000008E 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 00000001000000000000008F 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000090 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:49 000000010000000000000091 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:49 000000010000000000000092 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000093 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000094 2024-06-02T22:52:40.914 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 000000010000000000000095 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000096 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:51 000000010000000000000097 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:48 000000010000000000000098 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 000000010000000000000099 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 00000001000000000000009A 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:47 00000001000000000000009B 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 22:50 00000001000000000000009C 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 archive_status 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:total 0 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 22:36 . 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Jun 2 22:52 .. 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:40.915 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T22:52:40.916 INFO:teuthology.orchestra.run.smithi031.stdout:total 192 2024-06-02T22:52:40.916 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 22:36 . 2024-06-02T22:52:40.916 INFO:teuthology.orchestra.run.smithi031.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 22:52 .. 2024-06-02T22:52:40.916 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Jun 2 22:52 0000 2024-06-02T22:52:40.917 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-02T22:52:40.929 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:52:40.956 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-02T22:52:41.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 -- 172.21.15.31:0/533015218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c104dd0 msgr2=0x7fe51c1071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 --2- 172.21.15.31:0/533015218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c104dd0 0x7fe51c1071c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe504009860 tx=0x7fe50402a340 comp rx=0 tx=0).stop 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 -- 172.21.15.31:0/533015218 shutdown_connections 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 --2- 172.21.15.31:0/533015218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c107700 0x7fe51c109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 --2- 172.21.15.31:0/533015218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c104dd0 0x7fe51c1071c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 --2- 172.21.15.31:0/533015218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 -- 172.21.15.31:0/533015218 >> 172.21.15.31:0/533015218 conn(0x7fe51c0fbe90 msgr2=0x7fe51c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 -- 172.21.15.31:0/533015218 shutdown_connections 2024-06-02T22:52:41.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.253+0000 7fe522200640 1 -- 172.21.15.31:0/533015218 wait complete. 2024-06-02T22:52:41.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 Processor -- start 2024-06-02T22:52:41.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 -- start start 2024-06-02T22:52:41.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 0x7fe51c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 0x7fe51c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c10d6b0 con 0x7fe51c104dd0 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c10d530 con 0x7fe51c1024a0 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.254+0000 7fe522200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c10d830 con 0x7fe51c107700 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 0x7fe51c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:38648/0 (socket says 172.21.15.31:38648) 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 -- 172.21.15.31:0/2095284018 learned_addr learned my addr 172.21.15.31:0/2095284018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51be00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 0x7fe51c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 -- 172.21.15.31:0/2095284018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 msgr2=0x7fe51c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 0x7fe51c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 -- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 msgr2=0x7fe51c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 0x7fe51c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 -- 172.21.15.31:0/2095284018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c19f9c0 con 0x7fe51c1024a0 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51aa00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 0x7fe51c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51be00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 0x7fe51c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.255+0000 7fe51b400640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00c420 tx=0x7fe50c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.256+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c004b20 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.256+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51c19fcb0 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.256+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe50c003e50 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.256+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00b630 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.256+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51c1a01b0 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.257+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51c0fd980 con 0x7fe51c1024a0 2024-06-02T22:52:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.259+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe50c01d020 con 0x7fe51c1024a0 2024-06-02T22:52:41.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.260+0000 7fe513e00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 0x7fe5000a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.261+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fe50c0cf560 con 0x7fe51c1024a0 2024-06-02T22:52:41.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.261+0000 7fe51aa00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 0x7fe5000a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.262+0000 7fe51aa00640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 0x7fe5000a5050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe50402a930 tx=0x7fe504030570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.265+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe50c09c0d0 con 0x7fe51c1024a0 2024-06-02T22:52:41.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.478+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe51c0625a0 con 0x7fe51c1024a0 2024-06-02T22:52:41.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.480+0000 7fe513e00640 1 -- 172.21.15.31:0/2095284018 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7fe50c09b9d0 con 0x7fe51c1024a0 2024-06-02T22:52:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:41.481 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 msgr2=0x7fe5000a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 0x7fe5000a5050 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe50402a930 tx=0x7fe504030570 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 msgr2=0x7fe51c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00c420 tx=0x7fe50c00c8e0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 shutdown_connections 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe5000a2b90 0x7fe5000a5050 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c107700 0x7fe51c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51c104dd0 0x7fe51c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 --2- 172.21.15.31:0/2095284018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe51c1024a0 0x7fe51c197db0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.483+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 >> 172.21.15.31:0/2095284018 conn(0x7fe51c0fbe90 msgr2=0x7fe51c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.484+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 shutdown_connections 2024-06-02T22:52:41.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.484+0000 7fe522200640 1 -- 172.21.15.31:0/2095284018 wait complete. 2024-06-02T22:52:41.505 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T22:25:40.784938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T22:31:14.565709+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T22:31:19.461562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T22:31:32.375546+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T22:52:41.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T22:52:41.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.728+0000 7f5880c00640 1 -- 172.21.15.31:0/1893600303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c104c60 msgr2=0x7f587c107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.728+0000 7f5880c00640 1 --2- 172.21.15.31:0/1893600303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c104c60 0x7f587c107050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5868009860 tx=0x7f586802a340 comp rx=0 tx=0).stop 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 -- 172.21.15.31:0/1893600303 shutdown_connections 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 --2- 172.21.15.31:0/1893600303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c107590 0x7f587c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 --2- 172.21.15.31:0/1893600303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c104c60 0x7f587c107050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 --2- 172.21.15.31:0/1893600303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 -- 172.21.15.31:0/1893600303 >> 172.21.15.31:0/1893600303 conn(0x7f587c0fbd40 msgr2=0x7f587c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 -- 172.21.15.31:0/1893600303 shutdown_connections 2024-06-02T22:52:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.729+0000 7f5880c00640 1 -- 172.21.15.31:0/1893600303 wait complete. 2024-06-02T22:52:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.730+0000 7f5880c00640 1 Processor -- start 2024-06-02T22:52:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.730+0000 7f5880c00640 1 -- start start 2024-06-02T22:52:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 0x7f587c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c107590 0x7f587c19f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d530 con 0x7f587c102330 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d3b0 con 0x7f587c104c60 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f5880c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f587c10d6b0 con 0x7f587c107590 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f587b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f587b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45156/0 (socket says 172.21.15.31:45156) 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f587be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c107590 0x7f587c19f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f587b400640 1 -- 172.21.15.31:0/3699787298 learned_addr learned my addr 172.21.15.31:0/3699787298 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.731+0000 7f587aa00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 0x7f587c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 -- 172.21.15.31:0/3699787298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c107590 msgr2=0x7f587c19f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c107590 0x7f587c19f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 -- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 msgr2=0x7f587c197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 -- 172.21.15.31:0/3699787298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c19f7f0 con 0x7f587c104c60 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f587aa00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 0x7f587c198110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5868035040 tx=0x7f5868033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868037040 con 0x7f587c104c60 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5868004040 con 0x7f587c104c60 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.732+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c19fa80 con 0x7f587c104c60 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.733+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680055c0 con 0x7f587c104c60 2024-06-02T22:52:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.733+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c19ff70 con 0x7f587c104c60 2024-06-02T22:52:41.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.734+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c0fd830 con 0x7f587c104c60 2024-06-02T22:52:41.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.736+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f5868042020 con 0x7f587c104c60 2024-06-02T22:52:41.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.737+0000 7f5873e00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 0x7f58600a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:41.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.738+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f58680eed00 con 0x7f587c104c60 2024-06-02T22:52:41.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.738+0000 7f587b400640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 0x7f58600a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:41.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.738+0000 7f587b400640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 0x7f58600a5050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f586c005c80 tx=0x7f586c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:41.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.742+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5868049020 con 0x7f587c104c60 2024-06-02T22:52:41.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.946+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f587c0625a0 con 0x7f587c104c60 2024-06-02T22:52:41.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.947+0000 7f5873e00640 1 -- 172.21.15.31:0/3699787298 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f58680bb870 con 0x7f587c104c60 2024-06-02T22:52:41.948 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 msgr2=0x7f58600a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 0x7f58600a5050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f586c005c80 tx=0x7f586c009260 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 msgr2=0x7f587c198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 0x7f587c198110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5868035040 tx=0x7f5868033d90 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 shutdown_connections 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f58600a2b90 0x7f58600a5050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f587c107590 0x7f587c19f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f587c104c60 0x7f587c198110 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 --2- 172.21.15.31:0/3699787298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587c102330 0x7f587c197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 >> 172.21.15.31:0/3699787298 conn(0x7f587c0fbd40 msgr2=0x7f587c102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:41.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 shutdown_connections 2024-06-02T22:52:41.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:41.950+0000 7f5880c00640 1 -- 172.21.15.31:0/3699787298 wait complete. 2024-06-02T22:52:41.970 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T22:52:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 -- 172.21.15.31:0/2129047229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 msgr2=0x7f6a1810bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 --2- 172.21.15.31:0/2129047229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a1810bc20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a1402a3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 -- 172.21.15.31:0/2129047229 shutdown_connections 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 --2- 172.21.15.31:0/2129047229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a1810bc20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 --2- 172.21.15.31:0/2129047229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a18074400 0x7f6a18074880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 --2- 172.21.15.31:0/2129047229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a180759e0 0x7f6a18073e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 -- 172.21.15.31:0/2129047229 >> 172.21.15.31:0/2129047229 conn(0x7f6a180fce40 msgr2=0x7f6a180ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 -- 172.21.15.31:0/2129047229 shutdown_connections 2024-06-02T22:52:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.178+0000 7f6a1f200640 1 -- 172.21.15.31:0/2129047229 wait complete. 2024-06-02T22:52:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.179+0000 7f6a1f200640 1 Processor -- start 2024-06-02T22:52:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.179+0000 7f6a1f200640 1 -- start start 2024-06-02T22:52:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 0x7f6a1819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a181a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1810f780 con 0x7f6a18074400 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1810f600 con 0x7f6a180759e0 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1810f900 con 0x7f6a18109790 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45174/0 (socket says 172.21.15.31:45174) 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1de00640 1 -- 172.21.15.31:0/1988091068 learned_addr learned my addr 172.21.15.31:0/1988091068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1d400640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 0x7f6a1819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.180+0000 7f6a1e800640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a181a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 -- 172.21.15.31:0/1988091068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 msgr2=0x7f6a181a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a181a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 -- 172.21.15.31:0/1988091068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 msgr2=0x7f6a1819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 0x7f6a1819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 -- 172.21.15.31:0/1988091068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a181a1980 con 0x7f6a18074400 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1d400640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 0x7f6a1819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1de00640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00ebc0 tx=0x7f6a0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c010630 con 0x7f6a18074400 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a0c010cb0 con 0x7f6a18074400 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a181a1c70 con 0x7f6a18074400 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.181+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c018bd0 con 0x7f6a18074400 2024-06-02T22:52:42.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.182+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a181a21c0 con 0x7f6a18074400 2024-06-02T22:52:42.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.183+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a181084c0 con 0x7f6a18074400 2024-06-02T22:52:42.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.185+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f6a0c0107d0 con 0x7f6a18074400 2024-06-02T22:52:42.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.186+0000 7f6a12a00640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 0x7f6a000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.186+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f6a0c0cf9d0 con 0x7f6a18074400 2024-06-02T22:52:42.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.187+0000 7f6a1d400640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 0x7f6a000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.188+0000 7f6a1d400640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 0x7f6a000a50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a1819b270 tx=0x7f6a08005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.194+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a0c09bef0 con 0x7f6a18074400 2024-06-02T22:52:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:41 smithi178 ceph-mon[36614]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 892 op/s 2024-06-02T22:52:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2095284018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:52:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3699787298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:52:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:41 smithi031 ceph-mon[31767]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 892 op/s 2024-06-02T22:52:42.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2095284018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:52:42.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3699787298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:52:42.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.403+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a180625a0 con 0x7f6a18074400 2024-06-02T22:52:42.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.404+0000 7f6a12a00640 1 -- 172.21.15.31:0/1988091068 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f6a0c0a01f0 con 0x7f6a18074400 2024-06-02T22:52:42.405 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 msgr2=0x7f6a000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 0x7f6a000a50d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a1819b270 tx=0x7f6a08005f90 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 msgr2=0x7f6a18199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00ebc0 tx=0x7f6a0c00c6a0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 shutdown_connections 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f6a000a2c10 0x7f6a000a50d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a18109790 0x7f6a181a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a180759e0 0x7f6a1819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 --2- 172.21.15.31:0/1988091068 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a18074400 0x7f6a18199d60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 >> 172.21.15.31:0/1988091068 conn(0x7f6a180fce40 msgr2=0x7f6a18105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 shutdown_connections 2024-06-02T22:52:42.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.407+0000 7f6a1f200640 1 -- 172.21.15.31:0/1988091068 wait complete. 2024-06-02T22:52:42.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T22:52:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:41 smithi098 ceph-mon[36750]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 892 op/s 2024-06-02T22:52:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2095284018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:52:42.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3699787298' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T22:52:42.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 -- 172.21.15.31:0/2531257204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 msgr2=0x7fdf48102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2531257204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf48102f20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009900 tx=0x7fdf3402a400 comp rx=0 tx=0).stop 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 -- 172.21.15.31:0/2531257204 shutdown_connections 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2531257204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf48103460 0x7fdf48109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2531257204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf48102f20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2531257204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf481018b0 0x7fdf48101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 -- 172.21.15.31:0/2531257204 >> 172.21.15.31:0/2531257204 conn(0x7fdf480fce40 msgr2=0x7fdf480ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 -- 172.21.15.31:0/2531257204 shutdown_connections 2024-06-02T22:52:42.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.633+0000 7fdf47e00640 1 -- 172.21.15.31:0/2531257204 wait complete. 2024-06-02T22:52:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.634+0000 7fdf47e00640 1 Processor -- start 2024-06-02T22:52:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.634+0000 7fdf47e00640 1 -- start start 2024-06-02T22:52:42.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf481018b0 0x7fdf48197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf481980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d550 con 0x7fdf48103460 2024-06-02T22:52:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d3d0 con 0x7fdf48102aa0 2024-06-02T22:52:42.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdf4810d6d0 con 0x7fdf481018b0 2024-06-02T22:52:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45194/0 (socket says 172.21.15.31:45194) 2024-06-02T22:52:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf47400640 1 -- 172.21.15.31:0/2483414402 learned_addr learned my addr 172.21.15.31:0/2483414402 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf46000640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf481980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.635+0000 7fdf46a00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf481018b0 0x7fdf48197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 -- 172.21.15.31:0/2483414402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf481018b0 msgr2=0x7fdf48197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf481018b0 0x7fdf48197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 -- 172.21.15.31:0/2483414402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 msgr2=0x7fdf481980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf481980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 -- 172.21.15.31:0/2483414402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf4819f7b0 con 0x7fdf48103460 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf46000640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf481980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.636+0000 7fdf47400640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000eb10 tx=0x7fdf4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.637+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004b20 con 0x7fdf48103460 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.637+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf4819faa0 con 0x7fdf48103460 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.637+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf40004cc0 con 0x7fdf48103460 2024-06-02T22:52:42.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.637+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40010760 con 0x7fdf48103460 2024-06-02T22:52:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.637+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf481a0010 con 0x7fdf48103460 2024-06-02T22:52:42.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.638+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf48108bd0 con 0x7fdf48103460 2024-06-02T22:52:42.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.640+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fdf40005020 con 0x7fdf48103460 2024-06-02T22:52:42.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.642+0000 7fdf3f400640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 0x7fdf2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.643+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7fdf400cfa50 con 0x7fdf48103460 2024-06-02T22:52:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.643+0000 7fdf46a00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 0x7fdf2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:42.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.643+0000 7fdf46a00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 0x7fdf2c0a50d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf48102900 tx=0x7fdf38005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:42.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.647+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fdf4009c5c0 con 0x7fdf48103460 2024-06-02T22:52:42.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.853+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdf480625a0 con 0x7fdf48103460 2024-06-02T22:52:42.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.854+0000 7fdf3f400640 1 -- 172.21.15.31:0/2483414402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7fdf4009bec0 con 0x7fdf48103460 2024-06-02T22:52:42.854 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-06-02T22:52:42.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.856+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 msgr2=0x7fdf2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.856+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 0x7fdf2c0a50d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdf48102900 tx=0x7fdf38005f90 comp rx=0 tx=0).stop 2024-06-02T22:52:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.856+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 msgr2=0x7fdf4819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.856+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000eb10 tx=0x7fdf4000c2d0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 shutdown_connections 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fdf2c0a2c10 0x7fdf2c0a50d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf48103460 0x7fdf4819f140 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf48102aa0 0x7fdf481980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 --2- 172.21.15.31:0/2483414402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf481018b0 0x7fdf48197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 >> 172.21.15.31:0/2483414402 conn(0x7fdf480fce40 msgr2=0x7fdf48105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 shutdown_connections 2024-06-02T22:52:42.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:42.857+0000 7fdf47e00640 1 -- 172.21.15.31:0/2483414402 wait complete. 2024-06-02T22:52:42.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T22:52:43.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.093+0000 7faae0200640 1 -- 172.21.15.31:0/3230389756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad8103590 msgr2=0x7faad8109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.093+0000 7faae0200640 1 --2- 172.21.15.31:0/3230389756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad8103590 0x7faad8109e20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faad0009ca0 tx=0x7faad002a8b0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.093+0000 7faae0200640 1 -- 172.21.15.31:0/3230389756 shutdown_connections 2024-06-02T22:52:43.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 --2- 172.21.15.31:0/3230389756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad8103590 0x7faad8109e20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 --2- 172.21.15.31:0/3230389756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad8103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 --2- 172.21.15.31:0/3230389756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad81019e0 0x7faad8101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 -- 172.21.15.31:0/3230389756 >> 172.21.15.31:0/3230389756 conn(0x7faad80fcf50 msgr2=0x7faad80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 -- 172.21.15.31:0/3230389756 shutdown_connections 2024-06-02T22:52:43.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.094+0000 7faae0200640 1 -- 172.21.15.31:0/3230389756 wait complete. 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 Processor -- start 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 -- start start 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad81019e0 0x7faad8197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faad810d640 con 0x7faad8102bd0 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faad810d4c0 con 0x7faad81019e0 2024-06-02T22:52:43.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.095+0000 7faae0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faad810d7c0 con 0x7faad8103590 2024-06-02T22:52:43.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faadce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faadce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45200/0 (socket says 172.21.15.31:45200) 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faadd800640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad81019e0 0x7faad8197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.31:39248/0 (socket says 172.21.15.31:39248) 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faadce00640 1 -- 172.21.15.31:0/1904182626 learned_addr learned my addr 172.21.15.31:0/1904182626 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 -- 172.21.15.31:0/1904182626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad81019e0 msgr2=0x7faad8197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad81019e0 0x7faad8197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 -- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 msgr2=0x7faad81981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faade200640 1 -- 172.21.15.31:0/1904182626 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad819f8d0 con 0x7faad8103590 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.096+0000 7faadce00640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faade200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faad002add0 tx=0x7faad0003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0004240 con 0x7faad8103590 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad0040070 con 0x7faad8103590 2024-06-02T22:52:43.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad819fb60 con 0x7faad8103590 2024-06-02T22:52:43.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0031440 con 0x7faad8103590 2024-06-02T22:52:43.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.097+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81a0100 con 0x7faad8103590 2024-06-02T22:52:43.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.098+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad8108d00 con 0x7faad8103590 2024-06-02T22:52:43.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.100+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7faad0045600 con 0x7faad8103590 2024-06-02T22:52:43.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.102+0000 7faad6000640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.102+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7faad00f0580 con 0x7faad8103590 2024-06-02T22:52:43.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.102+0000 7faadd800640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.103+0000 7faadd800640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 0x7faac00a50d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faad8198b60 tx=0x7faacc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.106+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faad00bd0f0 con 0x7faad8103590 2024-06-02T22:52:43.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:42 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1988091068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:42 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2483414402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.311+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faad802d2e0 con 0x7faad8103590 2024-06-02T22:52:43.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.312+0000 7faad6000640 1 -- 172.21.15.31:0/1904182626 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v99) ==== 103+0+11 (secure 0 0 0) 0x7faad00098b0 con 0x7faad8103590 2024-06-02T22:52:43.313 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 msgr2=0x7faac00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 0x7faac00a50d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faad8198b60 tx=0x7faacc00b390 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 msgr2=0x7faad819f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faad002add0 tx=0x7faad0003ba0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 shutdown_connections 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7faac00a2c10 0x7faac00a50d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8103590 0x7faad819f230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8102bd0 0x7faad81981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 --2- 172.21.15.31:0/1904182626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faad81019e0 0x7faad8197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 >> 172.21.15.31:0/1904182626 conn(0x7faad80fcf50 msgr2=0x7faad8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 shutdown_connections 2024-06-02T22:52:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.315+0000 7faae0200640 1 -- 172.21.15.31:0/1904182626 wait complete. 2024-06-02T22:52:43.333 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:42 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1988091068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.334 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:42 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2483414402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-02T22:52:43.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:42 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1988091068' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:42 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2483414402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 -- 172.21.15.31:0/2021995240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 msgr2=0x7f5b9c100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 --2- 172.21.15.31:0/2021995240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c100510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009900 tx=0x7f5b9002a3f0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 -- 172.21.15.31:0/2021995240 shutdown_connections 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 --2- 172.21.15.31:0/2021995240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c101870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 --2- 172.21.15.31:0/2021995240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 --2- 172.21.15.31:0/2021995240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c100510 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 -- 172.21.15.31:0/2021995240 >> 172.21.15.31:0/2021995240 conn(0x7f5b9c0fbc70 msgr2=0x7f5b9c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:43.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 -- 172.21.15.31:0/2021995240 shutdown_connections 2024-06-02T22:52:43.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.550+0000 7f5ba3000640 1 -- 172.21.15.31:0/2021995240 wait complete. 2024-06-02T22:52:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.551+0000 7f5ba3000640 1 Processor -- start 2024-06-02T22:52:43.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 -- start start 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10f660 con 0x7f5b9c100a50 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10f4e0 con 0x7f5b9c1013f0 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba3000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10f7e0 con 0x7f5b9c1000f0 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba1c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45228/0 (socket says 172.21.15.31:45228) 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.552+0000 7f5ba1200640 1 -- 172.21.15.31:0/1887106969 learned_addr learned my addr 172.21.15.31:0/1887106969 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:52:43.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba2600640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 -- 172.21.15.31:0/1887106969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 msgr2=0x7f5b9c199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 -- 172.21.15.31:0/1887106969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 msgr2=0x7f5b9c1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c1a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 -- 172.21.15.31:0/1887106969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c1a1960 con 0x7f5b9c100a50 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba2600640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1c00640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:52:43.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.553+0000 7f5ba1200640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e9f0 tx=0x7f5b8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.554+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00cd80 con 0x7f5b9c100a50 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.554+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8c010910 con 0x7f5b9c100a50 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.554+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c1a1c50 con 0x7f5b9c100a50 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.554+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c018990 con 0x7f5b9c100a50 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.554+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1a21a0 con 0x7f5b9c100a50 2024-06-02T22:52:43.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.555+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c10b040 con 0x7f5b9c100a50 2024-06-02T22:52:43.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.557+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f5b8c010ac0 con 0x7f5b9c100a50 2024-06-02T22:52:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.559+0000 7f5b9a000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 0x7f5b840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:52:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.559+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f5b8c0cf7e0 con 0x7f5b9c100a50 2024-06-02T22:52:43.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.559+0000 7f5ba1c00640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 0x7f5b840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:52:43.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.560+0000 7f5ba1c00640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 0x7f5b840a50d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c19b220 tx=0x7f5b90000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:52:43.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.564+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5b8c09c350 con 0x7f5b9c100a50 2024-06-02T22:52:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.828+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5b9c062640 con 0x7f5b9c100a50 2024-06-02T22:52:43.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.864+0000 7f5b9a000640 1 -- 172.21.15.31:0/1887106969 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+740366 (secure 0 0 0) 0x7f5b8c09bc50 con 0x7f5b9c100a50 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 20, 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "active_gid": 14152, 2024-06-02T22:52:43.874 INFO:teuthology.orchestra.run.smithi031.stdout: "active_name": "x", 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addrs": { 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 784266653 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 784266653 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:43.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addr": "172.21.15.31:6801/784266653", 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "active_change": "2024-06-02T22:22:54.073748+0000", 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "active_mgr_features": 4540701547738038271, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "available": true, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "standbys": [ 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 24109, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "z", 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr_features": 4540701547738038271, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:43.876 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.877 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.878 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:43.879 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.880 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.881 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.882 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-06-02T22:52:43.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.886 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.887 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.888 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.889 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.890 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-06-02T22:52:43.892 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T22:52:43.894 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T22:52:43.895 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.896 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.897 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.898 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.899 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.901 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.902 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.903 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.904 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.905 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.906 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:43.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-06-02T22:52:43.908 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.909 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.910 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.911 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.912 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:43.913 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.918 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.919 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.920 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-06-02T22:52:43.921 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.922 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.923 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.924 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.925 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.926 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-06-02T22:52:43.927 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-06-02T22:52:43.929 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.930 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.931 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.932 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.933 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.934 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.935 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.936 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.937 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.938 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba": { 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba", 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB container image", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.940 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.941 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-06-02T22:52:43.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.943 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.944 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.945 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.946 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.947 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.948 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.949 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.952 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T22:52:43.953 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.954 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.955 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.958 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.959 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.961 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.965 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-06-02T22:52:43.966 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.967 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.969 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.970 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-06-02T22:52:43.971 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-06-02T22:52:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-06-02T22:52:43.973 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.974 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.975 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-06-02T22:52:43.976 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-06-02T22:52:43.977 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-06-02T22:52:43.978 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.979 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.980 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.981 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.982 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-06-02T22:52:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:43.983 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.984 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.985 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.986 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.987 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.989 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.990 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:43.991 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.992 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.993 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.994 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.995 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.996 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T22:52:43.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T22:52:43.998 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T22:52:43.999 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-06-02T22:52:44.000 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T22:52:44.001 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T22:52:44.002 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.003 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.004 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.005 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.012 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.014 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.015 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.017 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.018 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.019 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.020 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.021 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.022 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T22:52:44.023 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.025 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.026 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.027 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.028 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.029 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.030 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.031 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T22:52:44.032 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.033 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.035 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.036 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.037 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.039 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.040 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.041 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.043 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-06-02T22:52:44.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-06-02T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.052 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.058 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.059 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.061 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.063 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.066 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.067 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.068 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.069 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.070 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.071 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.072 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.073 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.075 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-06-02T22:52:44.076 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:44.077 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.078 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.079 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-06-02T22:52:44.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.081 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.082 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.083 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.084 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.088 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.090 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.091 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.092 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.093 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.094 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T22:52:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-06-02T22:52:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-06-02T22:52:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "k8sevents", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_event_retention_days": { 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ceph_event_retention_days", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "config_check_secs": { 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_check_secs", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "10", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-06-02T22:52:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T22:52:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-06-02T22:52:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T22:52:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mds_autoscaler", 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-06-02T22:52:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-06-02T22:52:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.148 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-06-02T22:52:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-06-02T22:52:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-06-02T22:52:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-06-02T22:52:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T22:52:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-06-02T22:52:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rook", 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "storage_class": { 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "storage_class", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "local", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-06-02T22:52:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-06-02T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-06-02T22:52:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-06-02T22:52:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.284 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.285 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.286 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.287 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.288 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.289 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.290 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.293 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.294 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.295 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.296 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.297 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.298 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.299 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.300 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.302 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T22:52:44.305 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.306 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.307 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.308 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.309 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.310 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.312 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.313 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.314 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.315 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.316 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.317 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.318 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.319 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.320 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T22:52:44.321 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.322 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.323 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.324 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.325 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.326 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.327 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.328 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.329 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.331 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.332 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.333 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.334 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.336 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.337 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-06-02T22:52:44.338 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-06-02T22:52:44.339 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.342 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.343 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.344 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.345 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.346 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.347 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.348 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.349 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 24113, 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "y", 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr_features": 4540701547738038271, 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-06-02T22:52:44.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.351 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.355 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.356 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.357 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-06-02T22:52:44.358 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.359 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.360 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.361 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.362 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.364 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.365 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.366 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.367 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.373 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.374 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.375 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.376 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.377 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.378 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.379 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-06-02T22:52:44.380 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.381 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.382 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.383 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.384 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-06-02T22:52:44.385 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.386 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-06-02T22:52:44.387 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-06-02T22:52:44.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-06-02T22:52:44.389 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.390 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.391 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.392 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.393 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-06-02T22:52:44.394 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.395 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.396 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.397 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.398 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.400 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-02T22:52:44.401 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.402 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.403 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T22:52:44.404 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T22:52:44.405 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.406 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.407 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.408 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.409 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.410 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.411 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba": { 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.412 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB container image", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.413 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.414 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.415 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.418 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.419 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.420 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.421 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.422 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.423 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.424 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.425 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.426 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.427 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.428 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.429 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.430 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.431 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.432 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.433 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.434 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.435 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.436 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-06-02T22:52:44.437 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-06-02T22:52:44.438 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-06-02T22:52:44.439 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.440 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.441 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-06-02T22:52:44.442 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-06-02T22:52:44.443 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-06-02T22:52:44.444 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.445 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T22:52:44.451 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T22:52:44.452 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.453 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.454 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.455 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.456 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.457 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.458 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.459 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.461 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.462 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.463 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.464 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.465 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.466 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.467 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.469 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.470 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.471 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.473 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.474 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.475 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T22:52:44.567 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T22:52:44.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.567 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.567 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.567 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.568 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.569 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.570 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.571 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.572 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.573 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T22:52:44.574 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.575 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T22:52:44.576 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T22:52:44.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.576 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.576 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.578 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T22:52:44.579 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.580 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.581 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T22:52:44.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.583 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.584 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.586 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T22:52:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.588 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.589 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T22:52:44.590 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.591 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.592 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.593 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T22:52:44.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.596 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.597 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.598 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.599 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.600 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.601 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.602 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.603 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.604 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.605 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-06-02T22:52:44.606 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.608 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.609 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.610 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.611 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.614 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.616 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.617 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.618 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.619 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.620 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:44.621 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.622 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.623 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.624 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:44.625 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.626 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.627 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.628 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.629 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.630 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.631 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.632 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.633 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-06-02T22:52:44.634 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.635 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.637 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.638 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:44.639 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-06-02T22:52:44.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.642 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-06-02T22:52:44.643 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.644 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.645 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.646 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.647 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.648 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.649 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.650 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.651 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.652 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-06-02T22:52:44.653 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.655 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-06-02T22:52:44.656 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-06-02T22:52:44.657 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.658 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.659 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.660 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.661 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.662 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.663 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.664 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.665 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-06-02T22:52:44.666 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.668 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-06-02T22:52:44.669 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.670 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.671 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:44.673 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.674 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.675 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.676 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.677 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.678 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.680 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.683 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.684 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.685 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.686 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.687 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "k8sevents", 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_event_retention_days": { 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ceph_event_retention_days", 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.688 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "config_check_secs": { 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_check_secs", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.689 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "10", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.691 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.692 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.693 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.695 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.696 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T22:52:44.697 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.698 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.699 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.700 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.701 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.702 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.703 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.704 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-06-02T22:52:44.705 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.706 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.707 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.708 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-06-02T22:52:44.709 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-06-02T22:52:44.710 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mds_autoscaler", 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.712 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.713 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.714 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.715 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.717 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.719 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.720 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.721 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.723 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.724 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.725 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.726 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.727 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-06-02T22:52:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T22:52:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-06-02T22:52:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.760 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-06-02T22:52:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T22:52:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-06-02T22:52:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rook", 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "storage_class": { 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "storage_class", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "local", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-06-02T22:52:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-06-02T22:52:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-06-02T22:52:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-06-02T22:52:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-06-02T22:52:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-06-02T22:52:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.873 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.874 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-06-02T22:52:44.875 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.876 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.877 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.878 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.879 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.881 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.882 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-06-02T22:52:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-06-02T22:52:44.884 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-06-02T22:52:44.885 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-06-02T22:52:44.886 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-06-02T22:52:44.887 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.888 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.889 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.890 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.891 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.892 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.893 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.894 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.896 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.897 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.899 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.900 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.901 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.903 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T22:52:44.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.905 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.906 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.907 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.909 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.910 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.912 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.913 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.914 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-06-02T22:52:44.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.918 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.919 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.920 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.921 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.922 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.923 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.924 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.925 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.926 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.927 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.928 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.929 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-06-02T22:52:44.930 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.931 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "modules": [ 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-06-02T22:52:44.932 INFO:teuthology.orchestra.run.smithi031.stdout: "dashboard", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "iostat", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "nfs", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "restful" 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.933 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:44 smithi098 ceph-mon[36750]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.7 MiB/s wr, 757 op/s 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:44 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1904182626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:44 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1887106969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:44 smithi178 ceph-mon[36614]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.7 MiB/s wr, 757 op/s 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:44 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1904182626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T22:52:44.935 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:44 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1887106969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T22:52:44.937 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.937 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.938 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.939 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.941 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-06-02T22:52:44.943 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.944 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-06-02T22:52:44.946 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-06-02T22:52:44.947 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-06-02T22:52:44.948 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-06-02T22:52:44.949 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T22:52:44.950 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.951 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-06-02T22:52:44.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-06-02T22:52:44.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-06-02T22:52:44.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-06-02T22:52:44.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-06-02T22:52:44.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-06-02T22:52:44.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-06-02T22:52:44.958 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-06-02T22:52:44.959 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:44.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.961 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.962 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.963 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:44.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-06-02T22:52:44.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:44.966 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-06-02T22:52:44.967 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T22:52:44.968 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.969 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T22:52:44.970 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.971 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.972 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.973 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:44.974 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.975 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:44.976 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:44.977 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-06-02T22:52:44.978 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.979 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.981 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.982 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.986 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.987 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.988 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.989 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.990 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-06-02T22:52:44.991 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-06-02T22:52:44.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.993 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.994 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.995 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.996 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T22:52:44.997 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba": { 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-02T22:52:44.998 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB container image", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:44.999 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.000 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.001 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-06-02T22:52:45.002 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-06-02T22:52:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.004 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.005 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.007 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.009 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.010 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.011 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.013 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.014 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.015 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.016 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.017 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T22:52:45.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-06-02T22:52:45.019 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.020 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.021 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-06-02T22:52:45.022 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.023 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.024 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T22:52:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T22:52:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.072 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-06-02T22:52:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-06-02T22:52:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-06-02T22:52:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-06-02T22:52:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-06-02T22:52:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-06-02T22:52:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.149 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.151 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.152 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.154 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.155 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.156 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.157 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "k8sevents", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_event_retention_days": { 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ceph_event_retention_days", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.159 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "config_check_secs": { 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_check_secs", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "10", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.160 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.161 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.164 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.165 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.166 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.167 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.168 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.169 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.170 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.171 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-06-02T22:52:45.172 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-06-02T22:52:45.173 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.174 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.175 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.176 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mds_autoscaler", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.178 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.179 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.181 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.182 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.183 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.184 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.185 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.186 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.187 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.188 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.189 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.190 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.191 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.192 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.193 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.194 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.195 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.198 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.199 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.200 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.202 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.203 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.204 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-06-02T22:52:45.207 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.208 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.209 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.210 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.211 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.212 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.213 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.215 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.216 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.217 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.218 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.219 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.220 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.221 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.222 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.223 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.224 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.225 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.226 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.227 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.230 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.231 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.232 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.233 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.235 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.236 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T22:52:45.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-06-02T22:52:45.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:45.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:45.241 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.242 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.243 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.244 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.245 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.246 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.247 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.248 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.249 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.250 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.253 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-06-02T22:52:45.254 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.255 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.256 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.258 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.259 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.260 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.262 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.263 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.264 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-06-02T22:52:45.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-06-02T22:52:45.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.267 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.268 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.269 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.271 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.272 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rook", 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.274 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.275 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.276 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.277 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.278 INFO:teuthology.orchestra.run.smithi031.stdout: "storage_class": { 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "storage_class", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "local", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.280 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.281 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.282 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.283 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.284 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.285 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.286 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.287 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.288 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.289 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.290 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.291 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.292 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.293 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.294 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.295 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.296 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-06-02T22:52:45.297 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.298 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.299 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.300 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.301 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.302 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.303 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.304 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.307 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.308 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.310 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.311 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.312 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.313 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.314 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.315 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.316 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.317 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.318 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.319 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.320 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.322 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.323 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.324 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.325 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.327 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.328 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.329 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.330 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.331 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.332 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.333 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T22:52:45.334 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.335 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.336 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-06-02T22:52:45.337 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.338 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.339 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.340 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.341 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.342 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.343 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.344 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.345 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.346 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.347 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.348 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.349 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.350 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.351 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.352 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.353 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.355 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.356 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.357 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.358 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.359 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.360 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.361 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.362 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.363 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-06-02T22:52:45.364 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.365 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.368 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.369 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-06-02T22:52:45.370 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.372 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-06-02T22:52:45.373 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-06-02T22:52:45.374 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "services": { 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dashboard": "https://172.21.15.31:8443/" 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "always_on_modules": { 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "octopus": [ 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-06-02T22:52:45.376 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pacific": [ 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-06-02T22:52:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "quincy": [ 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-06-02T22:52:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "reef": [ 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "squid": [ 2024-06-02T22:52:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "last_failure_osd_epoch": 3, 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "active_clients": [ 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3836586636 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "libcephsqlite", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-06-02T22:52:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1444011975 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 26885434 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1475941824 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-06-02T22:52:45.383 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 msgr2=0x7f5b840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 0x7f5b840a50d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c19b220 tx=0x7f5b90000bc0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 msgr2=0x7f5b9c19a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e9f0 tx=0x7f5b8c00eeb0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 shutdown_connections 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f5b840a2c10 0x7f5b840a50d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b9c1013f0 0x7f5b9c1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b9c100a50 0x7f5b9c19a290 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 --2- 172.21.15.31:0/1887106969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b9c1000f0 0x7f5b9c199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 >> 172.21.15.31:0/1887106969 conn(0x7f5b9c0fbc70 msgr2=0x7f5b9c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:52:45.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 shutdown_connections 2024-06-02T22:52:45.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:52:43.880+0000 7f5ba3000640 1 -- 172.21.15.31:0/1887106969 wait complete. 2024-06-02T22:52:45.392 DEBUG:tasks.check_counter:Getting stats from a 2024-06-02T22:52:45.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-02T22:52:45.392 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:44 smithi031 ceph-mon[31767]: pgmap v983: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.7 MiB/s wr, 757 op/s 2024-06-02T22:52:45.393 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:44 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1904182626' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-02T22:52:45.393 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:44 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1887106969' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T22:52:45.888 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:52:46.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:46 smithi178 ceph-mon[36614]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 666 op/s 2024-06-02T22:52:46.313 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:46 smithi031 ceph-mon[31767]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 666 op/s 2024-06-02T22:52:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:46 smithi098 ceph-mon[36750]: pgmap v984: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 5.8 MiB/s wr, 666 op/s 2024-06-02T22:52:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:48 smithi178 ceph-mon[36614]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-06-02T22:52:48.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:48 smithi031 ceph-mon[31767]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-06-02T22:52:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:48 smithi098 ceph-mon[36750]: pgmap v985: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 514 op/s 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 5471, 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 7772, 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 2207387, 2024-06-02T22:52:49.758 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 7278802, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 18, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 3, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.988769891, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.344929226, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.388440531, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.209293338, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 7774, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 5.315700192, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000683779 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:49.759 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 6643, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.004481968, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000674 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 864256, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 223184 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 11703, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 13343, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 4267114, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 12241490, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 18, 2024-06-02T22:52:49.760 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 8, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 4.156814012, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 2.658252576, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 8.248036184, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.264253178, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 13335, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 4.808738135, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000360610 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:49.761 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 17938, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.008033188, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000447 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 3427824, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 6841696 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 6776, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 9037, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 1970485, 2024-06-02T22:52:49.762 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 13450149, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 142, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 8, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 1.634269420, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.723644706, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.603766369, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.292770233, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 9039, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 5.421022664, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000599736 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:49.763 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 6780, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.002589332, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000381 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 32176, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 1904 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "cct": { 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "total_workers": 1, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "unhealthy_workers": 0 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-MDSRank": { 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:52:49.764 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 5054, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 7.806313627, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001544581 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-PurgeQueue": { 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 867, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.129118600, 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000148925 2024-06-02T22:52:49.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "request": 3657, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "reply": 3657, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "reply_latency": { 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3657, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 18.341578071, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.005015471 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_reply": 0, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "forward": 0, 2024-06-02T22:52:49.766 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_complete": 0, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_keys": 0, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_commit": 1212, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_split": 3, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_merge": 0, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes": 1150, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_top": 7, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_bottom": 1143, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pin_tail": 0, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pinned": 1140, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_expired": 0, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_with_caps": 1045, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": 1045, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "subtrees": 2, 2024-06-02T22:52:49.767 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse": 6183, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_hit": 5050, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_forward": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_discover": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_remote_ino": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_lock": 251, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "load_cent": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "q": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "exported": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "exported_inodes": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "imported": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "imported_inodes": 0, 2024-06-02T22:52:49.768 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_dir_fetch": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_peer_discover": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rfiles": 1021, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rbytes": 1568529708, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rsnaps": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_set_tag": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:52:49.769 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_file_inodes": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_revoke": 354, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_grant": 2492, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps": 3891, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps_dirty": 2065, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_cap_release": 180, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "process_request_cap_release": 1001 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.770 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_cache": { 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update": 168, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update_receipt": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_try_discover": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_send_discover": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_handle_discover": 252, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays": 3, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_delayed": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_created": 412, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_enqueued": 253, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_reintegrated": 156, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_migrated": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_processing": 0, 2024-06-02T22:52:49.771 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_started": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_completed": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_exportdir": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_flush": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragmentdir": 3, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragstats": 0, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_inodestats": 0 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_log": { 2024-06-02T22:52:49.772 INFO:teuthology.orchestra.run.smithi031.stdout: "evlrg": 0, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "evadd": 6640, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "evex": 6406, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "evtrm": 6406, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "ev": 234, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "evexg": 0, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "evexd": 24, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segadd": 75, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segex": 74, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segtrm": 74, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "seg": 1, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segmjr": 1, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segexg": 0, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "segexd": 1, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "expos": 20052086, 2024-06-02T22:52:49.773 INFO:teuthology.orchestra.run.smithi031.stdout: "wrpos": 20668149, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "rdpos": 0, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "jlat": { 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 2548, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 106.004021229, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.041602834 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "replayed": 0 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_mem": { 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "ino": 1075, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "ino+": 1320, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "ino-": 245, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "dir": 68, 2024-06-02T22:52:49.774 INFO:teuthology.orchestra.run.smithi031.stdout: "dir+": 73, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dir-": 5, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dn": 1148, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dn+": 1925, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dn-": 777, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cap": 1045, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cap+": 1450, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "cap-": 405, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "rss": 74336, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "heap": 231804 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_server": { 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_client_request": 4466, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_server_request": 1, 2024-06-02T22:52:49.775 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_request": 3657, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_session": 344, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_peer_request": 2, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "req_create_latency": { 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1272, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 8.351133804, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.006565356 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getattr_latency": { 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 68, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 1.584632567, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.023303420 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.776 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getfilelock_latency": { 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "req_link_latency": { 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 156, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.571141829, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.003661165 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookup_latency": { 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 992, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 1.940855067, 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001956507 2024-06-02T22:52:49.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookuphash_latency": { 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupino_latency": { 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupname_latency": { 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.778 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupparent_latency": { 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupsnap_latency": { 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.779 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lssnap_latency": { 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mkdir_latency": { 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 37, 2024-06-02T22:52:49.780 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.606964197, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.016404437 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mknod_latency": { 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mksnap_latency": { 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.781 INFO:teuthology.orchestra.run.smithi031.stdout: "req_open_latency": { 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 475, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.370599218, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000780208 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "req_readdir_latency": { 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 64, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.392905349, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.006139146 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rename_latency": { 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 390, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 3.683685372, 2024-06-02T22:52:49.782 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.009445347 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "req_renamesnap_latency": { 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "req_snapdiff_latency": { 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmdir_latency": { 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 2, 2024-06-02T22:52:49.783 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.030858645, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.015429322 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmsnap_latency": { 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmxattr_latency": { 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setattr_latency": { 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 2, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.002119518, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.001059759 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setdirlayout_latency": { 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.785 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setfilelock_latency": { 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setlayout_latency": { 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setxattr_latency": { 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 9, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.033979468, 2024-06-02T22:52:49.786 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.003775496 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "req_symlink_latency": { 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "req_unlink_latency": { 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 190, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.772703037, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.004066858 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:52:49.787 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getvxattr_latency": { 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_sessions": { 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "session_count": 1, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "session_add": 4, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "session_remove": 3, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_open": 1, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_stale": 0, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "total_load": 678, 2024-06-02T22:52:49.788 INFO:teuthology.orchestra.run.smithi031.stdout: "average_load": 678, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "avg_session_uptime": 955, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "mdthresh_evicted": 0 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "mempool": { 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_items": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:52:49.789 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:52:49.790 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:52:49.791 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_bytes": 468925, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_items": 1220, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_bytes": 616, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_items": 7, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_bytes": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_items": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_items": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_items": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_bytes": 8888, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_items": 170, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:52:49.792 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_bytes": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_items": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_bytes": 3910430, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_items": 54330, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_bytes": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_items": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_bytes": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_items": 0 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "objecter": { 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "op_active": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "op_laggy": 0, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send": 8405, 2024-06-02T22:52:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send_bytes": 20796299, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "op_resend": 31, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "op_reply": 8405, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "op_latency": { 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 8405, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 762.006898696, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.090661142 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "op_inflight": 0, 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "oplen_avg": { 2024-06-02T22:52:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 8405, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 15160 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "op": 8405, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "op_r": 101, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "op_w": 8304, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "op_rmw": 0, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "op_pg": 0, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_stat": 1141, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_create": 2637, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_read": 101, 2024-06-02T22:52:49.795 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_write": 2649, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writefull": 359, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writesame": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_append": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_zero": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_truncate": 3, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_delete": 1048, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_mapext": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_sparse_read": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_clonerange": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_getxattr": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_setxattr": 4028, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_rmxattr": 0, 2024-06-02T22:52:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_call": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_watch": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_notify": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_other": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_active": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_send": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_resend": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_ping": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_active": 0, 2024-06-02T22:52:49.797 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_send": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_resend": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_active": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_send": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_resend": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_active": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_send": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_resend": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "command_active": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "command_send": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "command_resend": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "map_epoch": 99, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "map_full": 0, 2024-06-02T22:52:49.798 INFO:teuthology.orchestra.run.smithi031.stdout: "map_inc": 11, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_sessions": 12, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_open": 12, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_close": 0, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_laggy": 0, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_wr": 2963, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_rd": 0, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_del": 231 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "oft": { 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_objs": 1, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_updates": 0, 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_removes": 0 2024-06-02T22:52:49.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "osd-slow-ops": { 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_ops_count": 0 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "purge_queue": { 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops": 0, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops_high_water": 12, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing": 0, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_high_water": 5, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed_ops": 530, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed": 253, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_item_in_journal": 0 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:49.800 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 23946, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 5848542, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 23946, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 23946, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 5848542, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_bytes": { 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 8405, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 20823860, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 8405, 2024-06-02T22:52:49.802 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 20823860, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_ops": { 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 1024, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:49.803 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 8405, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 8405, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 8405, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 8405, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.804 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 253, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 27561, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 253, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 101, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 27561, 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:49.805 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle-0x5555fc534500": { 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 4792, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 6640, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 16473845, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 6640, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:49.806 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 2548, 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 16469053, 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:49.807 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:52:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:50 smithi178 ceph-mon[36614]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 322 op/s 2024-06-02T22:52:50.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:50 smithi031 ceph-mon[31767]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 322 op/s 2024-06-02T22:52:50.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:50 smithi098 ceph-mon[36750]: pgmap v986: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.7 MiB/s wr, 322 op/s 2024-06-02T22:52:51.468 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-06-02T22:52:51.468 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-06-02T22:52:51.468 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=168 2024-06-02T22:52:51.468 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-06-02T22:52:51.468 DEBUG:tasks.check_counter:Getting stats from d 2024-06-02T22:52:51.469 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-02T22:52:51.942 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:52:52.281 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:52 smithi031 ceph-mon[31767]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-06-02T22:52:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:52 smithi178 ceph-mon[36614]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-06-02T22:52:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:52 smithi098 ceph-mon[36750]: pgmap v987: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.2 MiB/s wr, 144 op/s 2024-06-02T22:52:54.290 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:54 smithi031 ceph-mon[31767]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 774 KiB/s wr, 104 op/s 2024-06-02T22:52:54.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:54 smithi178 ceph-mon[36614]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 774 KiB/s wr, 104 op/s 2024-06-02T22:52:54.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:54 smithi098 ceph-mon[36750]: pgmap v988: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 774 KiB/s wr, 104 op/s 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 0, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 2, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 0, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 0, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 4, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 0, 2024-06-02T22:52:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.004152405, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.000767576, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 6, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 275, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 3392, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 204592, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 4, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 2, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.043520819, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.033916195, 2024-06-02T22:52:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.003715298, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 274, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.059205029, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000216076 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 204592 2024-06-02T22:52:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 361, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 356, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 794416, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 220416, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 2, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 1, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.125856865, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.063143094, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.044268619, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.014792358, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 355, 2024-06-02T22:52:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.080221561, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000225976 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 794416, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 220416 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "cct": { 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "total_workers": 0, 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "unhealthy_workers": 0 2024-06-02T22:52:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "mempool": { 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_items": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:52:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:52:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_bytes": 149735, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_items": 30, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:52:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_bytes": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_items": 0, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_bytes": 928, 2024-06-02T22:52:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_items": 2, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_bytes": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_items": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_bytes": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_items": 0 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 363, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 743400, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 363, 2024-06-02T22:52:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 363, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 743400, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:54.643 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:52:55.498 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-02T22:52:55.498 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-02T22:52:55.498 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-06-02T22:52:55.498 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-06-02T22:52:55.498 DEBUG:tasks.check_counter:Getting stats from g 2024-06-02T22:52:55.499 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-02T22:52:55.969 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:52:56.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:56 smithi178 ceph-mon[36614]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 KiB/s wr, 24 op/s 2024-06-02T22:52:56.331 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:56 smithi031 ceph-mon[31767]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 KiB/s wr, 24 op/s 2024-06-02T22:52:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:56 smithi098 ceph-mon[36750]: pgmap v989: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 80 KiB/s wr, 24 op/s 2024-06-02T22:52:58.293 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:52:58 smithi031 ceph-mon[31767]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 17 op/s 2024-06-02T22:52:58.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:52:58 smithi178 ceph-mon[36614]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 17 op/s 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 19, 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 21, 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 7189, 2024-06-02T22:52:58.363 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 13001, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 12, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 4, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.015171751, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.001123045, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.008206006, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.000512907, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 18, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.044485847, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.002471435 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.364 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 3093, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 1901, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 1544623, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 690498, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 7, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 4, 2024-06-02T22:52:58.365 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.516195785, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.267687428, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.301292013, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.027103309, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1902, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.452432711, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000237872 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3774, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.001645322, 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000435 2024-06-02T22:52:58.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 852096, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 223680 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 78, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 346, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 24584, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 590732, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 14, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 8, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.114372485, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.082574352, 2024-06-02T22:52:58.367 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.027980100, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.000453163, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 344, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.093935788, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000273069 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 132, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000033249, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000251 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 21792, 2024-06-02T22:52:58.368 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 537424 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "cct": { 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "total_workers": 1, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "unhealthy_workers": 0 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-MDSRank": { 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 44, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.005137541, 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000116762 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-PurgeQueue": { 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 2, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000008086, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000004043 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "request": 48, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "reply": 1, 2024-06-02T22:52:58.370 INFO:teuthology.orchestra.run.smithi031.stdout: "reply_latency": { 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000204821, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000204821 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_reply": 0, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "forward": 47, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_complete": 0, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_keys": 0, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_commit": 11, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_split": 0, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_merge": 0, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes": 34, 2024-06-02T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_top": 11, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_bottom": 23, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pin_tail": 0, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pinned": 18, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_expired": 4, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_with_caps": 0, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": 0, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "subtrees": 3, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse": 116, 2024-06-02T22:52:58.372 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_hit": 43, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_forward": 45, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_discover": 26, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_remote_ino": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_lock": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "load_cent": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "q": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "exported": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "exported_inodes": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "imported": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "imported_inodes": 0, 2024-06-02T22:52:58.373 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_dir_fetch": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_peer_discover": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rfiles": 1021, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rbytes": 1568529708, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rsnaps": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_set_tag": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:52:58.374 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_file_inodes": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:52:58.375 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_cap_release": 0, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "process_request_cap_release": 2 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_cache": { 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update": 0, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update_receipt": 108, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_try_discover": 66, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_send_discover": 63, 2024-06-02T22:52:58.376 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_handle_discover": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_delayed": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_created": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_enqueued": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_reintegrated": 0, 2024-06-02T22:52:58.377 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_migrated": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_processing": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_started": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_completed": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_exportdir": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_flush": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:52:58.378 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragstats": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_inodestats": 0 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_log": { 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evlrg": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evadd": 5, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evex": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evtrm": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "ev": 5, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evexg": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "evexd": 0, 2024-06-02T22:52:58.379 INFO:teuthology.orchestra.run.smithi031.stdout: "segadd": 2, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "segex": 0, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "segtrm": 0, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "seg": 2, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "segmjr": 2, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "segexg": 0, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "segexd": 0, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "expos": 4194304, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "wrpos": 4195729, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "rdpos": 0, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "jlat": { 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 4, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.008483243, 2024-06-02T22:52:58.380 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.002120810 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "replayed": 0 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_mem": { 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "ino": 38, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "ino+": 40, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "ino-": 2, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "dir": 58, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "dir+": 61, 2024-06-02T22:52:58.381 INFO:teuthology.orchestra.run.smithi031.stdout: "dir-": 3, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "dn": 34, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "dn+": 38, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "dn-": 4, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "cap": 0, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "cap+": 1, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "cap-": 1, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "rss": 51200, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "heap": 223612 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_server": { 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_client_request": 49, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_server_request": 0, 2024-06-02T22:52:58.382 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_request": 48, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_session": 17, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_peer_request": 0, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "req_create_latency": { 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getattr_latency": { 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000204821, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000204821 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.383 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getfilelock_latency": { 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "req_link_latency": { 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookup_latency": { 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.384 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookuphash_latency": { 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupino_latency": { 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupname_latency": { 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupparent_latency": { 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupsnap_latency": { 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lssnap_latency": { 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.386 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.387 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mkdir_latency": { 2024-06-02T22:52:58.387 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.387 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mknod_latency": { 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mksnap_latency": { 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.388 INFO:teuthology.orchestra.run.smithi031.stdout: "req_open_latency": { 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "req_readdir_latency": { 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rename_latency": { 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "req_renamesnap_latency": { 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "req_snapdiff_latency": { 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmdir_latency": { 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.390 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmsnap_latency": { 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmxattr_latency": { 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.391 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setattr_latency": { 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setdirlayout_latency": { 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setfilelock_latency": { 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setlayout_latency": { 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setxattr_latency": { 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "req_symlink_latency": { 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.393 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "req_unlink_latency": { 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getvxattr_latency": { 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.394 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.395 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_sessions": { 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "session_count": 1, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "session_add": 2, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "session_remove": 1, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_open": 1, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_stale": 0, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "total_load": 1, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "average_load": 1, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "avg_session_uptime": 965, 2024-06-02T22:52:58.396 INFO:teuthology.orchestra.run.smithi031.stdout: "mdthresh_evicted": 0 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "mempool": { 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_items": 0, 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:52:58.397 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:52:58.398 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_items": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:52:58.399 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_items": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_bytes": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_items": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_bytes": 252033, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_items": 122, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:52:58.400 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_items": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_bytes": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_items": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_items": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_items": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_bytes": 8888, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_items": 170, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:52:58.401 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_bytes": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_items": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_bytes": 188735, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_items": 936, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_bytes": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_items": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_bytes": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_items": 0 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "objecter": { 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "op_active": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "op_laggy": 0, 2024-06-02T22:52:58.402 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send": 40, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send_bytes": 11727, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "op_resend": 32, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "op_reply": 40, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "op_latency": { 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 40, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.314994909, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.007874872 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "op_inflight": 0, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "oplen_avg": { 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 40, 2024-06-02T22:52:58.403 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 62 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "op": 40, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "op_r": 0, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "op_w": 40, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "op_rmw": 0, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "op_pg": 0, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_stat": 0, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_create": 10, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_read": 0, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_write": 4, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writefull": 7, 2024-06-02T22:52:58.404 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writesame": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_append": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_zero": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_truncate": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_delete": 6, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_mapext": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_sparse_read": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_clonerange": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_getxattr": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_setxattr": 20, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:52:58.405 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_rmxattr": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_call": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_watch": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_notify": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_other": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_active": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_send": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_resend": 0, 2024-06-02T22:52:58.406 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_ping": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_active": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_send": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_resend": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_active": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_send": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_resend": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_active": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_send": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_resend": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "command_active": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "command_send": 0, 2024-06-02T22:52:58.407 INFO:teuthology.orchestra.run.smithi031.stdout: "command_resend": 0, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "map_epoch": 99, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "map_full": 0, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "map_inc": 2, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_sessions": 10, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_open": 16, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_close": 6, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_laggy": 0, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_wr": 14, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_rd": 0, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_del": 1 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.408 INFO:teuthology.orchestra.run.smithi031.stdout: "oft": { 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_objs": 1, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_updates": 0, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_removes": 0 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "osd-slow-ops": { 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_ops_count": 0 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "purge_queue": { 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops": 0, 2024-06-02T22:52:58.409 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_high_water": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed_ops": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_item_in_journal": 0 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:58.410 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 3186, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 1263126, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 3186, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3186, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 1263126, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_bytes": { 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 40, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 11727, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 40, 2024-06-02T22:52:58.412 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 11727, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_ops": { 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 1024, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:52:58.413 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 40, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 40, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 40, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 40, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.414 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:58.415 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 0, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 0, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle-0x55ca8340c500": { 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:52:58.416 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 5, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 1425, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 5, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 4, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 1425, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:52:58.417 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:52:58.418 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:52:58.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:52:58.418 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:52:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:52:58 smithi098 ceph-mon[36750]: pgmap v990: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 17 op/s 2024-06-02T22:52:59.388 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-06-02T22:52:59.388 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-06-02T22:52:59.389 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-06-02T22:52:59.389 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=108 2024-06-02T22:52:59.389 DEBUG:tasks.check_counter:Getting stats from j 2024-06-02T22:52:59.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-02T22:52:59.872 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:00.300 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:00 smithi031 ceph-mon[31767]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-06-02T22:53:00.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:00 smithi178 ceph-mon[36614]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-06-02T22:53:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:00 smithi098 ceph-mon[36750]: pgmap v991: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2024-06-02T22:53:02.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:02 smithi178 ceph-mon[36614]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T22:53:02.315 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:02 smithi031 ceph-mon[31767]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T22:53:02.427 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-06-02T22:53:02.427 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:02.427 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 1150, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 1152, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 386345, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 365701, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 7, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.270638155, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.108942892, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.055172460, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.081505706, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 1150, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.285729641, 2024-06-02T22:53:02.428 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000248460 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 2211, 2024-06-02T22:53:02.429 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 2484, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 563918, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 1229285, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.344446896, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.132453417, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.073053391, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.109832001, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 2482, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.351818233, 2024-06-02T22:53:02.430 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000141747 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 526448 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_messages": 380, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages": 371, 2024-06-02T22:53:02.431 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_bytes": 830484, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_bytes": 224933, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_created_connections": 6, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_total_time": 0.099853322, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_send_time": 0.030997854, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_recv_time": 0.059150431, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_running_fast_dispatch_time": 0.014756755, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 371, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.074808509, 2024-06-02T22:53:02.433 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000201640 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_recv_encrypted_bytes": 829136, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "msgr_send_encrypted_bytes": 223968 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "cct": { 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "total_workers": 1, 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: "unhealthy_workers": 0 2024-06-02T22:53:02.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-MDSRank": { 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 5343, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.241254666, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000045153 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "queue_len": 0, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "complete_latency": { 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.435 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "request": 0, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "reply": 0, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "reply_latency": { 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_reply": 0, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "forward": 0, 2024-06-02T22:53:02.436 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_commit": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_split": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_merge": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_top": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_bottom": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_pinned": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_expired": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": 0, 2024-06-02T22:53:02.437 INFO:teuthology.orchestra.run.smithi031.stdout: "subtrees": 1, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_hit": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_forward": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_discover": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "traverse_lock": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "load_cent": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "q": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "exported": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "exported_inodes": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "imported": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "imported_inodes": 0, 2024-06-02T22:53:02.438 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rfiles": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rbytes": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "root_rsnaps": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:02.439 INFO:teuthology.orchestra.run.smithi031.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "process_request_cap_release": 0 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_cache": { 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update": 0, 2024-06-02T22:53:02.440 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_update_receipt": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_try_discover": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_send_discover": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_created": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_enqueued": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "strays_migrated": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:02.441 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_started": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_completed": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_flush": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "ireq_inodestats": 0 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_log": { 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "evlrg": 0, 2024-06-02T22:53:02.442 INFO:teuthology.orchestra.run.smithi031.stdout: "evadd": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "evex": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "evtrm": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "ev": 6, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "evexg": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "evexd": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segadd": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segex": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segtrm": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "seg": 2, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segmjr": 2, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segexg": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "segexd": 0, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "expos": 4194304, 2024-06-02T22:53:02.443 INFO:teuthology.orchestra.run.smithi031.stdout: "wrpos": 4195954, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "rdpos": 4195813, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "jlat": { 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "replayed": 6 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_mem": { 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "ino": 3, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "ino+": 3, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "ino-": 0, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "dir": 1, 2024-06-02T22:53:02.444 INFO:teuthology.orchestra.run.smithi031.stdout: "dir+": 1, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dir-": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dn": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dn+": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dn-": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "cap": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "cap+": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "cap-": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "rss": 48512, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "heap": 215420 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_server": { 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_client_request": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:02.445 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_request": 0, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_client_session": 0, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "handle_peer_request": 0, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "req_create_latency": { 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getattr_latency": { 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.446 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "req_link_latency": { 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookup_latency": { 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.447 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupino_latency": { 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupname_latency": { 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "req_lssnap_latency": { 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.450 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mkdir_latency": { 2024-06-02T22:53:02.450 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.450 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.450 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mknod_latency": { 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "req_mksnap_latency": { 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "req_open_latency": { 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.451 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "req_readdir_latency": { 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rename_latency": { 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:02.452 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmdir_latency": { 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setattr_latency": { 2024-06-02T22:53:02.454 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.455 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setlayout_latency": { 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "req_setxattr_latency": { 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "req_symlink_latency": { 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.456 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "req_unlink_latency": { 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_sessions": { 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "session_count": 0, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "session_add": 2, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "session_remove": 2, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_open": 1, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "sessions_stale": 0, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "total_load": 0, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "average_load": 0, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "avg_session_uptime": 1604, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "mempool": { 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_bytes": 198247, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_anon_items": 56, 2024-06-02T22:53:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_items": 170, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "pgmap_items": 0, 2024-06-02T22:53:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_bytes": 8464, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_co_items": 13, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_1_items": 0, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "unittest_2_items": 0 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "objecter": { 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "op_active": 0, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "op_laggy": 0, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send": 3363, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "op_send_bytes": 21, 2024-06-02T22:53:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "op_resend": 3, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "op_reply": 3363, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "op_latency": { 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3363, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 63.533026244, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.018891771 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "op_inflight": 0, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "oplen_avg": { 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 3363, 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 3364 2024-06-02T22:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "op": 3363, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "op_r": 3363, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "op_w": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "op_rmw": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "op_pg": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_stat": 2204, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_create": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_read": 1157, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_write": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writefull": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_writesame": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_append": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_zero": 0, 2024-06-02T22:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_truncate": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_delete": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_mapext": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_getxattr": 1, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_setxattr": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_call": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_watch": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_notify": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "osdop_other": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_active": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_send": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_resend": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "linger_ping": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_active": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_send": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "poolop_resend": 0, 2024-06-02T22:53:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_active": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_send": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "poolstat_resend": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_active": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_send": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "statfs_resend": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "command_active": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "command_send": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "command_resend": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "map_epoch": 99, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "map_full": 0, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "map_inc": 2, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_sessions": 6, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_open": 9, 2024-06-02T22:53:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_session_close": 3, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_laggy": 0, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_wr": 0, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_rd": 2, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_del": 0 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "oft": { 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_objs": 0, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_updates": 0, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "omap_total_removes": 0 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "osd-slow-ops": { 2024-06-02T22:53:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "slow_ops_count": 0 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "purge_queue": { 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_executed": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:53:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 3737, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 1422173, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 3737, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3737, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 1422173, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 104857600, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 3363, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 1655, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3363, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 1655, 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:53:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 1024, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 3363, 2024-06-02T22:53:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 3363, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 3363, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 3363, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:53:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "throttle-write_buf_throttle-0x561f4b192780": { 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "val": 0, 2024-06-02T22:53:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "max": 3758096384, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "get_started": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "get": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "get_sum": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "take": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "take_sum": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "put": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "put_sum": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "wait": { 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "avgcount": 0, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "sum": 0.000000000, 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "avgtime": 0.000000000 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-06-02T22:53:02.477 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-06-02T22:53:02.477 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:02 smithi098 ceph-mon[36750]: pgmap v992: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T22:53:03.423 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-06-02T22:53:03.423 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-06-02T22:53:03.423 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update=0 2024-06-02T22:53:03.423 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update_receipt=0 2024-06-02T22:53:03.423 DEBUG:tasks.check_counter:Getting stats from b 2024-06-02T22:53:03.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-02T22:53:03.736 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:53:04.148 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:04 smithi098 ceph-mon[36750]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2024-06-02T22:53:04.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:04 smithi031 ceph-mon[31767]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2024-06-02T22:53:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:04 smithi178 ceph-mon[36614]: pgmap v993: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 3076, 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1892, 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1538705, 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 676578, 2024-06-02T22:53:05.756 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 9, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.189191611, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.067574550, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.159251638, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.016306171, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1893, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.114593937, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000060535 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:05.757 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3790, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000851684, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000224 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 847744, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 223680 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 74, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 344, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 22730, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 686544, 2024-06-02T22:53:05.758 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 14, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 8, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.030176295, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.014461901, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.013771662, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000361103, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 340, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.030052952, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000088391 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 109, 2024-06-02T22:53:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000032842, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000301 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 18208, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 624816 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 17, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 17, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 6612, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 7166, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 9, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:05.760 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.004457850, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000212377, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.003695758, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000332681, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 16, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.018322748, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001145171 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.761 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:05.762 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 50, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001386097, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000027721 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000009357, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000004678 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-06-02T22:53:05.763 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 40, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 1, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000123405, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000123405 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 39, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-06-02T22:53:05.764 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 34, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 11, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 23, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 18, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 4, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 1, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 1, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 3, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 103, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 42, 2024-06-02T22:53:05.765 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 39, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 22, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:05.766 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 1021, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 1568529708, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:05.767 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-06-02T22:53:05.768 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 106, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 64, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 63, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:05.769 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.770 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 3, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 3, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-06-02T22:53:05.771 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195198, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.002958856, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001479428 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-06-02T22:53:05.772 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 38, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 40, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 2, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 58, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 62, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 4, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 34, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 38, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 4, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 1, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 1, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 51548, 2024-06-02T22:53:05.773 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 223612 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 40, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 40, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 13, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-06-02T22:53:05.775 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.776 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000123405, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000123405 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.778 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-06-02T22:53:05.779 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.781 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:05.782 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.783 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.784 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.785 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-06-02T22:53:05.786 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 1, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 0, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 1, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 1, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 970, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:05.787 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:05.788 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:05.789 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 243377, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 114, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:05.790 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 170, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 189071, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 934, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 37, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 11106, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 28, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 37, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 37, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.291996292, 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.007891791 2024-06-02T22:53:05.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 37, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 59 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 37, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 37, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 0, 2024-06-02T22:53:05.793 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 2, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 6, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 6, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:05.794 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-06-02T22:53:05.795 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 99, 2024-06-02T22:53:05.796 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 2, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 9, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 15, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 6, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 14, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 1 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-06-02T22:53:05.797 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-06-02T22:53:05.798 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3163, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1257592, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3163, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:05.799 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3163, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1257592, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:05.800 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 37, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 11106, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 37, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 11106, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.801 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 37, 2024-06-02T22:53:05.802 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 37, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 37, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 37, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:05.803 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x5564d9498500": { 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 894, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 894, 2024-06-02T22:53:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:05.806 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-06-02T22:53:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:06 smithi031 ceph-mon[31767]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-06-02T22:53:06.429 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:06 smithi098 ceph-mon[36750]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-06-02T22:53:06.457 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-06-02T22:53:06.457 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-06-02T22:53:06.457 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-06-02T22:53:06.457 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=106 2024-06-02T22:53:06.457 DEBUG:tasks.check_counter:Getting stats from e 2024-06-02T22:53:06.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-02T22:53:06.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:06 smithi178 ceph-mon[36614]: pgmap v994: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 11 op/s 2024-06-02T22:53:06.717 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:53:08.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:08 smithi031 ceph-mon[31767]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-06-02T22:53:08.403 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:08 smithi098 ceph-mon[36750]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-06-02T22:53:08.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:08 smithi178 ceph-mon[36614]: pgmap v995: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1210, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1212, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 318521, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 384844, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.097592766, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.035244030, 2024-06-02T22:53:08.707 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.023468578, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.028372035, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1210, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.058966047, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000048732 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1336, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1329, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1062984, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 529759, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.129063865, 2024-06-02T22:53:08.709 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.037458299, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.041484140, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.044166885, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1328, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.077747940, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000058545 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 826064, 2024-06-02T22:53:08.710 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 223520 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1210, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1481, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 408112, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 911702, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.137483909, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.046134957, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.034588126, 2024-06-02T22:53:08.711 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.043833207, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1480, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.103710525, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000070074 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 528512 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 5771, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.157787818, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000027341 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:08.713 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-06-02T22:53:08.715 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-06-02T22:53:08.716 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:08.717 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-06-02T22:53:08.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-06-02T22:53:08.719 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-06-02T22:53:08.720 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-06-02T22:53:08.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 3, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-06-02T22:53:08.722 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195198, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 4194892, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 3 2024-06-02T22:53:08.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 3, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 3, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 1, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 1, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 0, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 0, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 0, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-06-02T22:53:08.724 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 49340, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215420 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-06-02T22:53:08.725 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:08.726 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.727 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.728 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-06-02T22:53:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.730 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.731 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.733 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.734 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.735 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.736 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:08.737 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 1, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 0, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-06-02T22:53:08.738 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 2771, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:08.739 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:08.740 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:08.741 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 190929, 2024-06-02T22:53:08.742 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 54, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 170, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:08.743 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 8464, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 13, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 3378, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 21, 2024-06-02T22:53:08.744 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 3, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 3378, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3378, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 15.104818797, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004471527 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3378, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3379 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 3378, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 3378, 2024-06-02T22:53:08.745 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 2166, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 1210, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-06-02T22:53:08.746 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 1, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:08.747 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-06-02T22:53:08.748 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 99, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 2, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 5, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 6, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 1, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-06-02T22:53:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3752, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1429693, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3752, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3752, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1429693, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:08.752 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 3378, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 899, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3378, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 899, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:08.753 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 3378, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 3378, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3378, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 3378, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.754 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-06-02T22:53:08.755 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x564653c786e0": { 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:08.756 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:08.757 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-06-02T22:53:09.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:09 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:53:09.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:09 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:53:09.495 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-02T22:53:09.496 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-02T22:53:09.496 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-06-02T22:53:09.496 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-06-02T22:53:09.496 DEBUG:tasks.check_counter:Getting stats from h 2024-06-02T22:53:09.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-02T22:53:09.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:09 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T22:53:09.769 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:53:10.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:10 smithi031 ceph-mon[31767]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-06-02T22:53:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:10 smithi098 ceph-mon[36750]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-06-02T22:53:10.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:10 smithi178 ceph-mon[36614]: pgmap v996: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-06-02T22:53:11.558 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-06-02T22:53:11.558 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1581, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1572, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1233808, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 606180, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.173151380, 2024-06-02T22:53:11.559 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.064355988, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.051830408, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.046943396, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1572, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.096786455, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000061568 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:11.560 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 828592, 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 222672 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:11.561 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 4, 2024-06-02T22:53:11.562 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 276, 2024-06-02T22:53:11.562 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 876, 2024-06-02T22:53:11.562 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 617882, 2024-06-02T22:53:11.562 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.013973889, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.010469385, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.001205069, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000054214, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 274, 2024-06-02T22:53:11.563 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.015536638, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000056703 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T22:53:11.564 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 617184 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 2325, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2327, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 593316, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 739357, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:11.565 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.135383157, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.029783841, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.036953402, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.060936917, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2325, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.116682026, 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000050185 2024-06-02T22:53:11.566 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.567 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:11.568 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 5860, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.136756179, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000023337 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.570 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-06-02T22:53:11.571 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-06-02T22:53:11.572 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-06-02T22:53:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 0, 2024-06-02T22:53:11.574 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:11.575 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:11.576 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:11.577 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-06-02T22:53:11.578 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:11.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 5, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-06-02T22:53:11.580 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195729, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 4195423, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.581 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 5 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 3, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 3, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 1, 2024-06-02T22:53:11.582 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 1, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 50608, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 215420 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.583 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.584 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.585 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.586 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.588 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.589 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-06-02T22:53:11.590 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-06-02T22:53:11.591 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.592 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-06-02T22:53:11.593 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.594 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:11.596 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:11.597 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.598 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.599 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.600 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 2, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 2775, 2024-06-02T22:53:11.602 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:11.603 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:11.604 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:11.605 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:11.606 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 182082, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 49, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:11.607 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 170, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:11.608 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 8464, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 13, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-06-02T22:53:11.609 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 3533, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 21, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 3, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 3533, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3533, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 28.679661417, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.008117651 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.610 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3533, 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 3534 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 3533, 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 3533, 2024-06-02T22:53:11.611 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 2318, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 1213, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-06-02T22:53:11.612 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 1, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-06-02T22:53:11.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-06-02T22:53:11.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-06-02T22:53:11.615 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 99, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 2, 2024-06-02T22:53:11.616 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 4, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 5, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 1, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.617 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "osd-slow-ops": { 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-06-02T22:53:11.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.619 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3906, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1454277, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3906, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3906, 2024-06-02T22:53:11.620 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1454277, 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:11.621 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 3533, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 1430, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3533, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1430, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.622 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:11.623 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 3533, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 3533, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 3533, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 3533, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.624 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:11.625 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55f80a88c6e0": { 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:11.626 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-06-02T22:53:11.627 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:11.628 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-06-02T22:53:11.962 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:11.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:11.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:53:11.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:53:11.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:11.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:11 smithi098 ceph-mon[36750]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.062 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:11 smithi178 ceph-mon[36614]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-06-02T22:53:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T22:53:12.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T22:53:12.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' 2024-06-02T22:53:12.122 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:11 smithi031 ceph-mon[31767]: pgmap v997: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-06-02T22:53:12.368 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-02T22:53:12.369 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-02T22:53:12.369 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-06-02T22:53:12.369 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-06-02T22:53:12.369 DEBUG:tasks.check_counter:Getting stats from k 2024-06-02T22:53:12.369 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-02T22:53:12.605 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T22:53:14.084 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:13 smithi098 ceph-mon[36750]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-06-02T22:53:14.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:13 smithi178 ceph-mon[36614]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-06-02T22:53:14.362 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-06-02T22:53:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 373, 2024-06-02T22:53:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 366, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 799664, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 225984, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.053738857, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.019577074, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.024702277, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.008748615, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 366, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.023376704, 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000063870 2024-06-02T22:53:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 799664, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 225984 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 2, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 279, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 320, 2024-06-02T22:53:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 205200, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.014209293, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.010807197, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000823835, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 277, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.017708602, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000063929 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 205200 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-06-02T22:53:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.000202208, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000132146, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:14.370 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 148660, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 29, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:14.371 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 928, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:14.372 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 371, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 744440, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 371, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-06-02T22:53:14.373 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 371, 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 744440, 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-06-02T22:53:14.374 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-06-02T22:53:14.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:13 smithi031 ceph-mon[31767]: pgmap v998: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.2 KiB/s wr, 13 op/s 2024-06-02T22:53:15.154 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-02T22:53:15.154 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-02T22:53:15.155 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-06-02T22:53:15.155 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-06-02T22:53:15.155 DEBUG:tasks.check_counter:Getting stats from c 2024-06-02T22:53:15.155 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-02T22:53:15.487 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:53:16.213 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:15 smithi098 ceph-mon[36750]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-06-02T22:53:16.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:15 smithi178 ceph-mon[36614]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-06-02T22:53:16.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:15 smithi031 ceph-mon[31767]: pgmap v999: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-06-02T22:53:17.652 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-02T22:53:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 3100, 2024-06-02T22:53:17.652 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1920, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1537177, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 555195, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.191381297, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.068020194, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.155904354, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.017251284, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1920, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.116081714, 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000060459 2024-06-02T22:53:17.653 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3810, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000776824, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000203 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 842144, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 230048 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 29, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 304, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 7001, 2024-06-02T22:53:17.654 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 762565, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 16, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.019763340, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.011437179, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.005736672, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000147433, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 301, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.041751672, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000138709 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.655 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 28, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000004504, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000160 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 703376 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 22, 2024-06-02T22:53:17.656 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 24, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 5895, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 10260, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.003441089, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.000307287, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.002272031, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000512934, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 22, 2024-06-02T22:53:17.657 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.019711279, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000895967 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:17.658 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 56, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001780281, 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000031790 2024-06-02T22:53:17.659 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000008123, 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000004061 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.660 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 5, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 3, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.002407936, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000802645 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 2, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 11, 2024-06-02T22:53:17.661 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 34, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 11, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 23, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 18, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 4, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 3, 2024-06-02T22:53:17.662 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 69, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 48, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 21, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-02T22:53:17.663 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 1016, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 1501611507, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:17.664 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-06-02T22:53:17.665 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 105, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 63, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 63, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:17.666 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:17.667 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 6, 2024-06-02T22:53:17.668 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 6, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 2, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-02T22:53:17.669 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195954, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.012733190, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002546638 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.670 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 38, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 40, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 2, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 58, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 62, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 4, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 34, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 38, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 4, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 3, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 3, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 52432, 2024-06-02T22:53:17.671 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 223612 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 8, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 5, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 8, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 1, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-02T22:53:17.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001971728, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001971728 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.673 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000436208, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000218104 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-02T22:53:17.674 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.675 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-02T22:53:17.676 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-02T22:53:17.677 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.678 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:17.679 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.680 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 0, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 2, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 0, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 2, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 2, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 57, 2024-06-02T22:53:17.685 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:17.686 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:17.687 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 248369, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 102, 2024-06-02T22:53:17.688 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 176, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 2, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 170, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 188791, 2024-06-02T22:53:17.689 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 943, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 44, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 12267, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 33, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 44, 2024-06-02T22:53:17.690 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 44, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.280994844, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.006386246 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 44, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 68 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 44, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 0, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 44, 2024-06-02T22:53:17.691 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 10, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 5, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 8, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 6, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:17.692 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 20, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-02T22:53:17.693 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-02T22:53:17.694 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 99, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 9, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 13, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 4, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 17, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 2 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-02T22:53:17.695 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:17.696 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3147, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1242350, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3147, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3147, 2024-06-02T22:53:17.697 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1242350, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:17.698 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 44, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 12267, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 44, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 12267, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:17.699 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 44, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 44, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 44, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 44, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.700 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.701 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5577332e6500": { 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 6, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1650, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 6, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 5, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1650, 2024-06-02T22:53:17.702 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:17.703 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-02T22:53:18.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:17 smithi098 ceph-mon[36750]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-06-02T22:53:18.222 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:17 smithi178 ceph-mon[36614]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-06-02T22:53:18.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:17 smithi031 ceph-mon[31767]: pgmap v1000: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 11 op/s 2024-06-02T22:53:18.576 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-02T22:53:18.576 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-06-02T22:53:18.576 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-06-02T22:53:18.576 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=105 2024-06-02T22:53:18.576 DEBUG:tasks.check_counter:Getting stats from f 2024-06-02T22:53:18.577 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-02T22:53:18.829 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:53:20.056 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:19 smithi178 ceph-mon[36614]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-02T22:53:20.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:19 smithi098 ceph-mon[36750]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-02T22:53:20.261 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:19 smithi031 ceph-mon[31767]: pgmap v1001: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1822, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1824, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4755577, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 579406, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.171628574, 2024-06-02T22:53:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.049024491, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.046242359, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.061126100, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1822, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.081042856, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000044480 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1318, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1593, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 8471453, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 1039498, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 6, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.128803753, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.039150338, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.036106574, 2024-06-02T22:53:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.043285626, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1591, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.091516301, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000057521 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 620944 2024-06-02T22:53:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1145, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1136, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 5218325, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 468679, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 3, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 2, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.118907349, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.041343610, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.042702876, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.030754326, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1136, 2024-06-02T22:53:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.066890037, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000058882 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 829840, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 225408 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-02T22:53:20.670 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6560, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.205436315, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000031316 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.672 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 1617, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 1022, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 595, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 168, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:20.673 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 2, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-02T22:53:20.674 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 1016, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 1501623637, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:20.675 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-02T22:53:20.676 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:20.677 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-02T22:53:20.678 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 6658, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 71, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 20052086, 2024-06-02T22:53:20.679 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 20718632, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 20716980, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 6658 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 1064, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 1320, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 256, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 68, 2024-06-02T22:53:20.680 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 73, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 5, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 1617, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 1621, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 4, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 60436, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 215420 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:20.681 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:20.682 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.683 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.684 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.685 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.686 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-02T22:53:20.686 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.686 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.686 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.686 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.687 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.688 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.690 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.691 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.691 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:20.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-02T22:53:20.692 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.694 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.695 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.695 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-02T22:53:20.695 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:20.696 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 4, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 3, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 2, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-06-02T22:53:20.697 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 4490, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:20.699 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:20.700 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 228686, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 1093, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 170, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:20.701 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 3696734, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 41800, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-02T22:53:20.702 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 3903, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 26, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 4, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 3903, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3903, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 50.843144266, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.013026683 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3903, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3904 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.703 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 3903, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 3903, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 2360, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1540, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-02T22:53:20.704 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 2, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-02T22:53:20.705 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-02T22:53:20.706 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 99, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 5, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 5, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-06-02T22:53:20.707 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-02T22:53:20.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 4281, 2024-06-02T22:53:20.709 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 18037628, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 4281, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 4281, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 18037628, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:20.710 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3903, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 16528143, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3903, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 16528143, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3903, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3903, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3903, 2024-06-02T22:53:20.712 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3903, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:20.713 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x560fdf92e6e0": { 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:20.714 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:20.715 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-02T22:53:21.774 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-02T22:53:21.774 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-02T22:53:21.775 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-06-02T22:53:21.775 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-06-02T22:53:21.775 DEBUG:tasks.check_counter:Getting stats from i 2024-06-02T22:53:21.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-02T22:53:22.044 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:53:22.061 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:21 smithi178 ceph-mon[36614]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2024-06-02T22:53:22.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:21 smithi098 ceph-mon[36750]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2024-06-02T22:53:22.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:21 smithi031 ceph-mon[31767]: pgmap v1002: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2024-06-02T22:53:23.934 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2697, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1530, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 696075, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 482580, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 9, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.138277950, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.049075532, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.137091318, 2024-06-02T22:53:23.935 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.006569666, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1528, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.110277636, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000072171 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3799, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000828703, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000218 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.936 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 478, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 467, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 866693, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 294738, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.070978979, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.024181360, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.039165770, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.008876850, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 466, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.037467162, 2024-06-02T22:53:23.937 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000080401 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 102, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000026821, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000262 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 861840, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 237072 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 13, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 285, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 5285, 2024-06-02T22:53:23.938 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 625983, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.014951056, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.009800783, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.002624137, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000158845, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 284, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.040957382, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000144216 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.939 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 622832 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:23.940 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 57, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001635461, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000028692 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000008812, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000004406 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 33, 2024-06-02T22:53:23.941 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 1, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000164714, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000164714 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 32, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 11, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-02T22:53:23.942 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 34, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 11, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 23, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 18, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 4, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 1, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 1, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 3, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 98, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 42, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 32, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 24, 2024-06-02T22:53:23.943 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 1016, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 1501623637, 2024-06-02T22:53:23.944 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:23.945 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 108, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 66, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 63, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-02T22:53:23.946 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:23.947 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 5, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 5, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-02T22:53:23.948 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 2, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195729, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.013365924, 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003341481 2024-06-02T22:53:23.949 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 38, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 40, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 2, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 58, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 62, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 4, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 34, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 38, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 4, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 1, 2024-06-02T22:53:23.950 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 1, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 52704, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 223612 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 33, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 33, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 17, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.951 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.952 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1, 2024-06-02T22:53:23.953 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000164714, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000164714 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:23.954 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.956 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-02T22:53:23.957 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.958 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.959 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.960 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.961 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.962 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 1, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 1, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 987, 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:23.963 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:23.964 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:23.965 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 259569, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 118, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:23.966 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 170, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 189055, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 932, 2024-06-02T22:53:23.967 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 41, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 11938, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 33, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 41, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 41, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.364993273, 2024-06-02T22:53:23.968 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.008902274 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 41, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 64 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 41, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 0, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 41, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 0, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 10, 2024-06-02T22:53:23.969 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 4, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 7, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 6, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 20, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:23.970 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-02T22:53:23.971 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 99, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-06-02T22:53:23.972 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 9, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 13, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 4, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 16, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 0, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 1 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.973 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:23.974 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3184, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1255310, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3184, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3184, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1255310, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.975 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 41, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 11938, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 41, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 11938, 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:23.976 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 41, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 41, 2024-06-02T22:53:23.977 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 41, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 41, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:23.978 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55b0f6fea500": { 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:23.979 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 5, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1425, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 5, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 4, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1425, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:23.980 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-02T22:53:24.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:23 smithi098 ceph-mon[36750]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-06-02T22:53:24.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:23 smithi178 ceph-mon[36614]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-06-02T22:53:24.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:23 smithi031 ceph-mon[31767]: pgmap v1003: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1023 B/s wr, 11 op/s 2024-06-02T22:53:24.765 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-06-02T22:53:24.766 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-06-02T22:53:24.766 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-06-02T22:53:24.766 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=108 2024-06-02T22:53:24.766 DEBUG:tasks.check_counter:Getting stats from l 2024-06-02T22:53:24.766 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-02T22:53:25.006 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T22:53:26.137 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:25 smithi178 ceph-mon[36614]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-02T22:53:26.212 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:25 smithi098 ceph-mon[36750]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-02T22:53:26.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:25 smithi031 ceph-mon[31767]: pgmap v1004: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1613, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1606, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1242128, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 620738, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.178970973, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.057273858, 2024-06-02T22:53:26.702 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.056729855, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.053905085, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1605, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.112694867, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000070214 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 828512, 2024-06-02T22:53:26.703 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 229280 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2378, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2656, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 608175, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 1290879, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.185386129, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.064175816, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.042932369, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.065288645, 2024-06-02T22:53:26.704 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2655, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.148122924, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000055790 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 536208 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.705 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 4, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 6, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1629, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 1284, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.002778103, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.000062841, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.002317491, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000089112, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4, 2024-06-02T22:53:26.706 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.003234369, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000808592 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-06-02T22:53:26.707 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 6032, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.155468241, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000025773 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-06-02T22:53:26.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.709 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 0, 2024-06-02T22:53:26.710 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 1, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-06-02T22:53:26.711 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T22:53:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T22:53:26.713 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-06-02T22:53:26.714 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-06-02T22:53:26.715 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 5, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-06-02T22:53:26.716 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 2, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 2, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 4194304, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 4195729, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 4195423, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.717 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 5 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 3, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 3, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 1, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 1, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-06-02T22:53:26.718 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 50548, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 215420 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-06-02T22:53:26.719 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.720 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.721 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.722 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.723 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-06-02T22:53:26.724 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.725 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.725 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.726 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.726 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-06-02T22:53:26.726 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.726 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.726 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.727 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.728 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.729 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.730 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.731 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-06-02T22:53:26.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.733 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 1, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 2, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 1, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2742, 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-06-02T22:53:26.734 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T22:53:26.735 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-06-02T22:53:26.736 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 198225, 2024-06-02T22:53:26.737 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 56, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8888, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 170, 2024-06-02T22:53:26.738 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 8464, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 13, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.739 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 3608, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 3608, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3608, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 6.537888163, 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001812053 2024-06-02T22:53:26.740 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 3608, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3609 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 3608, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 3608, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-06-02T22:53:26.741 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 2368, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1238, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-06-02T22:53:26.742 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-06-02T22:53:26.743 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-06-02T22:53:26.744 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 99, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-06-02T22:53:26.745 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 2, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 6, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 9, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 3, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-06-02T22:53:26.746 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T22:53:26.747 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 3991, 2024-06-02T22:53:26.748 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1470030, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 3991, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3991, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1470030, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.749 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3608, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 1430, 2024-06-02T22:53:26.750 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3608, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1430, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:26.751 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 3608, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 3608, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 3608, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 3608, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-06-02T22:53:26.752 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.753 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55a2355b86e0": { 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-06-02T22:53:26.754 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-06-02T22:53:26.755 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-06-02T22:53:27.519 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-06-02T22:53:27.519 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-06-02T22:53:27.519 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-06-02T22:53:27.519 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-06-02T22:53:27.519 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-06-02T22:53:27.520 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-02T22:53:27.530 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-02T22:53:27.531 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:53:27.531 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:27.611 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:53:27.612 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:27.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-02T22:53:28.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:27 smithi031 ceph-mon[31767]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:53:28.147 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:28.288 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:27 smithi098 ceph-mon[36750]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:53:28.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:27 smithi178 ceph-mon[36614]: pgmap v1005: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2024-06-02T22:53:30.253 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:29 smithi031 ceph-mon[31767]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:30.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:29 smithi178 ceph-mon[36614]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:30.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:29 smithi098 ceph-mon[36750]: pgmap v1006: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 -- 172.21.15.31:0/889716680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7181030f0 msgr2=0x7ff718107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 --2- 172.21.15.31:0/889716680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7181030f0 0x7ff718107110 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff704009990 tx=0x7ff704009ca0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 -- 172.21.15.31:0/889716680 shutdown_connections 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 --2- 172.21.15.31:0/889716680 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 --2- 172.21.15.31:0/889716680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff718102740 0x7ff718102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 --2- 172.21.15.31:0/889716680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7181030f0 0x7ff718107110 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 -- 172.21.15.31:0/889716680 >> 172.21.15.31:0/889716680 conn(0x7ff7180795f0 msgr2=0x7ff718079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:30.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 -- 172.21.15.31:0/889716680 shutdown_connections 2024-06-02T22:53:30.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.752+0000 7ff71fa00700 1 -- 172.21.15.31:0/889716680 wait complete. 2024-06-02T22:53:30.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.753+0000 7ff71fa00700 1 Processor -- start 2024-06-02T22:53:30.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.753+0000 7ff71fa00700 1 -- start start 2024-06-02T22:53:30.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff718102740 0x7ff71819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 0x7ff71819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181127c0 con 0x7ff718107840 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff718112640 con 0x7ff7181030f0 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff718112940 con 0x7ff718102740 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71da00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71da00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53066/0 (socket says 172.21.15.31:53066) 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff717e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 0x7ff71819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71da00700 1 -- 172.21.15.31:0/161535364 learned_addr learned my addr 172.21.15.31:0/161535364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.754+0000 7ff71d000700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff718102740 0x7ff71819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 -- 172.21.15.31:0/161535364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff718102740 msgr2=0x7ff71819ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff718102740 0x7ff71819ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 -- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 msgr2=0x7ff71819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 -- 172.21.15.31:0/161535364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71819fe60 con 0x7ff7181030f0 2024-06-02T22:53:30.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff71da00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff717e00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 0x7ff71819b390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff7040098e0 tx=0x7ff70400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.755+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704027070 con 0x7ff7181030f0 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.756+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff70400fd10 con 0x7ff7181030f0 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.756+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7181a00f0 con 0x7ff7181030f0 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.756+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7040173f0 con 0x7ff7181030f0 2024-06-02T22:53:30.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.756+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7181a79d0 con 0x7ff7181030f0 2024-06-02T22:53:30.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.757+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff718103bd0 con 0x7ff7181030f0 2024-06-02T22:53:30.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.760+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7ff70402a070 con 0x7ff7181030f0 2024-06-02T22:53:30.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.761+0000 7ff715600700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 0x7ff7000a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:30.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.761+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7ff7040d0290 con 0x7ff7181030f0 2024-06-02T22:53:30.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.762+0000 7ff71d000700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 0x7ff7000a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:30.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.763+0000 7ff71d000700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 0x7ff7000a50e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009c60 tx=0x7ff70c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:30.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:30.765+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff70405e850 con 0x7ff7181030f0 2024-06-02T22:53:31.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.033+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7181a7ba0 con 0x7ff7181030f0 2024-06-02T22:53:31.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.033+0000 7ff715600700 1 -- 172.21.15.31:0/161535364 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v99) ==== 81+0+591 (secure 0 0 0) 0x7ff704013070 con 0x7ff7181030f0 2024-06-02T22:53:31.034 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1942203888 2024-06-03T22:22:54.073541+0000 2024-06-02T22:53:31.034 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/4252327404 2024-06-03T22:22:54.073541+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1083714701 2024-06-03T22:22:54.073541+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/228016607 2024-06-03T22:22:18.096691+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/1762120421 2024-06-03T22:22:18.096691+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2749889089 2024-06-03T22:22:18.096691+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6800/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:53:31.035 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2883761228 2024-06-03T22:22:54.073541+0000 2024-06-02T22:53:31.036 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6801/3345202686 2024-06-03T22:22:18.096691+0000 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 msgr2=0x7ff7000a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 0x7ff7000a50e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009c60 tx=0x7ff70c009260 comp rx=0 tx=0).stop 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 msgr2=0x7ff71819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 0x7ff71819b390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff7040098e0 tx=0x7ff70400b840 comp rx=0 tx=0).stop 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 shutdown_connections 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7ff7000a2c20 0x7ff7000a50e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff718107840 0x7ff71819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff718102740 0x7ff71819ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 --2- 172.21.15.31:0/161535364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7181030f0 0x7ff71819b390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:31.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 >> 172.21.15.31:0/161535364 conn(0x7ff7180795f0 msgr2=0x7ff718100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:31.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 shutdown_connections 2024-06-02T22:53:31.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:31.037+0000 7ff71fa00700 1 -- 172.21.15.31:0/161535364 wait complete. 2024-06-02T22:53:31.040 INFO:teuthology.orchestra.run.smithi031.stderr:listed 10 entries 2024-06-02T22:53:32.007 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-02T22:53:32.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /tmp/cephfs 2024-06-02T22:53:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:31 smithi178 ceph-mon[36614]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:53:32.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:31 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/161535364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:53:32.324 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:31 smithi031 ceph-mon[31767]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:53:32.325 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:31 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/161535364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:53:32.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T22:53:32.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.328 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-06-02T22:53:32.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.381 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-06-02T22:53:32.422 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-06-02T22:53:32.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-06-02T22:53:32.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:31 smithi098 ceph-mon[36750]: pgmap v1007: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-06-02T22:53:32.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:31 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/161535364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T22:53:32.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-06-02T22:53:32.657 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-02T22:53:32.657 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-06-02T22:53:32.657 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T22:53:32.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/diff,workdir=/var/lib/containers/storage/overlay/b2a0074a267db712e048aae4b4a598980a6fae76f8633327d2d1dd11f3ff76d8/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/diff,workdir=/var/lib/containers/storage/overlay/8b328599ea0677d3146dd2861d95386727a83c6d9aba7894df700a29f5183cfb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/diff,workdir=/var/lib/containers/storage/overlay/7dcd91522d347d61457d1be57f1da9808b723034523095e0e4d3bc2c02ed4663/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/diff,workdir=/var/lib/containers/storage/overlay/e249580f9f7ca4c58523b6ce9a96f38c6d60ae716756968c2849cba788dd18bb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/diff,workdir=/var/lib/containers/storage/overlay/d7dc00fd5e654fee5b36b0b63881ef5e5f75594ea8398fe62b085ee2b375de2e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/diff,workdir=/var/lib/containers/storage/overlay/7b552660bffa2894811616495066b5a238380bdd8e3b2cc8af6be02967df777f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/diff,workdir=/var/lib/containers/storage/overlay/db00690a0d58301908ce7659d722b82d03221977c7146d10394258813b4fe505/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/diff,workdir=/var/lib/containers/storage/overlay/cad1cac77d506e63f54df4ec94f79ec230a68c8b0bac6a456fe37dca4c19c976/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/diff,workdir=/var/lib/containers/storage/overlay/f2a0248d8c9f7349ca69cdb47cd4b0c9877f9bae801dd0a52b88468668aff9b8/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/UQKKEN7S727NADXI5I6BQMLSI2:/var/lib/containers/storage/overlay/l/4GGHTXNDNSMLGXB7PLAMACQVU7,upperdir=/var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/diff,workdir=/var/lib/containers/storage/overlay/0a55d8d670ff096aee54be29a9ddb06d898354e63614967a833c9012d3286e19/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 2024-06-02T22:53:32.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.703 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-06-02T22:53:32.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T22:53:32.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-06-02T22:53:32.957 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-06-02T22:53:32.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T22:53:32.963 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-02T22:53:32.973 INFO:tasks.cephadm:Teardown begin 2024-06-02T22:53:32.973 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T22:53:32.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:53:33.458 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:34.198 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:33 smithi031 ceph-mon[31767]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T22:53:34.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:33 smithi178 ceph-mon[36614]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T22:53:34.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:33 smithi098 ceph-mon[36750]: pgmap v1008: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T22:53:36.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 -- 172.21.15.31:0/1369493816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 msgr2=0x7f9ff4111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1369493816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff4111550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00b0a0 tx=0x7f9fec00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 -- 172.21.15.31:0/1369493816 shutdown_connections 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1369493816 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff4111550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1369493816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff410a680 0x7f9ff410aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1369493816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff4104680 0x7f9ff4104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 -- 172.21.15.31:0/1369493816 >> 172.21.15.31:0/1369493816 conn(0x7f9ff4100190 msgr2=0x7f9ff41025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 -- 172.21.15.31:0/1369493816 shutdown_connections 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.174+0000 7f9ffa800700 1 -- 172.21.15.31:0/1369493816 wait complete. 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.175+0000 7f9ffa800700 1 Processor -- start 2024-06-02T22:53:36.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.175+0000 7f9ffa800700 1 -- start start 2024-06-02T22:53:36.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 0x7f9ff419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff410a680 0x7f9ff419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114a00 con 0x7f9ff4105040 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114880 con 0x7f9ff4104680 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ffa800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114b80 con 0x7f9ff410a680 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ff2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ff2a00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff419b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53084/0 (socket says 172.21.15.31:53084) 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ff2a00700 1 -- 172.21.15.31:0/1752281340 learned_addr learned my addr 172.21.15.31:0/1752281340 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ff3400700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 0x7f9ff419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.176+0000 7f9ff3e00700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff410a680 0x7f9ff419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 -- 172.21.15.31:0/1752281340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff410a680 msgr2=0x7f9ff419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff410a680 0x7f9ff419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 -- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 msgr2=0x7f9ff419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 -- 172.21.15.31:0/1752281340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff419fdc0 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ff3400700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 0x7f9ff419adb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e9f0 tx=0x7f9fe400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400cb70 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.177+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff41a00b0 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.178+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe400ee90 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.178+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4003dc0 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.178+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff41a7930 con 0x7f9ff4104680 2024-06-02T22:53:36.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.179+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff4069180 con 0x7f9ff4104680 2024-06-02T22:53:36.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.181+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f9fe4003f60 con 0x7f9ff4104680 2024-06-02T22:53:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.182+0000 7f9febe00700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 0x7f9fd80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.182+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f9fe40cf540 con 0x7f9ff4104680 2024-06-02T22:53:36.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.183+0000 7f9ff2a00700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 0x7f9fd80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:36.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.183+0000 7f9ff2a00700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 0x7f9fd80a50e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009680 tx=0x7f9fe0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:36.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.187+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9fe409c0b0 con 0x7f9ff4104680 2024-06-02T22:53:36.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:35 smithi178 ceph-mon[36614]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:36.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:35 smithi031 ceph-mon[31767]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:36.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:35 smithi098 ceph-mon[36750]: pgmap v1009: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-06-02T22:53:36.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.474+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ff41a7bc0 con 0x7f9ff4104680 2024-06-02T22:53:36.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.475+0000 7f9febe00700 1 -- 172.21.15.31:0/1752281340 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f9fe409b9b0 con 0x7f9ff4104680 2024-06-02T22:53:36.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:53:36.476 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:36:52.312386+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24517,24503,24499,24484,24505]},"id":1}]} 2024-06-02T22:53:36.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 msgr2=0x7f9fd80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 0x7f9fd80a50e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009680 tx=0x7f9fe0009260 comp rx=0 tx=0).stop 2024-06-02T22:53:36.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 msgr2=0x7f9ff419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:36.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 0x7f9ff419adb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400e9f0 tx=0x7f9fe400ed00 comp rx=0 tx=0).stop 2024-06-02T22:53:36.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 shutdown_connections 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f9fd80a2c20 0x7f9fd80a50e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ff410a680 0x7f9ff419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9ff4104680 0x7f9ff419adb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 --2- 172.21.15.31:0/1752281340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ff4105040 0x7f9ff419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.478+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 >> 172.21.15.31:0/1752281340 conn(0x7f9ff4100190 msgr2=0x7f9ff4100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.479+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 shutdown_connections 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:36.479+0000 7f9ffa800700 1 -- 172.21.15.31:0/1752281340 wait complete. 2024-06-02T22:53:36.480 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 30 2024-06-02T22:53:37.230 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:36 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1752281340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:37.289 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-02T22:53:37.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:36 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1752281340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:37.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:36 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1752281340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:38.172 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:38 smithi031 ceph-mon[31767]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:38.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:38 smithi178 ceph-mon[36614]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:38.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:38 smithi098 ceph-mon[36750]: pgmap v1010: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 -- 172.21.15.31:0/652979672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406ab30 msgr2=0x7f344410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 --2- 172.21.15.31:0/652979672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406ab30 0x7f344410f320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f343c00b0a0 tx=0x7f343c00b3b0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 -- 172.21.15.31:0/652979672 shutdown_connections 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 --2- 172.21.15.31:0/652979672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406ab30 0x7f344410f320 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 --2- 172.21.15.31:0/652979672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3444108500 0x7f34441088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 --2- 172.21.15.31:0/652979672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f344406a170 0x7f344406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 -- 172.21.15.31:0/652979672 >> 172.21.15.31:0/652979672 conn(0x7f3444078340 msgr2=0x7f3444078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 -- 172.21.15.31:0/652979672 shutdown_connections 2024-06-02T22:53:40.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.177+0000 7f344ae00700 1 -- 172.21.15.31:0/652979672 wait complete. 2024-06-02T22:53:40.179 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:40 smithi031 ceph-mon[31767]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:40.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.178+0000 7f344ae00700 1 Processor -- start 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 -- start start 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 0x7f344419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3444108500 0x7f344419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3444112780 con 0x7f3444108500 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3444112600 con 0x7f344406a170 2024-06-02T22:53:40.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f344ae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3444112900 con 0x7f344406ab30 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f3448e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3444108500 0x7f344419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.179+0000 7f3443e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:53204/0 (socket says 172.21.15.31:53204) 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 -- 172.21.15.31:0/2012528205 learned_addr learned my addr 172.21.15.31:0/2012528205 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443400700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 0x7f344419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 -- 172.21.15.31:0/2012528205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 msgr2=0x7f344419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 0x7f344419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 -- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3444108500 msgr2=0x7f344419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3444108500 0x7f344419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 -- 172.21.15.31:0/2012528205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344419fdc0 con 0x7f344406a170 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443400700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 0x7f344419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T22:53:40.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.180+0000 7f3443e00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f343400e9c0 tx=0x7f343400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.181+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343400cbd0 con 0x7f344406a170 2024-06-02T22:53:40.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.181+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f343400cd70 con 0x7f344406a170 2024-06-02T22:53:40.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.181+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434010430 con 0x7f344406a170 2024-06-02T22:53:40.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.181+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34441a00b0 con 0x7f344406a170 2024-06-02T22:53:40.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.181+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34441a7930 con 0x7f344406a170 2024-06-02T22:53:40.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.182+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3444069180 con 0x7f344406a170 2024-06-02T22:53:40.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.184+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f3434004750 con 0x7f344406a170 2024-06-02T22:53:40.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.185+0000 7f3440c00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 0x7f34280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:40.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.185+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f34340cf5f0 con 0x7f344406a170 2024-06-02T22:53:40.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.186+0000 7f3443400700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 0x7f34280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:40.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.186+0000 7f3443400700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 0x7f34280a5160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3444103350 tx=0x7f3430009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:40.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.189+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f343409c160 con 0x7f344406a170 2024-06-02T22:53:40.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:40 smithi178 ceph-mon[36614]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:40.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:40 smithi098 ceph-mon[36750]: pgmap v1011: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.474+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f344419c110 con 0x7f344406a170 2024-06-02T22:53:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.475+0000 7f3440c00700 1 -- 172.21.15.31:0/2012528205 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f343409ba60 con 0x7f344406a170 2024-06-02T22:53:40.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:53:40.477 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/3658195000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":3658195000},{"type":"v1","addr":"172.21.15.31:6837","nonce":3658195000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/3988257834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3988257834},{"type":"v1","addr":"172.21.15.98:6833","nonce":3988257834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T22:31:23.645237+0000","modified":"2024-06-02T22:36:52.312386+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24517,"mds_1":24505,"mds_2":24503,"mds_3":24499,"mds_4":24484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24431":{"gid":24431,"name":"j","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.31:6835/2351522534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2351522534},{"type":"v1","addr":"172.21.15.31:6835","nonce":2351522534}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6833/1728134779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1728134779},{"type":"v1","addr":"172.21.15.178:6833","nonce":1728134779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/2455073763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":2455073763},{"type":"v1","addr":"172.21.15.98:6835","nonce":2455073763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6837/511134673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":511134673},{"type":"v1","addr":"172.21.15.98:6837","nonce":511134673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/262655409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":262655409},{"type":"v1","addr":"172.21.15.178:6835","nonce":262655409}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":4,"incarnation":26,"state":"up:active","state_seq":34,"addr":"172.21.15.178:6837/2069330007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":2069330007},{"type":"v1","addr":"172.21.15.178:6837","nonce":2069330007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":3,"incarnation":24,"state":"up:active","state_seq":32,"addr":"172.21.15.178:6839/4016839880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":4016839880},{"type":"v1","addr":"172.21.15.178:6839","nonce":4016839880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"b","rank":2,"incarnation":22,"state":"up:active","state_seq":29,"addr":"172.21.15.98:6839/2003931119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2003931119},{"type":"v1","addr":"172.21.15.98:6839","nonce":2003931119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":30,"addr":"172.21.15.31:6839/4188521464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6838","nonce":4188521464},{"type":"v1","addr":"172.21.15.31:6839","nonce":4188521464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.31:6841/3282614730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6840","nonce":3282614730},{"type":"v1","addr":"172.21.15.31:6841","nonce":3282614730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24517,"qdb_cluster":[24517,24503,24499,24484,24505]},"id":1}]} 2024-06-02T22:53:40.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 msgr2=0x7f34280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 0x7f34280a5160 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3444103350 tx=0x7f3430009260 comp rx=0 tx=0).stop 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 msgr2=0x7f344419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f343400e9c0 tx=0x7f343400ecd0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 shutdown_connections 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f34280a2ca0 0x7f34280a5160 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3444108500 0x7f344419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f344406a170 0x7f344419adb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 --2- 172.21.15.31:0/2012528205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f344406ab30 0x7f344419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 >> 172.21.15.31:0/2012528205 conn(0x7f3444078340 msgr2=0x7f344410d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.479+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 shutdown_connections 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:40.480+0000 7f344ae00700 1 -- 172.21.15.31:0/2012528205 wait complete. 2024-06-02T22:53:40.481 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 30 2024-06-02T22:53:41.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:41 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/2012528205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:41.325 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:41 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/2012528205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:41.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T22:53:41.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:41 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/2012528205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T22:53:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:42.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:42 smithi178 ceph-mon[36614]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:42.329 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:42 smithi031 ceph-mon[31767]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:42.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:42 smithi098 ceph-mon[36750]: pgmap v1012: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:44.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 -- 172.21.15.31:0/2713240078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f152410a670 msgr2=0x7f152410aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:44.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 --2- 172.21.15.31:0/2713240078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f152410a670 0x7f152410aa50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1518009990 tx=0x7f1518009ca0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 -- 172.21.15.31:0/2713240078 shutdown_connections 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 --2- 172.21.15.31:0/2713240078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1524104f80 0x7f1524111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 --2- 172.21.15.31:0/2713240078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f152410a670 0x7f152410aa50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 --2- 172.21.15.31:0/2713240078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15241045c0 0x7f1524104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 -- 172.21.15.31:0/2713240078 >> 172.21.15.31:0/2713240078 conn(0x7f1524100070 msgr2=0x7f1524102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 -- 172.21.15.31:0/2713240078 shutdown_connections 2024-06-02T22:53:44.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.152+0000 7f152aa00700 1 -- 172.21.15.31:0/2713240078 wait complete. 2024-06-02T22:53:44.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.153+0000 7f152aa00700 1 Processor -- start 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 -- start start 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 0x7f15241a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152410a670 0x7f152419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1524114910 con 0x7f15241045c0 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1524114790 con 0x7f152410a670 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f152aa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1524114a90 con 0x7f1524104f80 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f1529600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.154+0000 7f1529600700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38962/0 (socket says 172.21.15.31:38962) 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1529600700 1 -- 172.21.15.31:0/1661323129 learned_addr learned my addr 172.21.15.31:0/1661323129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 0x7f15241a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f152a000700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152410a670 0x7f152419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:44.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 -- 172.21.15.31:0/1661323129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152410a670 msgr2=0x7f152419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152410a670 0x7f152419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 -- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 msgr2=0x7f15241a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 -- 172.21.15.31:0/1661323129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152419b270 con 0x7f1524104f80 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1529600700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:44.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.155+0000 7f1528c00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 0x7f15241a0e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f151000e9f0 tx=0x7f151000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.156+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151000cbd0 con 0x7f1524104f80 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.156+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f151000cd70 con 0x7f1524104f80 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.156+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f152419b560 con 0x7f1524104f80 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.156+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510018710 con 0x7f1524104f80 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.156+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a77d0 con 0x7f1524104f80 2024-06-02T22:53:44.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.157+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f152410cb00 con 0x7f1524104f80 2024-06-02T22:53:44.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.159+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f1510010430 con 0x7f1524104f80 2024-06-02T22:53:44.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.160+0000 7f1522000700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 0x7f150c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:44.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.161+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f15100cf940 con 0x7f1524104f80 2024-06-02T22:53:44.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.161+0000 7f1529600700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 0x7f150c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:44.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.161+0000 7f1529600700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 0x7f150c0a5160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1518006010 tx=0x7f151801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:44.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.163+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f151009c4b0 con 0x7f1524104f80 2024-06-02T22:53:44.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:44 smithi178 ceph-mon[36614]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:44.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:44 smithi031 ceph-mon[31767]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.394+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f152419bff0 con 0x7f1524104f80 2024-06-02T22:53:44.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.397+0000 7f1522000700 1 -- 172.21.15.31:0/1661323129 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+24714 (secure 0 0 0) 0x7f151009bdb0 con 0x7f1524104f80 2024-06-02T22:53:44.399 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-06-02T22:53:44.400 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"52c9257e-212e-11ef-bc9b-c7b262605968","created":"2024-06-02T22:21:34.835242+0000","modified":"2024-06-02T22:32:56.484738+0000","last_up_change":"2024-06-02T22:30:01.819784+0000","last_in_change":"2024-06-02T22:29:42.341144+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T22:25:40.784938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T22:31:14.565709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T22:31:19.461562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T22:31:32.375546+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2e6dbbc-b92f-48c1-a685-7b8927abae1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6803","nonce":487181160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6805","nonce":487181160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6809","nonce":487181160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":487181160},{"type":"v1","addr":"172.21.15.31:6807","nonce":487181160}]},"public_addr":"172.21.15.31:6803/487181160","cluster_addr":"172.21.15.31:6805/487181160","heartbeat_back_addr":"172.21.15.31:6809/487181160","heartbeat_front_addr":"172.21.15.31:6807/487181160","state":["exists","up"]},{"osd":1,"uuid":"16a77b57-663a-4221-97c9-5548c8b17528","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6801","nonce":1503486625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6803","nonce":1503486625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6807","nonce":1503486625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1503486625},{"type":"v1","addr":"172.21.15.98:6805","nonce":1503486625}]},"public_addr":"172.21.15.98:6801/1503486625","cluster_addr":"172.21.15.98:6803/1503486625","heartbeat_back_addr":"172.21.15.98:6807/1503486625","heartbeat_front_addr":"172.21.15.98:6805/1503486625","state":["exists","up"]},{"osd":2,"uuid":"ce3e9128-3ac7-4e85-a8d0-5d39b8808e03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6801","nonce":2072394322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6803","nonce":2072394322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6807","nonce":2072394322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":2072394322},{"type":"v1","addr":"172.21.15.178:6805","nonce":2072394322}]},"public_addr":"172.21.15.178:6801/2072394322","cluster_addr":"172.21.15.178:6803/2072394322","heartbeat_back_addr":"172.21.15.178:6807/2072394322","heartbeat_front_addr":"172.21.15.178:6805/2072394322","state":["exists","up"]},{"osd":3,"uuid":"d77d2d54-6910-4ed7-83b0-35edc54a34d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6811","nonce":3409524597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6813","nonce":3409524597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6817","nonce":3409524597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":3409524597},{"type":"v1","addr":"172.21.15.31:6815","nonce":3409524597}]},"public_addr":"172.21.15.31:6811/3409524597","cluster_addr":"172.21.15.31:6813/3409524597","heartbeat_back_addr":"172.21.15.31:6817/3409524597","heartbeat_front_addr":"172.21.15.31:6815/3409524597","state":["exists","up"]},{"osd":4,"uuid":"947b323e-fd09-4b93-a09f-e5096507d984","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6809","nonce":4148113847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6811","nonce":4148113847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6815","nonce":4148113847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":4148113847},{"type":"v1","addr":"172.21.15.98:6813","nonce":4148113847}]},"public_addr":"172.21.15.98:6809/4148113847","cluster_addr":"172.21.15.98:6811/4148113847","heartbeat_back_addr":"172.21.15.98:6815/4148113847","heartbeat_front_addr":"172.21.15.98:6813/4148113847","state":["exists","up"]},{"osd":5,"uuid":"d33c02c1-01bb-4a7c-ab07-14be9d3bafb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6809","nonce":1564865420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6811","nonce":1564865420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6815","nonce":1564865420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1564865420},{"type":"v1","addr":"172.21.15.178:6813","nonce":1564865420}]},"public_addr":"172.21.15.178:6809/1564865420","cluster_addr":"172.21.15.178:6811/1564865420","heartbeat_back_addr":"172.21.15.178:6815/1564865420","heartbeat_front_addr":"172.21.15.178:6813/1564865420","state":["exists","up"]},{"osd":6,"uuid":"453bcd2d-d571-44c6-8bb1-dc611d2a5e0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6819","nonce":3425159606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6821","nonce":3425159606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6825","nonce":3425159606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":3425159606},{"type":"v1","addr":"172.21.15.31:6823","nonce":3425159606}]},"public_addr":"172.21.15.31:6819/3425159606","cluster_addr":"172.21.15.31:6821/3425159606","heartbeat_back_addr":"172.21.15.31:6825/3425159606","heartbeat_front_addr":"172.21.15.31:6823/3425159606","state":["exists","up"]},{"osd":7,"uuid":"6dd6941e-24c9-4b1d-8825-c33834a434da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6817","nonce":1807036424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6819","nonce":1807036424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6823","nonce":1807036424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1807036424},{"type":"v1","addr":"172.21.15.98:6821","nonce":1807036424}]},"public_addr":"172.21.15.98:6817/1807036424","cluster_addr":"172.21.15.98:6819/1807036424","heartbeat_back_addr":"172.21.15.98:6823/1807036424","heartbeat_front_addr":"172.21.15.98:6821/1807036424","state":["exists","up"]},{"osd":8,"uuid":"cc697acf-ed41-4b2d-ae99-bfe3992cd0c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6817","nonce":2113425738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6819","nonce":2113425738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6823","nonce":2113425738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2113425738},{"type":"v1","addr":"172.21.15.178:6821","nonce":2113425738}]},"public_addr":"172.21.15.178:6817/2113425738","cluster_addr":"172.21.15.178:6819/2113425738","heartbeat_back_addr":"172.21.15.178:6823/2113425738","heartbeat_front_addr":"172.21.15.178:6821/2113425738","state":["exists","up"]},{"osd":9,"uuid":"9b6fdf0f-b76f-46d2-9ec1-c693c36f7d72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6827","nonce":3616812337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6829","nonce":3616812337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6833","nonce":3616812337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":3616812337},{"type":"v1","addr":"172.21.15.31:6831","nonce":3616812337}]},"public_addr":"172.21.15.31:6827/3616812337","cluster_addr":"172.21.15.31:6829/3616812337","heartbeat_back_addr":"172.21.15.31:6833/3616812337","heartbeat_front_addr":"172.21.15.31:6831/3616812337","state":["exists","up"]},{"osd":10,"uuid":"668ead78-dca3-48e3-8096-b743361599db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6825","nonce":810778248}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6827","nonce":810778248}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6831","nonce":810778248}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":810778248},{"type":"v1","addr":"172.21.15.98:6829","nonce":810778248}]},"public_addr":"172.21.15.98:6825/810778248","cluster_addr":"172.21.15.98:6827/810778248","heartbeat_back_addr":"172.21.15.98:6831/810778248","heartbeat_front_addr":"172.21.15.98:6829/810778248","state":["exists","up"]},{"osd":11,"uuid":"fbafbaf7-677b-4af5-ad84-e68f9ab5221a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6825","nonce":2684096429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6827","nonce":2684096429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6831","nonce":2684096429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2684096429},{"type":"v1","addr":"172.21.15.178:6829","nonce":2684096429}]},"public_addr":"172.21.15.178:6825/2684096429","cluster_addr":"172.21.15.178:6827/2684096429","heartbeat_back_addr":"172.21.15.178:6831/2684096429","heartbeat_front_addr":"172.21.15.178:6829/2684096429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:24:47.976323+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:13.512655+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:25:38.034518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:12.168524+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:26:37.808861+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:03.290901+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:27:38.410630+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:05.564903+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:28:31.575962+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:06.567540+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:29:34.547756+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T22:30:00.464345+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.b","mappings":[{"from":3,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/1942203888":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6800/4252327404":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/1083714701":"2024-06-03T22:22:54.073541+0000","172.21.15.31:0/228016607":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/1762120421":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2749889089":"2024-06-03T22:22:18.096691+0000","172.21.15.31:6800/3345202686":"2024-06-03T22:22:18.096691+0000","172.21.15.31:0/2883761228":"2024-06-03T22:22:54.073541+0000","172.21.15.31:6801/3345202686":"2024-06-03T22:22:18.096691+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 msgr2=0x7f150c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 0x7f150c0a5160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1518006010 tx=0x7f151801a040 comp rx=0 tx=0).stop 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 msgr2=0x7f15241a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 0x7f15241a0e40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f151000e9f0 tx=0x7f151000ed00 comp rx=0 tx=0).stop 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 shutdown_connections 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f150c0a2ca0 0x7f150c0a5160 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f152410a670 0x7f152419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f15241045c0 0x7f15241a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 --2- 172.21.15.31:0/1661323129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1524104f80 0x7f15241a0e40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.400+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 >> 172.21.15.31:0/1661323129 conn(0x7f1524100070 msgr2=0x7f15241016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.401+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 shutdown_connections 2024-06-02T22:53:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:44.401+0000 7f152aa00700 1 -- 172.21.15.31:0/1661323129 wait complete. 2024-06-02T22:53:44.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:44 smithi098 ceph-mon[36750]: pgmap v1013: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-06-02T22:53:45.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:45 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1661323129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:53:45.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs fail cephfs 2024-06-02T22:53:45.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:45 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1661323129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:53:45.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:45 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1661323129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T22:53:45.738 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:46.241 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:46 smithi031 ceph-mon[31767]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:46.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:46 smithi178 ceph-mon[36614]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:46.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:46 smithi098 ceph-mon[36750]: pgmap v1014: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-06-02T22:53:48.175 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-mon[31767]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 -- 172.21.15.31:0/1126712062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c10eec0 msgr2=0x7f865c1112b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 --2- 172.21.15.31:0/1126712062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c10eec0 0x7f865c1112b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8654009f90 tx=0x7f865400b330 comp rx=0 tx=0).stop 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 -- 172.21.15.31:0/1126712062 shutdown_connections 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 --2- 172.21.15.31:0/1126712062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c10eec0 0x7f865c1112b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 --2- 172.21.15.31:0/1126712062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c0746c0 0x7f865c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 --2- 172.21.15.31:0/1126712062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c074fe0 0x7f865c10e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 -- 172.21.15.31:0/1126712062 >> 172.21.15.31:0/1126712062 conn(0x7f865c079560 msgr2=0x7f865c079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 -- 172.21.15.31:0/1126712062 shutdown_connections 2024-06-02T22:53:48.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.244+0000 7f8662800700 1 -- 172.21.15.31:0/1126712062 wait complete. 2024-06-02T22:53:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.246+0000 7f8662800700 1 Processor -- start 2024-06-02T22:53:48.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 -- start start 2024-06-02T22:53:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 0x7f865c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c074fe0 0x7f865c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 0x7f865c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f865c114a00 con 0x7f865c0746c0 2024-06-02T22:53:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f865c114880 con 0x7f865c074fe0 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.247+0000 7f8662800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f865c114b80 con 0x7f865c10eec0 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865b400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 0x7f865c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 0x7f865c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865b400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 0x7f865c19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38982/0 (socket says 172.21.15.31:38982) 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865b400700 1 -- 172.21.15.31:0/932234038 learned_addr learned my addr 172.21.15.31:0/932234038 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:48.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865aa00700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c074fe0 0x7f865c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 -- 172.21.15.31:0/932234038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c074fe0 msgr2=0x7f865c19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c074fe0 0x7f865c19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 -- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 msgr2=0x7f865c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 0x7f865c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.248+0000 7f865be00700 1 -- 172.21.15.31:0/932234038 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c19fdc0 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f865be00700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 0x7f865c19f680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f865c069c60 tx=0x7f865400cfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654021070 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8654007ac0 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654005040 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c1a0050 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.249+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c1a7930 con 0x7f865c10eec0 2024-06-02T22:53:48.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.251+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865c069180 con 0x7f865c10eec0 2024-06-02T22:53:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.252+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f8654024070 con 0x7f865c10eec0 2024-06-02T22:53:48.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.255+0000 7f8653e00700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 0x7f86400a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:48.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.255+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9150+0+0 (secure 0 0 0) 0x7f865400f020 con 0x7f865c10eec0 2024-06-02T22:53:48.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.255+0000 7f865b400700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 0x7f86400a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.256+0000 7f865b400700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 0x7f86400a5160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f864c005d10 tx=0x7f864c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:48.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.258+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f865402b020 con 0x7f865c10eec0 2024-06-02T22:53:48.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-mon[36614]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:48.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-mon[36750]: pgmap v1015: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-06-02T22:53:48.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.542+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f865c1a7b00 con 0x7f865c10eec0 2024-06-02T22:53:48.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.552+0000 7f8653e00700 1 -- 172.21.15.31:0/932234038 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f8654007c70 con 0x7f865c10eec0 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 msgr2=0x7f86400a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 0x7f86400a5160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f864c005d10 tx=0x7f864c009310 comp rx=0 tx=0).stop 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 msgr2=0x7f865c19f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 0x7f865c19f680 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f865c069c60 tx=0x7f865400cfa0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 shutdown_connections 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f86400a2ca0 0x7f86400a5160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865c10eec0 0x7f865c19f680 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0746c0 0x7f865c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 --2- 172.21.15.31:0/932234038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f865c074fe0 0x7f865c19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.556+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 >> 172.21.15.31:0/932234038 conn(0x7f865c079560 msgr2=0x7f865c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.557+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 shutdown_connections 2024-06-02T22:53:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:48.557+0000 7f8662800700 1 -- 172.21.15.31:0/932234038 wait complete. 2024-06-02T22:53:48.559 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-mds[68091]: -- 172.21.15.178:0/1650424098 <== mon.1 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55870c841a40 con 0x55870c814800 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: starting mds.i at 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.812 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: starting mds.f at 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: starting mds.l at 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.813 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-mds[67791]: -- 172.21.15.178:0/2166682693 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5589fad57a40 con 0x5589fad2a800 2024-06-02T22:53:48.814 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:53:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: starting mds.c at 2024-06-02T22:53:48.871 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a[31763]: 2024-06-02T22:53:48.544+0000 7f8a58e00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:53:48.872 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.872 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.872 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-mds[73557]: -- 172.21.15.31:0/1669008274 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555972f43a40 con 0x555972f16800 2024-06-02T22:53:48.872 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: starting mds.a at 2024-06-02T22:53:48.872 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-mds[73156]: -- 172.21.15.31:0/788510256 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f98bb9fa40 con 0x55f98bb73000 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: starting mds.g at 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-mds[71964]: -- 172.21.15.31:0/3140324106 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f37d5fa40 con 0x555f37d32c00 2024-06-02T22:53:48.873 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:53:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: starting mds.j at 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-mds[66261]: -- 172.21.15.98:0/3526544520 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb97bffa40 con 0x55bb97bd2c00 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: starting mds.e at 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-mds[66563]: -- 172.21.15.98:0/3603418868 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56477825fa40 con 0x564778232c00 2024-06-02T22:53:48.963 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: starting mds.h at 2024-06-02T22:53:48.964 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b[66875]: ignoring --setuser ceph since I am not root 2024-06-02T22:53:48.964 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b[66875]: ignoring --setgroup ceph since I am not root 2024-06-02T22:53:48.964 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-mds[66879]: -- 172.21.15.98:0/3645255346 <== mon.2 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557aa071da40 con 0x557aa06f0c00 2024-06-02T22:53:48.964 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:53:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b[66875]: starting mds.b at 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/932234038' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: osdmap e100: 12 total, 12 up, 12 in 2024-06-02T22:53:49.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:49 smithi178 ceph-mon[36614]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T22:53:49.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/932234038' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: osdmap e100: 12 total, 12 up, 12 in 2024-06-02T22:53:49.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:49 smithi031 ceph-mon[31767]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T22:53:49.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/932234038' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: osdmap e100: 12 total, 12 up, 12 in 2024-06-02T22:53:49.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:49 smithi098 ceph-mon[36750]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T22:53:49.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T22:53:50.068 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 921 B/s wr, 10 op/s 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6832/2262004269,v1:172.21.15.178:6833/2262004269] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6834/4001658598,v1:172.21.15.98:6835/4001658598] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6834/2768080313,v1:172.21.15.178:6835/2768080313] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6836/2253633784,v1:172.21.15.178:6837/2253633784] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6836/3632550292,v1:172.21.15.98:6838/3632550292] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.98:6837/2009290860,v1:172.21.15.98:6839/2009290860] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.178:6838/2462496532,v1:172.21.15.178:6839/2462496532] up:boot 2024-06-02T22:53:50.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6834/3543777536,v1:172.21.15.31:6835/3543777536] up:boot 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6839/237803007,v1:172.21.15.31:6841/237803007] up:boot 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: mds.? [v2:172.21.15.31:6838/1037051885,v1:172.21.15.31:6840/1037051885] up:boot 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:53:50.313 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:50 smithi178 ceph-mon[36614]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 921 B/s wr, 10 op/s 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6832/2262004269,v1:172.21.15.178:6833/2262004269] up:boot 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6834/4001658598,v1:172.21.15.98:6835/4001658598] up:boot 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6834/2768080313,v1:172.21.15.178:6835/2768080313] up:boot 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6836/2253633784,v1:172.21.15.178:6837/2253633784] up:boot 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6836/3632550292,v1:172.21.15.98:6838/3632550292] up:boot 2024-06-02T22:53:50.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.98:6837/2009290860,v1:172.21.15.98:6839/2009290860] up:boot 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.178:6838/2462496532,v1:172.21.15.178:6839/2462496532] up:boot 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6834/3543777536,v1:172.21.15.31:6835/3543777536] up:boot 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6839/237803007,v1:172.21.15.31:6841/237803007] up:boot 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: mds.? [v2:172.21.15.31:6838/1037051885,v1:172.21.15.31:6840/1037051885] up:boot 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:53:50.373 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:53:50.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:50 smithi031 ceph-mon[31767]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: pgmap v1017: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 921 B/s wr, 10 op/s 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6832/2262004269,v1:172.21.15.178:6833/2262004269] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6834/4001658598,v1:172.21.15.98:6835/4001658598] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6834/2768080313,v1:172.21.15.178:6835/2768080313] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6836/2253633784,v1:172.21.15.178:6837/2253633784] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6836/3632550292,v1:172.21.15.98:6838/3632550292] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.98:6837/2009290860,v1:172.21.15.98:6839/2009290860] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.178:6838/2462496532,v1:172.21.15.178:6839/2462496532] up:boot 2024-06-02T22:53:50.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6834/3543777536,v1:172.21.15.31:6835/3543777536] up:boot 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6839/237803007,v1:172.21.15.31:6841/237803007] up:boot 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: mds.? [v2:172.21.15.31:6838/1037051885,v1:172.21.15.31:6840/1037051885] up:boot 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T22:53:50.464 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:50 smithi098 ceph-mon[36750]: from='mgr.14152 172.21.15.31:0/1434690048' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T22:53:52.179 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:52 smithi031 ceph-mon[31767]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 9 op/s 2024-06-02T22:53:52.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:52 smithi178 ceph-mon[36614]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 9 op/s 2024-06-02T22:53:52.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:52 smithi098 ceph-mon[36750]: pgmap v1018: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 9 op/s 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 -- 172.21.15.31:0/4278695624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 msgr2=0x7f4fa406a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 --2- 172.21.15.31:0/4278695624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa406a5f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f900098f0 tx=0x7f4f90009c00 comp rx=0 tx=0).stop 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 -- 172.21.15.31:0/4278695624 shutdown_connections 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 --2- 172.21.15.31:0/4278695624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa406ab30 0x7f4fa410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 --2- 172.21.15.31:0/4278695624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa4108500 0x7f4fa41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 --2- 172.21.15.31:0/4278695624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa406a5f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:52.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 -- 172.21.15.31:0/4278695624 >> 172.21.15.31:0/4278695624 conn(0x7f4fa4078340 msgr2=0x7f4fa4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:52.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 -- 172.21.15.31:0/4278695624 shutdown_connections 2024-06-02T22:53:52.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.615+0000 7f4fabc00700 1 -- 172.21.15.31:0/4278695624 wait complete. 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.616+0000 7f4fabc00700 1 Processor -- start 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.616+0000 7f4fabc00700 1 -- start start 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 0x7f4fa419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa4108500 0x7f4fa419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4112780 con 0x7f4fa406a170 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4112600 con 0x7f4fa406ab30 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fabc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa4112900 con 0x7f4fa4108500 2024-06-02T22:53:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa9200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa9200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51014/0 (socket says 172.21.15.31:51014) 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa9200700 1 -- 172.21.15.31:0/3274005161 learned_addr learned my addr 172.21.15.31:0/3274005161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa3e00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 0x7f4fa419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa9c00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa4108500 0x7f4fa419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa3e00700 1 -- 172.21.15.31:0/3274005161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa4108500 msgr2=0x7f4fa419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.617+0000 7f4fa3e00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa4108500 0x7f4fa419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa3e00700 1 -- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 msgr2=0x7f4fa419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa3e00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:52.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa3e00700 1 -- 172.21.15.31:0/3274005161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa419fe60 con 0x7f4fa406ab30 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa3e00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 0x7f4fa419b3e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c010 tx=0x7f4f9000fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90005180 con 0x7f4fa406ab30 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa41a00f0 con 0x7f4fa406ab30 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f9000b560 con 0x7f4fa406ab30 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90003a80 con 0x7f4fa406ab30 2024-06-02T22:53:52.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.618+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa41a79d0 con 0x7f4fa406ab30 2024-06-02T22:53:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.620+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa4069180 con 0x7f4fa406ab30 2024-06-02T22:53:52.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.622+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f4f9000b710 con 0x7f4fa406ab30 2024-06-02T22:53:52.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.624+0000 7f4fa1600700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 0x7f4f8c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.624+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9580+0+0 (secure 0 0 0) 0x7f4f900d04b0 con 0x7f4fa406ab30 2024-06-02T22:53:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.624+0000 7f4fa9200700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 0x7f4f8c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.624+0000 7f4fa9200700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 0x7f4f8c0a50e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009750 tx=0x7f4f98009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.628+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4f90013030 con 0x7f4fa406ab30 2024-06-02T22:53:52.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:52.916+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4fa41a7ba0 con 0x7f4fa406ab30 2024-06-02T22:53:53.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.074+0000 7f4fa1600700 1 -- 172.21.15.31:0/3274005161 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) ==== 104+0+0 (secure 0 0 0) 0x7f4f9009cf00 con 0x7f4fa406ab30 2024-06-02T22:53:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 msgr2=0x7f4f8c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 0x7f4f8c0a50e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009750 tx=0x7f4f98009310 comp rx=0 tx=0).stop 2024-06-02T22:53:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 msgr2=0x7f4fa419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 0x7f4fa419b3e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000c010 tx=0x7f4f9000fa70 comp rx=0 tx=0).stop 2024-06-02T22:53:53.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 shutdown_connections 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f4f8c0a2c20 0x7f4f8c0a50e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa4108500 0x7f4fa419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fa406a170 0x7f4fa419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 --2- 172.21.15.31:0/3274005161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4fa406ab30 0x7f4fa419b3e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 >> 172.21.15.31:0/3274005161 conn(0x7f4fa4078340 msgr2=0x7f4fa40ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 shutdown_connections 2024-06-02T22:53:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:53.078+0000 7f4fabc00700 1 -- 172.21.15.31:0/3274005161 wait complete. 2024-06-02T22:53:53.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:53 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/3274005161' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:53.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:53 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:53 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/3274005161' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:53.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:53 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:53.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:53 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/3274005161' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:53.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:53 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T22:53:54.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 8 op/s 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: Cluster is now healthy 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:53:54.374 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:54 smithi031 ceph-mon[31767]: fsmap 12 up:standby 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 8 op/s 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: Cluster is now healthy 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:53:54.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:54 smithi098 ceph-mon[36750]: fsmap 12 up:standby 2024-06-02T22:53:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: pgmap v1019: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 8 op/s 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: Cluster is now healthy 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T22:53:54.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:54 smithi178 ceph-mon[36614]: fsmap 12 up:standby 2024-06-02T22:53:56.325 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:56 smithi031 ceph-mon[31767]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 6 op/s 2024-06-02T22:53:56.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:56 smithi098 ceph-mon[36750]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 6 op/s 2024-06-02T22:53:56.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:56 smithi178 ceph-mon[36614]: pgmap v1020: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 921 B/s wr, 6 op/s 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 -- 172.21.15.31:0/1525763521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f4074fe0 msgr2=0x7fe7f410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/1525763521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f4074fe0 0x7fe7f410e950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009990 tx=0x7fe7e0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 -- 172.21.15.31:0/1525763521 shutdown_connections 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/1525763521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f410ee90 0x7fe7f4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/1525763521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/1525763521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f4074fe0 0x7fe7f410e950 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 -- 172.21.15.31:0/1525763521 >> 172.21.15.31:0/1525763521 conn(0x7fe7f40795f0 msgr2=0x7fe7f4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 -- 172.21.15.31:0/1525763521 shutdown_connections 2024-06-02T22:53:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.939+0000 7fe7f9e00700 1 -- 172.21.15.31:0/1525763521 wait complete. 2024-06-02T22:53:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.940+0000 7fe7f9e00700 1 Processor -- start 2024-06-02T22:53:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.940+0000 7fe7f9e00700 1 -- start start 2024-06-02T22:53:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 0x7fe7f419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f410ee90 0x7fe7f419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4114a40 con 0x7fe7f4074fe0 2024-06-02T22:53:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f41148c0 con 0x7fe7f40746c0 2024-06-02T22:53:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f9e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4114bc0 con 0x7fe7f410ee90 2024-06-02T22:53:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f2a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f2a00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.31:43142/0 (socket says 172.21.15.31:43142) 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f2a00700 1 -- 172.21.15.31:0/740884892 learned_addr learned my addr 172.21.15.31:0/740884892 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f2000700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 0x7fe7f419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.941+0000 7fe7f3400700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f410ee90 0x7fe7f419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 -- 172.21.15.31:0/740884892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f410ee90 msgr2=0x7fe7f419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f410ee90 0x7fe7f419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 -- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 msgr2=0x7fe7f419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 0x7fe7f419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 -- 172.21.15.31:0/740884892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f419fef0 con 0x7fe7f40746c0 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2000700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 0x7fe7f419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.942+0000 7fe7f2a00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e9a0 tx=0x7fe7e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:56.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.943+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400ca10 con 0x7fe7f40746c0 2024-06-02T22:53:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.943+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f41a01e0 con 0x7fe7f40746c0 2024-06-02T22:53:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.943+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7e400cbb0 con 0x7fe7f40746c0 2024-06-02T22:53:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.943+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4018680 con 0x7fe7f40746c0 2024-06-02T22:53:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.943+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f41a7a60 con 0x7fe7f40746c0 2024-06-02T22:53:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.944+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f4069180 con 0x7fe7f40746c0 2024-06-02T22:53:56.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.946+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7fe7e4010430 con 0x7fe7f40746c0 2024-06-02T22:53:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.947+0000 7fe7f8a00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 0x7fe7d80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:53:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.948+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9580+0+0 (secure 0 0 0) 0x7fe7e40cfb60 con 0x7fe7f40746c0 2024-06-02T22:53:56.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.948+0000 7fe7f2000700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 0x7fe7d80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:53:56.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.948+0000 7fe7f2000700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 0x7fe7d80a5160 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00098e0 tx=0x7fe7e0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:53:56.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:56.950+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe7e409c520 con 0x7fe7f40746c0 2024-06-02T22:53:57.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:57.184+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe7f402dca0 con 0x7fe7f40746c0 2024-06-02T22:53:58.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.089+0000 7fe7f8a00700 1 -- 172.21.15.31:0/740884892 <== mon.2 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) ==== 181+0+0 (secure 0 0 0) 0x7fe7e409be20 con 0x7fe7f40746c0 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 msgr2=0x7fe7d80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 0x7fe7d80a5160 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00098e0 tx=0x7fe7e0005960 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 msgr2=0x7fe7f419af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400e9a0 tx=0x7fe7e400ecb0 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 shutdown_connections 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7fe7d80a2ca0 0x7fe7d80a5160 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7f410ee90 0x7fe7f419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7f40746c0 0x7fe7f419af30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 --2- 172.21.15.31:0/740884892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe7f4074fe0 0x7fe7f419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 >> 172.21.15.31:0/740884892 conn(0x7fe7f40795f0 msgr2=0x7fe7f40ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:53:58.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 shutdown_connections 2024-06-02T22:53:58.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:53:58.094+0000 7fe7f9e00700 1 -- 172.21.15.31:0/740884892 wait complete. 2024-06-02T22:53:58.095 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-06-02T22:53:58.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:58 smithi178 ceph-mon[36614]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-06-02T22:53:58.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:58 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/740884892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:58.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:58 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:58.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:58 smithi031 ceph-mon[31767]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-06-02T22:53:58.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:58 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/740884892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:58.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:58 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:58.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:58 smithi098 ceph-mon[36750]: pgmap v1021: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-06-02T22:53:58.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:58 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/740884892' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:58.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:58 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:53:59.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T22:53:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:59 smithi031 ceph-mon[31767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:53:59.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:53:59 smithi031 ceph-mon[31767]: osdmap e101: 12 total, 12 up, 12 in 2024-06-02T22:53:59.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:59 smithi098 ceph-mon[36750]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:53:59.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:53:59 smithi098 ceph-mon[36750]: osdmap e101: 12 total, 12 up, 12 in 2024-06-02T22:53:59.481 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:53:59.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:59 smithi178 ceph-mon[36614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:53:59.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:53:59 smithi178 ceph-mon[36614]: osdmap e101: 12 total, 12 up, 12 in 2024-06-02T22:54:00.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:00 smithi031 ceph-mon[31767]: pgmap v1023: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:00.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:00 smithi098 ceph-mon[36750]: pgmap v1023: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:00.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:00 smithi178 ceph-mon[36614]: pgmap v1023: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.973+0000 7f73cf200700 1 -- 172.21.15.31:0/1425690453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d010a670 msgr2=0x7f73d010aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.973+0000 7f73cf200700 1 --2- 172.21.15.31:0/1425690453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d010a670 0x7f73d010aa50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f73c00099c0 tx=0x7f73c0009cd0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 -- 172.21.15.31:0/1425690453 shutdown_connections 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 --2- 172.21.15.31:0/1425690453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d0104f80 0x7f73d0111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 --2- 172.21.15.31:0/1425690453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d010a670 0x7f73d010aa50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 --2- 172.21.15.31:0/1425690453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d01045c0 0x7f73d0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 -- 172.21.15.31:0/1425690453 >> 172.21.15.31:0/1425690453 conn(0x7f73d0100070 msgr2=0x7f73d0102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:01.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 -- 172.21.15.31:0/1425690453 shutdown_connections 2024-06-02T22:54:01.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.974+0000 7f73cf200700 1 -- 172.21.15.31:0/1425690453 wait complete. 2024-06-02T22:54:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.975+0000 7f73cf200700 1 Processor -- start 2024-06-02T22:54:01.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.975+0000 7f73cf200700 1 -- start start 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.975+0000 7f73cf200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d01045c0 0x7f73d01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cf200700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cf200700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d010a670 0x7f73d019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cf200700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73d0114930 con 0x7f73d0104f80 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cf200700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f73d01147b0 con 0x7f73d010a670 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cf200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f73d0114ab0 con 0x7f73d01045c0 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57814/0 (socket says 172.21.15.31:57814) 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 -- 172.21.15.31:0/1241755002 learned_addr learned my addr 172.21.15.31:0/1241755002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cde00700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d01045c0 0x7f73d01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:01.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73ce800700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d010a670 0x7f73d019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 -- 172.21.15.31:0/1241755002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d01045c0 msgr2=0x7f73d01a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d01045c0 0x7f73d01a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 -- 172.21.15.31:0/1241755002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d010a670 msgr2=0x7f73d019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d010a670 0x7f73d019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.976+0000 7f73cd400700 1 -- 172.21.15.31:0/1241755002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d019b250 con 0x7f73d0104f80 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73cd400700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00e9a0 tx=0x7f73bc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00ca10 con 0x7f73d0104f80 2024-06-02T22:54:01.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73bc00cbb0 con 0x7f73d0104f80 2024-06-02T22:54:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d019b540 con 0x7f73d0104f80 2024-06-02T22:54:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc018680 con 0x7f73d0104f80 2024-06-02T22:54:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.977+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d01a7800 con 0x7f73d0104f80 2024-06-02T22:54:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.978+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d0069180 con 0x7f73d0104f80 2024-06-02T22:54:01.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.981+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f73bc010430 con 0x7f73d0104f80 2024-06-02T22:54:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.983+0000 7f73c6a00700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 0x7f73b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.983+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9055+0+0 (secure 0 0 0) 0x7f73bc0cfac0 con 0x7f73d0104f80 2024-06-02T22:54:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.983+0000 7f73cde00700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 0x7f73b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.984+0000 7f73cde00700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 0x7f73b40a50e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f73c0000c00 tx=0x7f73c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:01.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:01.985+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f73bc09c690 con 0x7f73d0104f80 2024-06-02T22:54:02.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:02.219+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73d01a7a30 con 0x7f73d0104f80 2024-06-02T22:54:02.219 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:02 smithi031 ceph-mon[31767]: pgmap v1024: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:02.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:02 smithi098 ceph-mon[36750]: pgmap v1024: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:02.561 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:02 smithi178 ceph-mon[36614]: pgmap v1024: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:03.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.112+0000 7f73c6a00700 1 -- 172.21.15.31:0/1241755002 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) ==== 169+0+0 (secure 0 0 0) 0x7f73bc09bf90 con 0x7f73d0104f80 2024-06-02T22:54:03.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 msgr2=0x7f73b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:03.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 0x7f73b40a50e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f73c0000c00 tx=0x7f73c0005fb0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 msgr2=0x7f73d01a0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00e9a0 tx=0x7f73bc00ecb0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 shutdown_connections 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f73b40a2c20 0x7f73b40a50e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f73d010a670 0x7f73d019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.117+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73d01045c0 0x7f73d01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.118+0000 7f73cf200700 1 --2- 172.21.15.31:0/1241755002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73d0104f80 0x7f73d01a0e70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:03.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.118+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 >> 172.21.15.31:0/1241755002 conn(0x7f73d0100070 msgr2=0x7f73d01015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:03.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.118+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 shutdown_connections 2024-06-02T22:54:03.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:03.118+0000 7f73cf200700 1 -- 172.21.15.31:0/1241755002 wait complete. 2024-06-02T22:54:03.119 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-06-02T22:54:03.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:03 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:03.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:03 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:03.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:03 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:04.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-02T22:54:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:04 smithi031 ceph-mon[31767]: pgmap v1025: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:04 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:04.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:04 smithi031 ceph-mon[31767]: osdmap e102: 12 total, 12 up, 12 in 2024-06-02T22:54:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:04 smithi098 ceph-mon[36750]: pgmap v1025: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:04.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:04 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:04.463 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:04 smithi098 ceph-mon[36750]: osdmap e102: 12 total, 12 up, 12 in 2024-06-02T22:54:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:04 smithi178 ceph-mon[36614]: pgmap v1025: 97 pgs: 97 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:04 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1241755002' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:04.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:04 smithi178 ceph-mon[36614]: osdmap e102: 12 total, 12 up, 12 in 2024-06-02T22:54:04.582 INFO:teuthology.orchestra.run.smithi031.stderr:Inferring config /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T22:54:06.371 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:06 smithi031 ceph-mon[31767]: pgmap v1027: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:06.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:06 smithi098 ceph-mon[36750]: pgmap v1027: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:06.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:06 smithi178 ceph-mon[36614]: pgmap v1027: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:07.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.126+0000 7f1ff8e00700 1 -- 172.21.15.31:0/183213423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff41024e0 msgr2=0x7f1ff4102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.126+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/183213423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff41024e0 0x7f1ff4102940 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009990 tx=0x7f1fe0009ca0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 -- 172.21.15.31:0/183213423 shutdown_connections 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/183213423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4102e80 0x7f1ff410f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/183213423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff4108650 0x7f1ff4108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/183213423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff41024e0 0x7f1ff4102940 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 -- 172.21.15.31:0/183213423 >> 172.21.15.31:0/183213423 conn(0x7f1ff40795f0 msgr2=0x7f1ff4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 -- 172.21.15.31:0/183213423 shutdown_connections 2024-06-02T22:54:07.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.127+0000 7f1ff8e00700 1 -- 172.21.15.31:0/183213423 wait complete. 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.128+0000 7f1ff8e00700 1 Processor -- start 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.128+0000 7f1ff8e00700 1 -- start start 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.128+0000 7f1ff8e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff8e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff4102e80 0x7f1ff4074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff8e00700 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4108650 0x7f1ff4075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff8e00700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff41127f0 con 0x7f1ff41024e0 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff8e00700 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4112670 con 0x7f1ff4108650 2024-06-02T22:54:07.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff8e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4112970 con 0x7f1ff4102e80 2024-06-02T22:54:07.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:07.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57838/0 (socket says 172.21.15.31:57838) 2024-06-02T22:54:07.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 -- 172.21.15.31:0/1489281472 learned_addr learned my addr 172.21.15.31:0/1489281472 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-06-02T22:54:07.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff2800700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4108650 0x7f1ff4075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:07.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1400700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff4102e80 0x7f1ff4074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 -- 172.21.15.31:0/1489281472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff4102e80 msgr2=0x7f1ff4074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff4102e80 0x7f1ff4074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 -- 172.21.15.31:0/1489281472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4108650 msgr2=0x7f1ff4075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4108650 0x7f1ff4075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.129+0000 7f1ff1e00700 1 -- 172.21.15.31:0/1489281472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff41a71f0 con 0x7f1ff41024e0 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1ff1e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9a0 tx=0x7f1fe400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:07.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400ca10 con 0x7f1ff41024e0 2024-06-02T22:54:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fe400cbb0 con 0x7f1ff41024e0 2024-06-02T22:54:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff41a74e0 con 0x7f1ff41024e0 2024-06-02T22:54:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4018680 con 0x7f1ff41024e0 2024-06-02T22:54:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.130+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff41a7a70 con 0x7f1ff41024e0 2024-06-02T22:54:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.132+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff4069180 con 0x7f1ff41024e0 2024-06-02T22:54:07.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.134+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 137833+0+0 (secure 0 0 0) 0x7f1fe4010430 con 0x7f1ff41024e0 2024-06-02T22:54:07.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.136+0000 7f1feaa00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 0x7f1fd80a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T22:54:07.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.136+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8496+0+0 (secure 0 0 0) 0x7f1fe40cf2b0 con 0x7f1ff41024e0 2024-06-02T22:54:07.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.136+0000 7f1ff1400700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 0x7f1fd80a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T22:54:07.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.137+0000 7f1ff1400700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 0x7f1fd80a5160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4079c80 tx=0x7f1fe000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T22:54:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.140+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1fe409c0d0 con 0x7f1ff41024e0 2024-06-02T22:54:07.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:07.377+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1ff402dca0 con 0x7f1ff41024e0 2024-06-02T22:54:08.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.135+0000 7f1feaa00700 1 -- 172.21.15.31:0/1489281472 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v103) ==== 178+0+0 (secure 0 0 0) 0x7f1fe409b9d0 con 0x7f1ff41024e0 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.139+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 msgr2=0x7f1fd80a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.139+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 0x7f1fd80a5160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4079c80 tx=0x7f1fe000b260 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.139+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 msgr2=0x7f1ff4074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.139+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9a0 tx=0x7f1fe400ecb0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 shutdown_connections 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:6800/784266653,v1:172.21.15.31:6801/784266653] conn(0x7f1fd80a2ca0 0x7f1fd80a5160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ff4108650 0x7f1ff4075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ff41024e0 0x7f1ff4074790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 --2- 172.21.15.31:0/1489281472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ff4102e80 0x7f1ff4074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 >> 172.21.15.31:0/1489281472 conn(0x7f1ff40795f0 msgr2=0x7f1ff41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T22:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 shutdown_connections 2024-06-02T22:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-06-02T22:54:08.140+0000 7f1ff8e00700 1 -- 172.21.15.31:0/1489281472 wait complete. 2024-06-02T22:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' removed 2024-06-02T22:54:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:08 smithi098 ceph-mon[36750]: pgmap v1028: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:08.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:08 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:08.520 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:08 smithi031 ceph-mon[31767]: pgmap v1028: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:08.520 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:08 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:08 smithi178 ceph-mon[36614]: pgmap v1028: 33 pgs: 33 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:08.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:08 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T22:54:08.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:54:09.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:54:09.223 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:54:09.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:09 smithi031 ceph-mon[31767]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:09.372 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:09 smithi031 ceph-mon[31767]: osdmap e103: 12 total, 12 up, 12 in 2024-06-02T22:54:09.419 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:09 smithi178 ceph-mon[36614]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:09.419 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:09 smithi178 ceph-mon[36614]: osdmap e103: 12 total, 12 up, 12 in 2024-06-02T22:54:09.421 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-02T22:54:09.421 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T22:54:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:09 smithi098 ceph-mon[36750]: from='client.? 172.21.15.31:0/1489281472' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T22:54:09.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:09 smithi098 ceph-mon[36750]: osdmap e103: 12 total, 12 up, 12 in 2024-06-02T22:54:09.499 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T22:54:09.514 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T22:54:09.529 INFO:tasks.cephadm:Stopping all daemons... 2024-06-02T22:54:09.530 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-02T22:54:09.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a 2024-06-02T22:54:09.872 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:09 smithi031 systemd[1]: Stopping Ceph mon.a for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:10.462 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:10 smithi098 ceph-mon[36750]: pgmap v1030: 1 pgs: 1 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:10.562 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:10 smithi178 ceph-mon[36614]: pgmap v1030: 1 pgs: 1 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:10.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:10 smithi031 ceph-mon[31767]: pgmap v1030: 1 pgs: 1 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T22:54:10.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a[31763]: 2024-06-02T22:54:10.248+0000 7f8a5fc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:10.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a[31763]: 2024-06-02T22:54:10.248+0000 7f8a5fc00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-02T22:54:10.622 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:10 smithi031 podman[100316]: 2024-06-02 22:54:10.299163363 +0000 UTC m=+0.219641705 container died 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-02T22:54:11.851 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:11 smithi031 podman[100316]: 2024-06-02 22:54:11.586810065 +0000 UTC m=+1.507288419 container cleanup 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-02T22:54:11.851 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:11 smithi031 bash[100316]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a 2024-06-02T22:54:12.121 INFO:journalctl@ceph.mon.a.smithi031.stdout:Jun 02 22:54:11 smithi031 podman[100328]: 2024-06-02 22:54:11.849746269 +0000 UTC m=+1.538837731 container remove 5ed4a58e04a69db672c49c0d093a0944ef1c7229085ff8c7aa20c89be72eef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T22:54:12.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-02T22:54:12.630 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:12.630 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-02T22:54:12.630 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-02T22:54:12.630 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.b 2024-06-02T22:54:12.963 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:12 smithi098 systemd[1]: Stopping Ceph mon.b for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:13.459 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b[36746]: 2024-06-02T22:54:12.982+0000 7f6ed157d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:13.459 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b[36746]: 2024-06-02T22:54:12.982+0000 7f6ed157d700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-02T22:54:13.460 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:13 smithi098 podman[72685]: 2024-06-02 22:54:13.126491277 +0000 UTC m=+0.271697890 container died 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:54:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:13 smithi098 podman[72685]: 2024-06-02 22:54:13.567766317 +0000 UTC m=+0.712972921 container cleanup 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-02T22:54:13.712 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:13 smithi098 bash[72685]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b 2024-06-02T22:54:14.066 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-02T22:54:14.086 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:13 smithi098 podman[72697]: 2024-06-02 22:54:13.836238861 +0000 UTC m=+0.706239876 container remove 480b3f60b0f5bda7a4520f8a20253301f8facb80ffe134ad5421dadad5fffc1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-b, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-02T22:54:14.086 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:14 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.b.service: Deactivated successfully. 2024-06-02T22:54:14.086 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:14 smithi098 systemd[1]: Stopped Ceph mon.b for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:54:14.087 INFO:journalctl@ceph.mon.b.smithi098.stdout:Jun 02 22:54:14 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.b.service: Consumed 17.573s CPU time. 2024-06-02T22:54:14.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:14.113 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-02T22:54:14.113 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-02T22:54:14.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.c 2024-06-02T22:54:14.454 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:14 smithi178 systemd[1]: Stopping Ceph mon.c for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:14.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c[36596]: 2024-06-02T22:54:14.453+0000 7fd77db2b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:14.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c[36596]: 2024-06-02T22:54:14.453+0000 7fd77db2b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-02T22:54:14.812 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:14 smithi178 podman[74305]: 2024-06-02 22:54:14.6584377 +0000 UTC m=+0.333240715 container died 0db558e3df7ca2a50d258b0a65bc64807c1bc99b15416ef736d25f909844215f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:54:15.311 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:15 smithi178 podman[74305]: 2024-06-02 22:54:15.054764111 +0000 UTC m=+0.729567131 container cleanup 0db558e3df7ca2a50d258b0a65bc64807c1bc99b15416ef736d25f909844215f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:54:15.312 INFO:journalctl@ceph.mon.c.smithi178.stdout:Jun 02 22:54:15 smithi178 bash[74305]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mon-c 2024-06-02T22:54:15.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-02T22:54:15.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:15.534 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-02T22:54:15.534 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-02T22:54:15.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T22:54:15.871 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:15 smithi031 systemd[1]: Stopping Ceph mgr.x for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:16.621 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:54:16.278+0000 7fa87e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:16.622 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x[31996]: 2024-06-02T22:54:16.278+0000 7fa87e200700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-02T22:54:16.622 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:16 smithi031 podman[100517]: 2024-06-02 22:54:16.381436704 +0000 UTC m=+0.371737223 container died 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-02T22:54:17.622 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:17 smithi031 podman[100517]: 2024-06-02 22:54:17.229733315 +0000 UTC m=+1.220033848 container cleanup 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-02T22:54:17.622 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:17 smithi031 bash[100517]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x 2024-06-02T22:54:17.622 INFO:journalctl@ceph.mgr.x.smithi031.stdout:Jun 02 22:54:17 smithi031 podman[100529]: 2024-06-02 22:54:17.464310975 +0000 UTC m=+1.062595982 container remove 1c55eec3fbd5b2e06e57e0f364aa31f9ee022378d4f0c88c0a27bc2445ef55d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-x, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.33.5) 2024-06-02T22:54:18.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-02T22:54:18.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:18.123 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-02T22:54:18.123 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-02T22:54:18.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.y 2024-06-02T22:54:18.462 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:54:18 smithi098 systemd[1]: Stopping Ceph mgr.y for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:18.800 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:54:18 smithi098 podman[72808]: 2024-06-02 22:54:18.485838026 +0000 UTC m=+0.154475310 container died 641c20844e4d61d18b6ae4bad484314d1eaf360645551a8e94dbb858cfba169e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-02T22:54:19.141 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:54:18 smithi098 podman[72808]: 2024-06-02 22:54:18.873742274 +0000 UTC m=+0.542379549 container cleanup 641c20844e4d61d18b6ae4bad484314d1eaf360645551a8e94dbb858cfba169e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-02T22:54:19.141 INFO:journalctl@ceph.mgr.y.smithi098.stdout:Jun 02 22:54:18 smithi098 bash[72808]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-y 2024-06-02T22:54:19.294 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-02T22:54:19.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:19.328 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-02T22:54:19.328 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-02T22:54:19.328 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.z 2024-06-02T22:54:19.672 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:54:19 smithi178 systemd[1]: Stopping Ceph mgr.z for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:19.965 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:54:19 smithi178 podman[74444]: 2024-06-02 22:54:19.67246884 +0000 UTC m=+0.142008535 container died 3bdf1f1f5e3e1c7af703e851bc6d8092641286a2e084647f1c93456539572621 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-02T22:54:20.312 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:54:20 smithi178 podman[74444]: 2024-06-02 22:54:20.060689408 +0000 UTC m=+0.530229046 container cleanup 3bdf1f1f5e3e1c7af703e851bc6d8092641286a2e084647f1c93456539572621 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-02T22:54:20.312 INFO:journalctl@ceph.mgr.z.smithi178.stdout:Jun 02 22:54:20 smithi178 bash[74444]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mgr-z 2024-06-02T22:54:20.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-02T22:54:20.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:20.543 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-02T22:54:20.543 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-02T22:54:20.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.0 2024-06-02T22:54:21.121 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:20 smithi031 systemd[1]: Stopping Ceph osd.0 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:21.622 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0[46129]: 2024-06-02T22:54:21.199+0000 7fc35ea00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:21.622 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0[46129]: 2024-06-02T22:54:21.199+0000 7fc35ea00700 -1 osd.0 103 *** Got signal Terminated *** 2024-06-02T22:54:21.622 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0[46129]: 2024-06-02T22:54:21.199+0000 7fc35ea00700 -1 osd.0 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:54:27.516 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:27 smithi031 podman[100639]: 2024-06-02 22:54:27.164563 +0000 UTC m=+6.127033753 container died 19fa8304113af59fd6964f5bc0196ffa516042418eb154bfdd5ad043584388f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True) 2024-06-02T22:54:27.871 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:27 smithi031 podman[100639]: 2024-06-02 22:54:27.710162259 +0000 UTC m=+6.672633006 container cleanup 19fa8304113af59fd6964f5bc0196ffa516042418eb154bfdd5ad043584388f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T22:54:27.871 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:27 smithi031 bash[100639]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0 2024-06-02T22:54:28.371 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:27 smithi031 podman[100657]: 2024-06-02 22:54:27.894792319 +0000 UTC m=+0.712132617 container remove 19fa8304113af59fd6964f5bc0196ffa516042418eb154bfdd5ad043584388f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, ceph=True) 2024-06-02T22:54:29.035 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:28 smithi031 podman[100749]: 2024-06-02 22:54:28.67250166 +0000 UTC m=+0.038900583 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:54:29.035 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:28 smithi031 podman[100749]: 2024-06-02 22:54:28.83765215 +0000 UTC m=+0.204051107 container create a3bf870ff88e9e59b000d8d15d554b6abb55fcdf21ec60d6bc1c3088f59e3f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-02T22:54:29.333 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:29 smithi031 podman[100749]: 2024-06-02 22:54:29.199840914 +0000 UTC m=+0.566239931 container init a3bf870ff88e9e59b000d8d15d554b6abb55fcdf21ec60d6bc1c3088f59e3f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-02T22:54:29.333 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:29 smithi031 podman[100749]: 2024-06-02 22:54:29.21373618 +0000 UTC m=+0.580135135 container start a3bf870ff88e9e59b000d8d15d554b6abb55fcdf21ec60d6bc1c3088f59e3f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-02T22:54:29.333 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:29 smithi031 podman[100749]: 2024-06-02 22:54:29.331986449 +0000 UTC m=+0.698385413 container attach a3bf870ff88e9e59b000d8d15d554b6abb55fcdf21ec60d6bc1c3088f59e3f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True) 2024-06-02T22:54:30.372 INFO:journalctl@ceph.osd.0.smithi031.stdout:Jun 02 22:54:30 smithi031 podman[100749]: 2024-06-02 22:54:30.119030708 +0000 UTC m=+1.485429699 container died a3bf870ff88e9e59b000d8d15d554b6abb55fcdf21ec60d6bc1c3088f59e3f32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-02T22:54:30.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-02T22:54:31.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:31.111 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-02T22:54:31.112 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-02T22:54:31.112 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.1 2024-06-02T22:54:31.436 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:31 smithi098 systemd[1]: Stopping Ceph osd.1 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:31.703 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1[41300]: 2024-06-02T22:54:31.436+0000 7f7315f80700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:31.704 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1[41300]: 2024-06-02T22:54:31.436+0000 7f7315f80700 -1 osd.1 103 *** Got signal Terminated *** 2024-06-02T22:54:31.704 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1[41300]: 2024-06-02T22:54:31.436+0000 7f7315f80700 -1 osd.1 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:54:37.386 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:37 smithi098 podman[72933]: 2024-06-02 22:54:37.061606665 +0000 UTC m=+5.752309754 container died 54487b007583836bc3cc94d82869a6fa87095756757fca7d9ff6b414772cfca7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T22:54:37.712 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:37 smithi098 podman[72933]: 2024-06-02 22:54:37.387103745 +0000 UTC m=+6.077806837 container cleanup 54487b007583836bc3cc94d82869a6fa87095756757fca7d9ff6b414772cfca7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:54:37.713 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:37 smithi098 bash[72933]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1 2024-06-02T22:54:37.713 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:37 smithi098 podman[72963]: 2024-06-02 22:54:37.62246977 +0000 UTC m=+0.555350109 container remove 54487b007583836bc3cc94d82869a6fa87095756757fca7d9ff6b414772cfca7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T22:54:38.367 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:37.941704284 +0000 UTC m=+0.017182989 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:54:38.368 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:38.073691886 +0000 UTC m=+0.149170596 container create f6461b1e66f2221f3ddbf93fa0322f7f347cda472d0c9ea78d511731acc45b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:54:38.368 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:38.368681226 +0000 UTC m=+0.444159923 container init f6461b1e66f2221f3ddbf93fa0322f7f347cda472d0c9ea78d511731acc45b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True) 2024-06-02T22:54:38.713 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:38.371976814 +0000 UTC m=+0.447455508 container start f6461b1e66f2221f3ddbf93fa0322f7f347cda472d0c9ea78d511731acc45b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T22:54:38.713 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:38.477075159 +0000 UTC m=+0.552553858 container attach f6461b1e66f2221f3ddbf93fa0322f7f347cda472d0c9ea78d511731acc45b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-02T22:54:39.096 INFO:journalctl@ceph.osd.1.smithi098.stdout:Jun 02 22:54:38 smithi098 podman[73055]: 2024-06-02 22:54:38.724353579 +0000 UTC m=+0.799832271 container died f6461b1e66f2221f3ddbf93fa0322f7f347cda472d0c9ea78d511731acc45b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T22:54:39.404 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-02T22:54:39.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:39.445 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-02T22:54:39.445 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-02T22:54:39.446 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.2 2024-06-02T22:54:39.771 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:39 smithi178 systemd[1]: Stopping Ceph osd.2 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:40.062 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2[41728]: 2024-06-02T22:54:39.771+0000 7ff76cade700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:40.062 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2[41728]: 2024-06-02T22:54:39.771+0000 7ff76cade700 -1 osd.2 103 *** Got signal Terminated *** 2024-06-02T22:54:40.062 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2[41728]: 2024-06-02T22:54:39.771+0000 7ff76cade700 -1 osd.2 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:54:45.562 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:45 smithi178 podman[74569]: 2024-06-02 22:54:45.30553295 +0000 UTC m=+5.663211105 container died 770ec441a93e93d537c0578687398ef212fc6ae96b7588280d7ea42489bc38c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-02T22:54:45.996 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:45 smithi178 podman[74569]: 2024-06-02 22:54:45.688630698 +0000 UTC m=+6.046308837 container cleanup 770ec441a93e93d537c0578687398ef212fc6ae96b7588280d7ea42489bc38c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-02T22:54:45.997 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:45 smithi178 bash[74569]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2 2024-06-02T22:54:46.312 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:45 smithi178 podman[74584]: 2024-06-02 22:54:45.997496875 +0000 UTC m=+0.682124690 container remove 770ec441a93e93d537c0578687398ef212fc6ae96b7588280d7ea42489bc38c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-02T22:54:46.577 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.216681553 +0000 UTC m=+0.017121512 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:54:46.577 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.341269788 +0000 UTC m=+0.141709735 container create 3e8c2a2c45f0eebb44eeed09d59364d21483949a719d59d90d27dc3852c70c17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2-deactivate, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-02T22:54:46.577 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.577466687 +0000 UTC m=+0.377906634 container init 3e8c2a2c45f0eebb44eeed09d59364d21483949a719d59d90d27dc3852c70c17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-02T22:54:46.934 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.581122999 +0000 UTC m=+0.381562956 container start 3e8c2a2c45f0eebb44eeed09d59364d21483949a719d59d90d27dc3852c70c17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-02T22:54:46.934 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.694351593 +0000 UTC m=+0.494791558 container attach 3e8c2a2c45f0eebb44eeed09d59364d21483949a719d59d90d27dc3852c70c17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-02T22:54:47.247 INFO:journalctl@ceph.osd.2.smithi178.stdout:Jun 02 22:54:46 smithi178 podman[74674]: 2024-06-02 22:54:46.935140531 +0000 UTC m=+0.735580490 container died 3e8c2a2c45f0eebb44eeed09d59364d21483949a719d59d90d27dc3852c70c17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T22:54:47.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-02T22:54:47.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:47.623 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-02T22:54:47.623 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-02T22:54:47.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.3 2024-06-02T22:54:48.121 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:47 smithi031 systemd[1]: Stopping Ceph osd.3 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:48.203+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:48.608 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:48.261+0000 7f23d8400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:48.608 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:48.261+0000 7f23d8400700 -1 osd.3 103 *** Got signal Terminated *** 2024-06-02T22:54:48.608 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:48.261+0000 7f23d8400700 -1 osd.3 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:54:48.872 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:48 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:48.607+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:49.062 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:48.910+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:49.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:48.887+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:49.234+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:49.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:49 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:49.612+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:50.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:49.857+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:50.311 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:50.195+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:50.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:49.953+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:51.121 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:50 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:50.640+0000 7f23cec00700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:25.984333+0000 front 2024-06-02T22:54:25.984760+0000 (oldest deadline 2024-06-02T22:54:50.084377+0000) 2024-06-02T22:54:51.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:50 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:50.646+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:51.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:50.905+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:51.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:51.003+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:51.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:51.204+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:52.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:51.628+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:52.121 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:51 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:51.670+0000 7f23cec00700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:25.984333+0000 front 2024-06-02T22:54:25.984760+0000 (oldest deadline 2024-06-02T22:54:50.084377+0000) 2024-06-02T22:54:52.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:51.921+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:52.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:51.956+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:52.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:52.155+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:53.053 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:52.672+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:53.053 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:52 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3[53075]: 2024-06-02T22:54:52.664+0000 7f23cec00700 -1 osd.3 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:25.984333+0000 front 2024-06-02T22:54:25.984760+0000 (oldest deadline 2024-06-02T22:54:50.084377+0000) 2024-06-02T22:54:53.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:52.930+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:53.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:52.936+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:53.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:53.125+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:53.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:53.051+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:54.033 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:53 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:53.707+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:54.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:53.897+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:54.311 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:53.961+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:54.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:54.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:54.371 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:54 smithi031 podman[100865]: 2024-06-02 22:54:54.269418512 +0000 UTC m=+6.168971179 container died 985758f104b4018c5ceb0dcfa4c9a9e173418340986c12e74316d82a8b00b466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-02T22:54:54.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:54.032+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:54.871 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:54 smithi031 podman[100865]: 2024-06-02 22:54:54.730801241 +0000 UTC m=+6.630353898 container cleanup 985758f104b4018c5ceb0dcfa4c9a9e173418340986c12e74316d82a8b00b466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-02T22:54:54.871 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:54 smithi031 bash[100865]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3 2024-06-02T22:54:54.872 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:54.702+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:55.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:54.860+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:55.311 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:54.970+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:55.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:55.114+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:55.371 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:54 smithi031 podman[100884]: 2024-06-02 22:54:54.973741718 +0000 UTC m=+0.692420110 container remove 985758f104b4018c5ceb0dcfa4c9a9e173418340986c12e74316d82a8b00b466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528) 2024-06-02T22:54:55.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:54 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:54.989+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:56.023 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:55 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:55.676+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:56.024 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:55 smithi031 podman[100972]: 2024-06-02 22:54:55.720297372 +0000 UTC m=+0.041701881 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:54:56.024 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:55 smithi031 podman[100972]: 2024-06-02 22:54:55.916189574 +0000 UTC m=+0.237594076 container create e856166b2971fbfb7a319a8a9404aeeca732dd171a59749ef1893404ecb3ce52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-02T22:54:56.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:55.845+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:56.311 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:55.944+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:56.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:56.157+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:56.368 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:56 smithi031 podman[100972]: 2024-06-02 22:54:56.261628762 +0000 UTC m=+0.583033361 container init e856166b2971fbfb7a319a8a9404aeeca732dd171a59749ef1893404ecb3ce52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-02T22:54:56.368 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:56 smithi031 podman[100972]: 2024-06-02 22:54:56.273766673 +0000 UTC m=+0.595171209 container start e856166b2971fbfb7a319a8a9404aeeca732dd171a59749ef1893404ecb3ce52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-02T22:54:56.369 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:56.023+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:56.621 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:56 smithi031 podman[100972]: 2024-06-02 22:54:56.368946294 +0000 UTC m=+0.690350873 container attach e856166b2971fbfb7a319a8a9404aeeca732dd171a59749ef1893404ecb3ce52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-02T22:54:57.000 INFO:journalctl@ceph.osd.3.smithi031.stdout:Jun 02 22:54:56 smithi031 podman[100997]: 2024-06-02 22:54:56.807641867 +0000 UTC m=+0.036986592 container died e856166b2971fbfb7a319a8a9404aeeca732dd171a59749ef1893404ecb3ce52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD) 2024-06-02T22:54:57.001 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:56 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:56.648+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:57.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:56 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:56.885+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:57.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:56.960+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:57.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:57.146+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:57.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:57.000+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:57.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-02T22:54:57.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:54:57.791 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-02T22:54:57.791 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-02T22:54:57.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.4 2024-06-02T22:54:57.993 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:57.634+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:58.125 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:54:57 smithi098 systemd[1]: Stopping Ceph osd.4 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:54:58.125 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:57 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:57.838+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:58.126 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:57 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:57.838+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:54:58.276 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:57.969+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:58.277 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:58.117+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:58.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:57.993+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:58.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:57 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:57.993+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:54:58.462 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:54:58 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:54:58.125+0000 7ffabbdf7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:54:58.463 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:54:58 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:54:58.125+0000 7ffabbdf7700 -1 osd.4 103 *** Got signal Terminated *** 2024-06-02T22:54:58.463 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:54:58 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:54:58.126+0000 7ffabbdf7700 -1 osd.4 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:54:58.978 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:58 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:58.628+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:58.979 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:58 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:58.628+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:54:59.145 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:58.921+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:54:59.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:58 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:58.832+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:54:59.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:58 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:58.832+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:54:59.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:58 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:58.978+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:54:59.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:58 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:58.978+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:54:59.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:54:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:54:59.145+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:54:59.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:59.594+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:54:59.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:54:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:54:59.594+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:00.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:59 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:59.815+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:00.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:54:59 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:54:59.815+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:00.234 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:54:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:54:59.892+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:00.235 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:00.121+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:00.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:59.993+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:00.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:54:59 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:54:59.994+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:00.561 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:00.234+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:00.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:00 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:00.567+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:00.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:00 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:00.567+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:01.113 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:00 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:55:00.995+0000 7ffab43e3700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:34.925039+0000 front 2024-06-02T22:54:34.925060+0000 (oldest deadline 2024-06-02T22:55:00.725793+0000) 2024-06-02T22:55:01.114 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:00 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:00.838+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:01.114 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:00 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:00.838+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:01.157 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:00.863+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:01.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:01.043+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:01.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:01.043+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:01.158+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:01.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:01.257+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:01.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:01.552+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:01.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:01 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:01.552+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:02.185 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:01.912+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:02.185 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:01.912+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:02.212 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:01 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:55:01.950+0000 7ffab43e3700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:34.925039+0000 front 2024-06-02T22:54:34.925060+0000 (oldest deadline 2024-06-02T22:55:00.725793+0000) 2024-06-02T22:55:02.213 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:02 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:02.088+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:02.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:01 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:01.849+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:02.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:01 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:01.849+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:02.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:02.085+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:02.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:02.085+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:02.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:02.185+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:02.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:02.210+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:02.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:02.531+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:02.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:02 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:02.531+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:03.122 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:02 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4[47798]: 2024-06-02T22:55:02.962+0000 7ffab43e3700 -1 osd.4 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:34.925039+0000 front 2024-06-02T22:54:34.925060+0000 (oldest deadline 2024-06-02T22:55:00.725793+0000) 2024-06-02T22:55:03.123 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:02 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:02.817+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:03.123 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:02 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:02.817+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:03.229 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:02.894+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:03.229 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:02.894+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:03.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:03 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:03.081+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:03.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:03 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:03.081+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:03.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:03 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:03.122+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:03.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:03.233+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:03.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:03.229+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:03.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:03 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:03.578+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:03.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:03 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:03.578+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:03.962 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:03 smithi098 podman[73161]: 2024-06-02 22:55:03.693089393 +0000 UTC m=+5.706317189 container died af175ccf4b213694c17b27f2c2748dd7e47589db894863d7da04e353899c17d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-06-02T22:55:03.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:03 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:03.793+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:03.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:03 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:03.793+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:04.189 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:03.919+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:04.189 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:03.919+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:04.343 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:04 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:04.101+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:04.344 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73161]: 2024-06-02 22:55:04.076176145 +0000 UTC m=+6.089403942 container cleanup af175ccf4b213694c17b27f2c2748dd7e47589db894863d7da04e353899c17d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-02T22:55:04.344 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 bash[73161]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4 2024-06-02T22:55:04.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:04 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:04.064+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:04.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:04 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:04.064+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:04.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:04.259+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:04.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:04.189+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:04.691 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73177]: 2024-06-02 22:55:04.344669131 +0000 UTC m=+0.648813381 container remove af175ccf4b213694c17b27f2c2748dd7e47589db894863d7da04e353899c17d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-02T22:55:04.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:04 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:04.537+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:04.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:04 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:04.537+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:04.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:04 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:04.750+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:04.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:04 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:04.750+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:04.963 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73265]: 2024-06-02 22:55:04.595377809 +0000 UTC m=+0.016897137 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:04.963 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73265]: 2024-06-02 22:55:04.720606208 +0000 UTC m=+0.142125532 container create 2e443af24a2742165cab5ccc834eb29bf4086d93a8d377fac51f5ee0b8c9e2c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-02T22:55:05.208 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:04.940+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:05.208 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:04.940+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:05.281 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:05 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:05.120+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:05.281 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73265]: 2024-06-02 22:55:04.982754108 +0000 UTC m=+0.404273445 container init 2e443af24a2742165cab5ccc834eb29bf4086d93a8d377fac51f5ee0b8c9e2c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:55:05.281 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:04 smithi098 podman[73265]: 2024-06-02 22:55:04.986249206 +0000 UTC m=+0.407768539 container start 2e443af24a2742165cab5ccc834eb29bf4086d93a8d377fac51f5ee0b8c9e2c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-02T22:55:05.281 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:05 smithi098 podman[73265]: 2024-06-02 22:55:05.081689797 +0000 UTC m=+0.503209145 container attach 2e443af24a2742165cab5ccc834eb29bf4086d93a8d377fac51f5ee0b8c9e2c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4-deactivate, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:55:05.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:05 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:05.017+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:05.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:05 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:05.017+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:05.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:05 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:05.291+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:05.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:05 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:05.208+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:05.651 INFO:journalctl@ceph.osd.4.smithi098.stdout:Jun 02 22:55:05 smithi098 podman[73265]: 2024-06-02 22:55:05.282135167 +0000 UTC m=+0.703654504 container died 2e443af24a2742165cab5ccc834eb29bf4086d93a8d377fac51f5ee0b8c9e2c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-02T22:55:05.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:05 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:05.572+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:05.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:05 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:05.572+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:05.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:05 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:05.786+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:05.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:05 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:05.786+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:05.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-02T22:55:06.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:06.024 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-02T22:55:06.024 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-02T22:55:06.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.5 2024-06-02T22:55:06.166 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:05 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:05.892+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:06.166 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:05 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:05.892+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:06.166 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 systemd[1]: Stopping Ceph osd.5 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:06.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:06.043+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:06.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:06.043+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:06.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:06.043+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:06.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:06 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:06.115+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:06.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:06.285+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:06.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:06.165+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:06.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:06.165+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:06.562 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.317+0000 7f111a374700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:06.562 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.317+0000 7f111a374700 -1 osd.5 103 *** Got signal Terminated *** 2024-06-02T22:55:06.563 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.317+0000 7f111a374700 -1 osd.5 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:06.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:06.570+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:06.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:06.570+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:06.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:06 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:06.570+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:07.085 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:06 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:06.737+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:07.085 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:06 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:06.737+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:07.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:07.117+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:07.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:07.117+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:07.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.904+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:07.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.904+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:07.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:06 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:06.904+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.520698+0000 front 2024-06-02T22:54:41.520720+0000 (oldest deadline 2024-06-02T22:55:06.820873+0000) 2024-06-02T22:55:07.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:07.080+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:07.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:07.080+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:07.372 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:07.080+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:07.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:07 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:07.085+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:07.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:07 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:07.085+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:07.811 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:07.325+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:07.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:07.555+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:07.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:07.555+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:07.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:07.555+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:08.127 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:07 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:07.748+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:08.129 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:07 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:07.748+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:08.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:08.120+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:08.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:08.120+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:08.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:07.900+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:08.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:07.900+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:08.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:07 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:07.900+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.520698+0000 front 2024-06-02T22:54:41.520720+0000 (oldest deadline 2024-06-02T22:55:06.820873+0000) 2024-06-02T22:55:08.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:08.116+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:08.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:08.116+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:08.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:08.116+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:08.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:08 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:08.126+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:08.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:08 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:08.126+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:08.812 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:08.328+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:08.812 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:08.328+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:08.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:08.530+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:08.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:08.530+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:08.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:08 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:08.530+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:09.135 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:08 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:08.743+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:09.136 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:08 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:08.743+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:09.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:09.169+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:09.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:09.169+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:09.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:08.935+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:09.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:08.935+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:09.312 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:08 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:08.935+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.520698+0000 front 2024-06-02T22:54:41.520720+0000 (oldest deadline 2024-06-02T22:55:06.820873+0000) 2024-06-02T22:55:09.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:09 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:09.135+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:09.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:09 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:09.135+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:09.522 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:09.149+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:09.522 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:09.149+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:09.522 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:09.149+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:09.811 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:09.314+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:09.812 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:09.314+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:09.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:09.522+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:09.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:09.522+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:09.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:09 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:09.522+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:10.176 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:09 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:09.736+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:10.176 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:09 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:09.736+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:10.176 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:09 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:09.736+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:10.283 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:10.126+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:10.284 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:10.126+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:10.284 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:09.889+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:10.284 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:09.889+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:10.284 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:09 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:09.889+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.520698+0000 front 2024-06-02T22:54:41.520720+0000 (oldest deadline 2024-06-02T22:55:06.820873+0000) 2024-06-02T22:55:10.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:10 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:10.176+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:10.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:10 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:10.176+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:10.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:10.283+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:10.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:10.283+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:10.572 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:10.156+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:10.572 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:10.156+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:10.572 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:10.156+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:10.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:10.572+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:10.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:10.572+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:10.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:10.572+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:10.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:10 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:10.709+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:10.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:10 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:10.709+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:10.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:10 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:10.709+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:11.102 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:10.843+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:20.517527+0000 front 2024-06-02T22:54:20.517820+0000 (oldest deadline 2024-06-02T22:54:48.717480+0000) 2024-06-02T22:55:11.102 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:10.843+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.220151+0000 front 2024-06-02T22:54:36.220091+0000 (oldest deadline 2024-06-02T22:55:01.520187+0000) 2024-06-02T22:55:11.102 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:10 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5[48635]: 2024-06-02T22:55:10.843+0000 7f1112960700 -1 osd.5 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.520698+0000 front 2024-06-02T22:54:41.520720+0000 (oldest deadline 2024-06-02T22:55:06.820873+0000) 2024-06-02T22:55:11.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:11 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:11.153+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:11.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:11 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:11.153+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:11.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:11 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:11.102+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:11.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:11 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:11.102+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:11.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:11 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:11.264+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:11.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:11 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:11.264+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:11.577 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:11.160+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:11.577 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:11.160+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:11.577 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:11.160+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:11.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:11.577+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:11.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:11.577+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:11.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:11 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:11.577+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:12.116 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:11 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:11.739+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:12.116 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:11 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:11.739+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:12.117 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:11 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:11.739+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:12.151 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:11 smithi178 podman[74791]: 2024-06-02 22:55:11.85663495 +0000 UTC m=+5.632605889 container died 50d8b9e03ef012f926c7963bf2b0d694357fa4f74f39ea4057c733adb915dedb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-02T22:55:12.151 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:12 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:12.091+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:12.151 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:12 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:12.091+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:12.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:12.116+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:12.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:12.116+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:12.535 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:12 smithi178 podman[74791]: 2024-06-02 22:55:12.267233471 +0000 UTC m=+6.043204401 container cleanup 50d8b9e03ef012f926c7963bf2b0d694357fa4f74f39ea4057c733adb915dedb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:55:12.535 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:12 smithi178 bash[74791]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5 2024-06-02T22:55:12.535 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:12 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:12.275+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:12.535 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:12 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:12.275+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:12.597 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:12.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:12.597 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:12.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:12.597 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:12.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:12.811 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:12 smithi178 podman[74810]: 2024-06-02 22:55:12.535484846 +0000 UTC m=+0.675002147 container remove 50d8b9e03ef012f926c7963bf2b0d694357fa4f74f39ea4057c733adb915dedb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-02T22:55:12.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:12.597+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:12.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:12.597+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:12.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:12 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:12.597+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:13.147 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:12.722+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:13.147 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:12.722+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:13.147 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:12 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:12.722+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:13.205 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:13 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:13.043+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:13.205 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:13 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:13.043+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:13.205 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:12 smithi178 podman[74899]: 2024-06-02 22:55:12.845578005 +0000 UTC m=+0.017078349 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:13.205 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:12 smithi178 podman[74899]: 2024-06-02 22:55:12.944759163 +0000 UTC m=+0.116259505 container create 14d599d5064dfe512c38b50bf0e993e482215f806074022416430f33d0600fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T22:55:13.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:13.107+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:13.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:13.107+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:13.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:13.107+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:13.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:13 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:13.146+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:13.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:13 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:13.146+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:13.502 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:13 smithi178 podman[74899]: 2024-06-02 22:55:13.205748712 +0000 UTC m=+0.377249041 container init 14d599d5064dfe512c38b50bf0e993e482215f806074022416430f33d0600fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:55:13.502 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:13 smithi178 podman[74899]: 2024-06-02 22:55:13.209537168 +0000 UTC m=+0.381037511 container start 14d599d5064dfe512c38b50bf0e993e482215f806074022416430f33d0600fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-06-02T22:55:13.502 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:13 smithi178 podman[74899]: 2024-06-02 22:55:13.305927283 +0000 UTC m=+0.477427639 container attach 14d599d5064dfe512c38b50bf0e993e482215f806074022416430f33d0600fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T22:55:13.502 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:13 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:13.314+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:13.502 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:13 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:13.314+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:13.811 INFO:journalctl@ceph.osd.5.smithi178.stdout:Jun 02 22:55:13 smithi178 podman[74899]: 2024-06-02 22:55:13.50321138 +0000 UTC m=+0.674711735 container died 14d599d5064dfe512c38b50bf0e993e482215f806074022416430f33d0600fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc) 2024-06-02T22:55:13.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:13.603+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:13.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:13.603+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:13.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:13 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:13.603+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:14.186 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:14.071+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:14.186 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:14.071+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:14.187 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:13 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:13.743+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:14.188 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:13 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:13.743+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:14.188 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:13 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:13.743+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:14.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-02T22:55:14.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:14.251 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-02T22:55:14.251 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-02T22:55:14.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.6 2024-06-02T22:55:14.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:14.187+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:14.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:14.187+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:14.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:14.267+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:14.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:14 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:14.267+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:14.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.134+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:14.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.134+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:14.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.134+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:14.622 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 systemd[1]: Stopping Ceph osd.6 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:14.948 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.850+0000 7f17e3000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:14.948 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.850+0000 7f17e3000700 -1 osd.6 103 *** Got signal Terminated *** 2024-06-02T22:55:14.948 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:14.850+0000 7f17e3000700 -1 osd.6 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:14.949 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:14.646+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:14.949 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:14.646+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:14.949 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:14.646+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:15.208 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:14.723+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:15.209 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:14.723+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:15.209 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:14.723+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:15.209 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:14 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:14.723+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:15.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:15.129+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:15.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:15.129+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:15.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:15.129+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:15.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:15.208+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:15.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:15.208+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:15.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:15.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:15.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:15.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:15.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:15.294+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:15.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:15 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:15.294+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:16.118 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:15.660+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:16.119 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:15.660+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:16.119 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:15 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:15.660+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:16.161 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:15.738+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:16.161 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:15.738+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:16.161 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:15.738+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:16.161 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:15 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:15.738+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:16.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:16.118+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:16.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:16.118+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:16.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:16.118+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:16.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:16.161+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:16.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:16.161+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:16.463 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:16.065+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:16.463 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:16.065+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:16.463 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:16.065+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:16.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:16.305+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:16.464 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:16.305+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:16.464 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:16 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:16.305+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:16.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:16.704+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:16.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:16.704+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:16.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:16.704+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:16.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:16 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:16.704+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:17.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:16.685+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:17.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:16.685+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:17.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:16 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:16.685+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:17.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:17.042+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:17.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:17.042+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:17.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:17.042+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:17.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:17.291+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:17.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:17.291+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:17.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:17 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:17.291+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:17.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:17.180+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:17.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:17.180+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:17.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:17.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:17.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:17.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:17.622 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:17.123+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:18.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:17.684+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:18.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:17.684+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:18.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:17 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:17.684+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:18.176 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:17.730+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:18.177 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:17.730+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:18.177 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:17.730+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:18.177 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:17 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:17.730+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:18.301 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:18.000+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:18.301 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:18.000+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:18.301 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:18.000+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:18.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:18.176+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:18.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:18.176+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:18.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:18.176+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:18.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:18.301+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:18.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:18.301+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:18.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:18 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:18.301+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:18.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:18.144+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:18.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:18.144+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:18.621 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:18.144+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:18.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:18.681+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:18.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:18.681+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:18.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:18.681+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:18.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:18 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:18.681+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:19.095 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:18.683+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:19.095 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:18.683+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:19.095 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:18.683+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:19.279 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:19.026+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:19.279 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:19.026+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:19.279 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:19.026+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:19.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:19.095+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:23.370181+0000 front 2024-06-02T22:54:23.370251+0000 (oldest deadline 2024-06-02T22:54:52.771750+0000) 2024-06-02T22:55:19.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:19.095+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:36.274893+0000 front 2024-06-02T22:54:36.274831+0000 (oldest deadline 2024-06-02T22:54:57.975046+0000) 2024-06-02T22:55:19.371 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6[60014]: 2024-06-02T22:55:19.095+0000 7f17de800700 -1 osd.6 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:40.778932+0000 front 2024-06-02T22:54:40.778878+0000 (oldest deadline 2024-06-02T22:55:05.478395+0000) 2024-06-02T22:55:19.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:19.126+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:19.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:19.126+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:19.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:19.126+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:19.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:19.279+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:19.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:19.279+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:19.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:19 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:19.279+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:20.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:19.697+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:20.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:19.697+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:20.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:19.697+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:20.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:19 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:19.697+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:20.130 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:19.725+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:20.130 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:19.725+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:20.130 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:19.725+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:20.130 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:19 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:19.725+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:20.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:20.130+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:20.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:20.130+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:20.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:20.130+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:20.062+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:20.062+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:20.062+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:20.252+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:20.252+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:20.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:20 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:20.252+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:21.121 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:20 smithi031 podman[101077]: 2024-06-02 22:55:20.837969371 +0000 UTC m=+6.139945117 container died 8739b8559632ee8f21ba940311e5988ae29a9e884a77d66f190ab1fb40c2aef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-06-02T22:55:21.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:20 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:20.718+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:21.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:20 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:20.718+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:21.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:20 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:20.718+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:21.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:20 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:20.718+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:21.151 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:20.766+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:21.152 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:20.766+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:21.152 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:20.766+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:21.152 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:20 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:20.766+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:21.052+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:21.052+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:21.052+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:21.293+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:21.293+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:21.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:21 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:21.293+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:21.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:21.151+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:21.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:21.151+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:21.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:21.151+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:21.743 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:21 smithi031 podman[101077]: 2024-06-02 22:55:21.483930467 +0000 UTC m=+6.785906261 container cleanup 8739b8559632ee8f21ba940311e5988ae29a9e884a77d66f190ab1fb40c2aef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-02T22:55:21.743 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:21 smithi031 bash[101077]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6 2024-06-02T22:55:22.121 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:21 smithi031 podman[101105]: 2024-06-02 22:55:21.751840984 +0000 UTC m=+0.900932208 container remove 8739b8559632ee8f21ba940311e5988ae29a9e884a77d66f190ab1fb40c2aef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-02T22:55:22.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:21.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:22.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:21.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:22.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:21.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:22.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:21 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:21.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:22.173 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:21.806+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:22.173 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:21.806+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:22.173 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:21.807+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:22.173 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:21 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:21.807+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:22.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:22.173+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:22.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:22.173+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:22.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:22.173+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:22.066+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:22.066+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:22.066+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:22.284+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:22.284+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:22.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:22 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:22.284+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:23.059 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:22 smithi031 podman[101196]: 2024-06-02 22:55:22.578866495 +0000 UTC m=+0.035570282 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:23.060 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:22 smithi031 podman[101196]: 2024-06-02 22:55:22.727778521 +0000 UTC m=+0.184482323 container create 13ae00619107300ce0ef0832403197e0a071172c2c611609baf3a084427fb275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-02T22:55:23.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:22 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:22.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:23.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:22 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:22.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:23.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:22 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:22.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:23.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:22 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:22.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:23.188 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:22.822+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:23.241 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:22.822+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:23.241 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:22.822+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:23.241 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:22.822+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:23.325 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:23 smithi031 podman[101196]: 2024-06-02 22:55:23.189639139 +0000 UTC m=+0.646342961 container init 13ae00619107300ce0ef0832403197e0a071172c2c611609baf3a084427fb275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-02T22:55:23.326 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:23 smithi031 podman[101196]: 2024-06-02 22:55:23.201034316 +0000 UTC m=+0.657738125 container start 13ae00619107300ce0ef0832403197e0a071172c2c611609baf3a084427fb275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-02T22:55:23.326 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:23 smithi031 podman[101196]: 2024-06-02 22:55:23.325240336 +0000 UTC m=+0.781944178 container attach 13ae00619107300ce0ef0832403197e0a071172c2c611609baf3a084427fb275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-02T22:55:23.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:23.188+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:23.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:23.188+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:23.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:23.188+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:23.090+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:23.090+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:23.090+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:23.277+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:23.277+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:23.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:23 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:23.277+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:24.038 INFO:journalctl@ceph.osd.6.smithi031.stdout:Jun 02 22:55:23 smithi031 podman[101196]: 2024-06-02 22:55:23.673071817 +0000 UTC m=+1.129775659 container died 13ae00619107300ce0ef0832403197e0a071172c2c611609baf3a084427fb275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-02T22:55:24.039 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:23 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:23.751+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:24.039 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:23 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:23.751+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:24.039 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:23 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:23.751+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:24.039 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:23 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:23.751+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:24.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:23.805+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:24.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:23.805+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:24.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:23.805+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:24.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:23 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:23.805+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:24.526 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-02T22:55:24.561 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:24.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:24.561 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:24.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:24.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:24.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:24.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:24.272+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:24.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:24.272+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:24.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:24 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:24.272+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:24.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:24.638 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-02T22:55:24.638 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-02T22:55:24.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.7 2024-06-02T22:55:24.663 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.236+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:24.663 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.236+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:24.664 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.236+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:24.664 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.236+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 systemd[1]: Stopping Ceph osd.7 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:24.801+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:24.801+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:24.801+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:24.801+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:24.949 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:24.801+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:25.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:24.771+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:25.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:24.771+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:25.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:24.771+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:25.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:24 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:24.771+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:25.212 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.948+0000 7f4c4ac5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:25.212 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.948+0000 7f4c4ac5b700 -1 osd.7 103 *** Got signal Terminated *** 2024-06-02T22:55:25.212 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:24 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:24.948+0000 7f4c4ac5b700 -1 osd.7 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:25.561 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:25.114+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:25.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:25.114+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:25.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:25.114+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:25.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:25.236+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:25.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:25.236+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:25.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:25 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:25.236+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:25.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:25.243+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:25.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:25.243+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:25.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:25.243+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:25.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:25.243+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:26.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:25 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:25.815+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:26.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:25 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:25.815+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:26.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:25 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:25.815+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:26.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:25 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:25.815+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:26.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:25.772+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:26.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:25.772+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:26.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:25.772+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:26.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:25.772+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:26.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:25.772+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:26.187+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:26.187+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:26.187+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:26.129+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:26.129+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:26.129+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:26.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:26 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:26.129+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:26.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:26.230+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:26.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:26.230+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:26.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:26.230+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:26.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:26.230+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:27.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:26.823+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:27.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:26.823+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:27.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:26.823+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:27.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:26 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:26.823+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:27.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:26.775+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:27.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:26.775+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:27.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:26.775+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:27.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:26.775+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:27.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:26 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:26.775+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:27.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:27.098+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:27.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:27.098+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:27.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:27.098+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:27.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:27.098+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:27.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:27.216+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:27.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:27.216+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:27.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:27.216+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:27.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:27 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:27.216+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:27.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:27.234+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:27.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:27.234+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:27.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:27.234+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:27.713 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:27.234+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:28.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:27 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:27.785+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:28.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:27 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:27.785+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:28.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:27 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:27.785+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:28.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:27 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:27.785+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:28.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:27 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:27.785+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:28.206 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:27.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:28.206 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:27.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:28.206 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:27.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:28.206 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:27.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:28.206 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:27 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:27.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:28.462 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:28.205+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:28.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:28.205+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:28.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:28.205+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:28.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:28.205+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:28.085+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:28.085+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:28.085+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:28.085+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:28.201+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:28.201+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:28.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:28.201+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:28.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:28 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:28.201+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:28.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:28.693+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:28.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:28.693+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:28.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:28.693+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:28.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:28.693+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:28.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:28 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:28.693+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:29.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:28 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:28.833+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:29.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:28 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:28.833+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:29.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:28 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:28.833+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:29.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:28 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:28.833+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:29.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:28 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:28.833+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:29.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:29.193+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.266738+0000 front 2024-06-02T22:54:31.266693+0000 (oldest deadline 2024-06-02T22:55:01.267527+0000) 2024-06-02T22:55:29.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:29.193+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:41.268182+0000 front 2024-06-02T22:54:41.268288+0000 (oldest deadline 2024-06-02T22:55:06.568311+0000) 2024-06-02T22:55:29.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:29.193+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:52.469681+0000 front 2024-06-02T22:54:52.469578+0000 (oldest deadline 2024-06-02T22:55:17.670146+0000) 2024-06-02T22:55:29.463 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7[54805]: 2024-06-02T22:55:29.193+0000 7f4c4724f700 -1 osd.7 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.772258+0000 front 2024-06-02T22:55:02.772297+0000 (oldest deadline 2024-06-02T22:55:23.872546+0000) 2024-06-02T22:55:29.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:29.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:29.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:29.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:29.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:29.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:29.563 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:29.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:29.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:29.194+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:29.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:29.194+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:29.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:29.194+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:29.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:29 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:29.194+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:30.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:29 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:29.802+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:30.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:29 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:29.802+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:30.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:29 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:29.802+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:30.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:29 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:29.802+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:30.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:29 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:29.802+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:30.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:29.729+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:30.212 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:29.729+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:30.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:29.729+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:30.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:29.729+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:30.213 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:29.729+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:30.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:30.063+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:30.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:30.063+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:30.063+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:30.063+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:30.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:30.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:30.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:30.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:30 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:30.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:30.792 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:30 smithi098 podman[73371]: 2024-06-02 22:55:30.487277202 +0000 UTC m=+5.653113631 container died 7d484908dd82fc1a12fa03f5898109605994e4a82321e5210eec9ccca399226e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0) 2024-06-02T22:55:30.792 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:30 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:30.702+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:30.792 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:30 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:30.702+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:30.792 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:30 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:30.702+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:30.792 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:30 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:30.702+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:30.793 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:30 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:30.702+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:31.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:30 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:30.817+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:31.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:30 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:30.817+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:31.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:30 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:30.817+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:31.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:30 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:30.817+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:31.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:30 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:30.817+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:31.134 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:30 smithi098 podman[73371]: 2024-06-02 22:55:30.891498724 +0000 UTC m=+6.057335144 container cleanup 7d484908dd82fc1a12fa03f5898109605994e4a82321e5210eec9ccca399226e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-02T22:55:31.134 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:30 smithi098 bash[73371]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7 2024-06-02T22:55:31.447 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73388]: 2024-06-02 22:55:31.134807805 +0000 UTC m=+0.651912328 container remove 7d484908dd82fc1a12fa03f5898109605994e4a82321e5210eec9ccca399226e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:31.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:31.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:31.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:31.086+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:31.149+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:31.149+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:31.149+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:31.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:31 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:31.149+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:31.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73478]: 2024-06-02 22:55:31.350570523 +0000 UTC m=+0.017218914 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:31.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73478]: 2024-06-02 22:55:31.485553138 +0000 UTC m=+0.152201516 container create 8eab026cf01490a5906ab595e86be6a4efb476379f507f5470a4bde3fe78a3c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-06-02T22:55:31.712 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73478]: 2024-06-02 22:55:31.713187261 +0000 UTC m=+0.379835642 container init 8eab026cf01490a5906ab595e86be6a4efb476379f507f5470a4bde3fe78a3c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-02T22:55:31.962 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73478]: 2024-06-02 22:55:31.716263527 +0000 UTC m=+0.382911904 container start 8eab026cf01490a5906ab595e86be6a4efb476379f507f5470a4bde3fe78a3c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:31 smithi098 podman[73478]: 2024-06-02 22:55:31.83009835 +0000 UTC m=+0.496746754 container attach 8eab026cf01490a5906ab595e86be6a4efb476379f507f5470a4bde3fe78a3c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:31.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:31.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:31.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:31.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:31.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:31 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:31.734+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:32.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:31.794+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:32.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:31.794+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:32.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:31.794+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:32.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:31.794+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:32.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:31 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:31.794+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:32.288 INFO:journalctl@ceph.osd.7.smithi098.stdout:Jun 02 22:55:32 smithi098 podman[73478]: 2024-06-02 22:55:32.014828112 +0000 UTC m=+0.681476493 container died 8eab026cf01490a5906ab595e86be6a4efb476379f507f5470a4bde3fe78a3c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:55:32.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:32.081+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:32.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:32.081+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:32.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:32.081+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:32.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:32.081+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:32.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:32.111+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:32.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:32.111+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:32.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:32.111+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:32.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:32 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:32.111+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:32.658 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-02T22:55:32.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:32.736 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-02T22:55:32.736 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-02T22:55:32.736 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.8 2024-06-02T22:55:32.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:32 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:32.686+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:32.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:32 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:32.686+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:32.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:32 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:32.686+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:32.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:32 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:32.686+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:32.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:32 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:32.686+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:33.046 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:32 smithi178 systemd[1]: Stopping Ceph osd.8 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:33.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:32 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:32.747+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:33.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:32 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:32.747+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:33.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:32 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:32.747+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:33.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:32 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:32.747+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:33.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:32 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:32.747+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:33.112+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:33.112+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:33.112+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:33.112+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.046+0000 7fbb781c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.046+0000 7fbb781c6700 -1 osd.8 103 *** Got signal Terminated *** 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.046+0000 7fbb781c6700 -1 osd.8 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:33.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.096+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:33.313 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.096+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:33.313 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.096+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:33.313 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.096+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:33.313 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:33 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:33.096+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.122039+0000 front 2024-06-02T22:55:11.122066+0000 (oldest deadline 2024-06-02T22:55:32.822143+0000) 2024-06-02T22:55:33.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:33.638+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:33.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:33.638+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:33.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:33.638+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:33.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:33.638+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:33.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:33.638+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:34.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:34.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:34.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:34.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:34.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:34.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:33 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:33.741+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:34.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:34.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:34.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:34.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:34.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:34.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:34.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:34.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:34.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:34.107+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.122039+0000 front 2024-06-02T22:55:11.122066+0000 (oldest deadline 2024-06-02T22:55:32.822143+0000) 2024-06-02T22:55:34.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:34.090+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:34.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:34.090+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:34.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:34.090+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:34.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:34.090+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:34.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:34 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:34.090+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:34.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:34.596+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:34.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:34.596+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:34.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:34.596+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:34.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:34.596+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:34.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:34 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:34.596+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:35.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:35.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:35.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:35.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:35.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:35.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:34 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:34.764+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:35.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:35.073+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:35.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:35.073+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:35.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:35.073+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:35.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:35.073+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:35.562 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:35.073+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.122039+0000 front 2024-06-02T22:55:11.122066+0000 (oldest deadline 2024-06-02T22:55:32.822143+0000) 2024-06-02T22:55:35.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:35.064+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:35.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:35.064+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:35.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:35.064+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:35.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:35.064+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:35.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:35 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:35.064+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:35.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:35 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:35.576+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:36.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:36.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:36.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:36.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:36.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:36.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:35 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:35.724+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:36.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:36.050+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:36.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:36.050+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:36.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:36.050+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:36.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:36.050+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:36.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:36.050+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.122039+0000 front 2024-06-02T22:55:11.122066+0000 (oldest deadline 2024-06-02T22:55:32.822143+0000) 2024-06-02T22:55:36.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:36.103+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:36.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:36.103+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:36.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:36.103+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:36.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:36.103+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:36.313 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:36 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:36.103+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:36.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:36 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:36.620+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:37.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:37.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:37.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:37.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:37.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:37.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:36 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:36.720+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:37.057+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:37.057+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:37.057+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:37.057+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:37.057+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:37.045+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:35.214861+0000 front 2024-06-02T22:54:35.214949+0000 (oldest deadline 2024-06-02T22:54:59.314964+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:37.045+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.716758+0000 front 2024-06-02T22:54:42.716843+0000 (oldest deadline 2024-06-02T22:55:05.616942+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:37.045+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:53.118846+0000 front 2024-06-02T22:54:53.118900+0000 (oldest deadline 2024-06-02T22:55:15.418753+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:37.045+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:00.620745+0000 front 2024-06-02T22:55:00.620618+0000 (oldest deadline 2024-06-02T22:55:25.821166+0000) 2024-06-02T22:55:37.312 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:37 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8[55460]: 2024-06-02T22:55:37.045+0000 7fbb707b2700 -1 osd.8 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.122039+0000 front 2024-06-02T22:55:11.122066+0000 (oldest deadline 2024-06-02T22:55:32.822143+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:37.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:37 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:37.582+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:38.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:38.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:38.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:38.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:38.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:38.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:37 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:37.767+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:38.498 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:38.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:38.499 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:38.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:38.499 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:38.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:38.499 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:38.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:38.499 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:38.104+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:38.776 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:38 smithi178 podman[75016]: 2024-06-02 22:55:38.4994467 +0000 UTC m=+5.566478556 container died c98c08109731f0728a96e0255ac105ff8be23f733ea429b31f504068730305f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-02T22:55:38.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:38.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:38.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:38.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:38.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:38.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:38 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:38.544+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:39.061 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:38 smithi178 podman[75016]: 2024-06-02 22:55:38.880162321 +0000 UTC m=+5.947194198 container cleanup c98c08109731f0728a96e0255ac105ff8be23f733ea429b31f504068730305f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-02T22:55:39.062 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:38 smithi178 bash[75016]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8 2024-06-02T22:55:39.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:39.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:39.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:39.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:39.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:39.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:38 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:38.763+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:39.451 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75031]: 2024-06-02 22:55:39.131449803 +0000 UTC m=+0.635556278 container remove c98c08109731f0728a96e0255ac105ff8be23f733ea429b31f504068730305f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:55:39.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:39.092+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:39.451 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:39.092+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:39.452 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:39.092+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:39.452 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:39.092+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:39.452 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:39 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:39.093+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:39.724 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75122]: 2024-06-02 22:55:39.354864698 +0000 UTC m=+0.016809376 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:39.724 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75122]: 2024-06-02 22:55:39.493633773 +0000 UTC m=+0.155578433 container create c7d1ba64b3b95566273307339da78cf80c91df34cc4721223d8cd9466d30f45d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T22:55:39.724 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75122]: 2024-06-02 22:55:39.724630164 +0000 UTC m=+0.386574822 container init c7d1ba64b3b95566273307339da78cf80c91df34cc4721223d8cd9466d30f45d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:39.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:39 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:39.532+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:40.017 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75122]: 2024-06-02 22:55:39.728154469 +0000 UTC m=+0.390099132 container start c7d1ba64b3b95566273307339da78cf80c91df34cc4721223d8cd9466d30f45d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-06-02T22:55:40.017 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:39 smithi178 podman[75122]: 2024-06-02 22:55:39.833006706 +0000 UTC m=+0.494951378 container attach c7d1ba64b3b95566273307339da78cf80c91df34cc4721223d8cd9466d30f45d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-02T22:55:40.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:40.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:40.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:40.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:40.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:40.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:39 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:39.731+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:40.291 INFO:journalctl@ceph.osd.8.smithi178.stdout:Jun 02 22:55:40 smithi178 podman[75122]: 2024-06-02 22:55:40.018253479 +0000 UTC m=+0.680198158 container died c7d1ba64b3b95566273307339da78cf80c91df34cc4721223d8cd9466d30f45d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-02T22:55:40.291 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:40.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:40.291 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:40.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:40.291 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:40.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:40.291 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:40.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:40.292 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:40 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:40.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:40.705 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-02T22:55:40.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:40.741 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-02T22:55:40.742 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-02T22:55:40.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.9 2024-06-02T22:55:40.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:40.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:40.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:40.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:40.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:40.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:40 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:40.492+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:41.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:40.740+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:41.123 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:40 smithi031 systemd[1]: Stopping Ceph osd.9 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:41.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:41.159+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:41.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:41.159+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:41.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:41.159+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:41.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:41.159+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:41.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:41.159+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:41.621 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.350+0000 7f59cae00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:41.621 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.350+0000 7f59cae00700 -1 osd.9 103 *** Got signal Terminated *** 2024-06-02T22:55:41.621 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.350+0000 7f59cae00700 -1 osd.9 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:41.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:41 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:41.493+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:42.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:41 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:41.757+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:42.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:42 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:42.142+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:42.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:42 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:42.142+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:42.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:42 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:42.142+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:42.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:42 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:42.142+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:42.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:42 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:42.142+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:42.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:42 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:42.536+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:43.025 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:42 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:42.725+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:43.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:43 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:43.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:43.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:43 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:43.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:43.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:43 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:43.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:43.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:43 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:43.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:43.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:43 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:43.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:43.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:43 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:43.563+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:44.060 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:43 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:43.756+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:44.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:44 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:44.202+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:44.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:44 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:44.202+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:44.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:44 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:44.202+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:44.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:44 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:44.202+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:44.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:44 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:44.202+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:44.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:44 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:44.579+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:45.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:45.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:45.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:45.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:45.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:45.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:44 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:44.742+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:45.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:45.210+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:45.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:45.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:45 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:45.533+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:46.121 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.973675+0000 front 2024-06-02T22:54:24.973779+0000 (oldest deadline 2024-06-02T22:54:47.873867+0000) 2024-06-02T22:55:46.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:33.679644+0000 front 2024-06-02T22:54:33.679738+0000 (oldest deadline 2024-06-02T22:54:57.779915+0000) 2024-06-02T22:55:46.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:44.086953+0000 front 2024-06-02T22:54:44.087035+0000 (oldest deadline 2024-06-02T22:55:05.787177+0000) 2024-06-02T22:55:46.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:49.291129+0000 front 2024-06-02T22:54:49.291067+0000 (oldest deadline 2024-06-02T22:55:19.290889+0000) 2024-06-02T22:55:46.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:02.693567+0000 front 2024-06-02T22:55:02.693651+0000 (oldest deadline 2024-06-02T22:55:27.294743+0000) 2024-06-02T22:55:46.122 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:45 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9[66749]: 2024-06-02T22:55:45.744+0000 7f59c1600700 -1 osd.9 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:09.597358+0000 front 2024-06-02T22:55:09.597552+0000 (oldest deadline 2024-06-02T22:55:33.097628+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:46.463 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:46 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:46.172+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:46.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:46.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:46 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:46.558+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:47.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:47 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:47.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:47.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:47 smithi031 podman[101302]: 2024-06-02 22:55:47.442230448 +0000 UTC m=+6.212611328 container died ea87695e7861301091e4756333cf4b56c8e3f2d51b7e9f2f094718ae958c7b7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-02T22:55:47.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:47.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:47.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:47.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:47.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:47.964 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:47.964 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:47 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:47.513+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:48.255 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:48 smithi031 podman[101302]: 2024-06-02 22:55:48.027114378 +0000 UTC m=+6.797495254 container cleanup ea87695e7861301091e4756333cf4b56c8e3f2d51b7e9f2f094718ae958c7b7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-02T22:55:48.255 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:48 smithi031 bash[101302]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:48.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:48 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:48.228+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:48.621 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:48 smithi031 podman[101331]: 2024-06-02 22:55:48.253135526 +0000 UTC m=+0.797158358 container remove ea87695e7861301091e4756333cf4b56c8e3f2d51b7e9f2f094718ae958c7b7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:48.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:48.964 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:48 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:48.471+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:49.371 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:49 smithi031 podman[101419]: 2024-06-02 22:55:49.017236262 +0000 UTC m=+0.034609586 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:49.371 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:49 smithi031 podman[101419]: 2024-06-02 22:55:49.129016857 +0000 UTC m=+0.146390198 container create aeaf4eb6076788c85f0f744a2e868b5416e1bb741a06b1ad67e5a94e5b934f73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:49.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:49.214+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:49.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:49 smithi031 podman[101419]: 2024-06-02 22:55:49.557809677 +0000 UTC m=+0.575183013 container init aeaf4eb6076788c85f0f744a2e868b5416e1bb741a06b1ad67e5a94e5b934f73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:55:49.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:49 smithi031 podman[101419]: 2024-06-02 22:55:49.570077839 +0000 UTC m=+0.587451228 container start aeaf4eb6076788c85f0f744a2e868b5416e1bb741a06b1ad67e5a94e5b934f73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:55:49.871 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:49 smithi031 podman[101419]: 2024-06-02 22:55:49.656473003 +0000 UTC m=+0.673846392 container attach aeaf4eb6076788c85f0f744a2e868b5416e1bb741a06b1ad67e5a94e5b934f73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-02T22:55:49.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:49.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:49 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:49.469+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:50.371 INFO:journalctl@ceph.osd.9.smithi031.stdout:Jun 02 22:55:50 smithi031 podman[101419]: 2024-06-02 22:55:50.045678234 +0000 UTC m=+1.063051553 container died aeaf4eb6076788c85f0f744a2e868b5416e1bb741a06b1ad67e5a94e5b934f73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:50.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:50 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:50.211+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:50.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:50 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:50.475+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:51.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-02T22:55:51.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:51.137 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-02T22:55:51.138 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-02T22:55:51.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.10 2024-06-02T22:55:51.439 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 systemd[1]: Stopping Ceph osd.10 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:51.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:51 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:51.171+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:51.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.440+0000 7f024bd14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:51.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.440+0000 7f024bd14700 -1 osd.10 103 *** Got signal Terminated *** 2024-06-02T22:55:51.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.440+0000 7f024bd14700 -1 osd.10 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:55:51.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:51.714 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:51 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:51.525+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:52.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:52.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:52 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:52.188+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:52.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:52.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:52 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:52.538+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:53.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:53 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:53.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:53.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:53.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:53 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:53.583+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:54.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:54 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:54.169+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:54.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:54.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:54 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:54.614+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:55.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:55.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:55.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:55.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:55.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:55.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:55.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:55 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:55.134+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:55.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:24.195048+0000 front 2024-06-02T22:54:24.195158+0000 (oldest deadline 2024-06-02T22:54:48.294906+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6804 osd.1 since back 2024-06-02T22:54:31.696535+0000 front 2024-06-02T22:54:31.696574+0000 (oldest deadline 2024-06-02T22:54:57.596699+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:42.897979+0000 front 2024-06-02T22:54:42.897963+0000 (oldest deadline 2024-06-02T22:55:08.798066+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:48.798682+0000 front 2024-06-02T22:54:48.798800+0000 (oldest deadline 2024-06-02T22:55:14.698466+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:54:59.299728+0000 front 2024-06-02T22:54:59.299754+0000 (oldest deadline 2024-06-02T22:55:24.500478+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:11.302958+0000 front 2024-06-02T22:55:11.302927+0000 (oldest deadline 2024-06-02T22:55:35.402892+0000) 2024-06-02T22:55:55.963 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:55 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10[61667]: 2024-06-02T22:55:55.589+0000 7f0244300700 -1 osd.10 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:17.104272+0000 front 2024-06-02T22:55:17.104361+0000 (oldest deadline 2024-06-02T22:55:41.204174+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:56.518 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:56.519 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:56 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:56.132+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:57.289 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:57 smithi098 podman[73596]: 2024-06-02 22:55:57.014994659 +0000 UTC m=+5.678374420 container died 84a10dca0c6df1d91186a1b6190003391fd54f526b6ae3fcb549cc43fa54aef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:57.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:57 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:57.156+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:57.657 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:57 smithi098 podman[73596]: 2024-06-02 22:55:57.373167854 +0000 UTC m=+6.036547607 container cleanup 84a10dca0c6df1d91186a1b6190003391fd54f526b6ae3fcb549cc43fa54aef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-02T22:55:57.657 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:57 smithi098 bash[73596]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10 2024-06-02T22:55:57.962 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:57 smithi098 podman[73610]: 2024-06-02 22:55:57.657997024 +0000 UTC m=+0.640179068 container remove 84a10dca0c6df1d91186a1b6190003391fd54f526b6ae3fcb549cc43fa54aef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-02T22:55:58.260 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:57 smithi098 podman[73698]: 2024-06-02 22:55:57.888354764 +0000 UTC m=+0.017044068 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:55:58.260 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:58 smithi098 podman[73698]: 2024-06-02 22:55:58.000459284 +0000 UTC m=+0.129148575 container create 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-02T22:55:58.261 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:58 smithi098 podman[73698]: 2024-06-02 22:55:58.20320828 +0000 UTC m=+0.331897571 container init 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS) 2024-06-02T22:55:58.261 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:58 smithi098 podman[73698]: 2024-06-02 22:55:58.206204836 +0000 UTC m=+0.334894124 container start 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5) 2024-06-02T22:55:58.261 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:58 smithi098 podman[73698]: 2024-06-02 22:55:58.26121757 +0000 UTC m=+0.389906872 container attach 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:58.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:58 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:58.161+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:58.713 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:58 smithi098 podman[73698]: 2024-06-02 22:55:58.501559994 +0000 UTC m=+0.630249287 container died 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3d89acc) 2024-06-02T22:55:59.057 INFO:journalctl@ceph.osd.10.smithi098.stdout:Jun 02 22:55:59 smithi098 podman[73723]: 2024-06-02 22:55:59.056325417 +0000 UTC m=+0.548612129 container remove 148fbd5342ac0cd2d6665c0b01bba301ee9b4e7a65cc530889b6dc2a3ad12836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-02T22:55:59.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-02T22:55:59.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:55:59.114 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-02T22:55:59.114 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-02T22:55:59.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.11 2024-06-02T22:55:59.446 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 systemd[1]: Stopping Ceph osd.11 for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.446+0000 7f8529b75700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.446+0000 7f8529b75700 -1 osd.11 103 *** Got signal Terminated *** 2024-06-02T22:55:59.447 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:55:59 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:55:59.446+0000 7f8529b75700 -1 osd.11 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T22:56:00.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:56:00.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:00 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:00.152+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:56:01.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:01 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:01.170+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-02T22:55:36.711415+0000 front 2024-06-02T22:55:36.711385+0000 (oldest deadline 2024-06-02T22:56:00.211367+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.178+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:56:02.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:02 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:02.179+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-02T22:55:36.711415+0000 front 2024-06-02T22:55:36.711385+0000 (oldest deadline 2024-06-02T22:56:00.211367+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:56:03.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:03 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:03.177+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-02T22:55:36.711415+0000 front 2024-06-02T22:55:36.711385+0000 (oldest deadline 2024-06-02T22:56:00.211367+0000) 2024-06-02T22:56:04.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6806 osd.0 since back 2024-06-02T22:54:26.199712+0000 front 2024-06-02T22:54:26.199429+0000 (oldest deadline 2024-06-02T22:54:47.899094+0000) 2024-06-02T22:56:04.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6804 osd.2 since back 2024-06-02T22:54:43.002788+0000 front 2024-06-02T22:54:43.002816+0000 (oldest deadline 2024-06-02T22:55:07.603571+0000) 2024-06-02T22:56:04.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6814 osd.3 since back 2024-06-02T22:54:51.704894+0000 front 2024-06-02T22:54:51.705048+0000 (oldest deadline 2024-06-02T22:55:15.804788+0000) 2024-06-02T22:56:04.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6812 osd.4 since back 2024-06-02T22:55:01.105961+0000 front 2024-06-02T22:55:01.105944+0000 (oldest deadline 2024-06-02T22:55:27.005998+0000) 2024-06-02T22:56:04.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6812 osd.5 since back 2024-06-02T22:55:08.106987+0000 front 2024-06-02T22:55:08.107072+0000 (oldest deadline 2024-06-02T22:55:34.007098+0000) 2024-06-02T22:56:04.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.31:6822 osd.6 since back 2024-06-02T22:55:19.709598+0000 front 2024-06-02T22:55:19.709490+0000 (oldest deadline 2024-06-02T22:55:45.009272+0000) 2024-06-02T22:56:04.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.98:6820 osd.7 since back 2024-06-02T22:55:29.710478+0000 front 2024-06-02T22:55:29.710462+0000 (oldest deadline 2024-06-02T22:55:50.810378+0000) 2024-06-02T22:56:04.563 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:04 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11[62373]: 2024-06-02T22:56:04.200+0000 7f8526169700 -1 osd.11 103 heartbeat_check: no reply from 172.21.15.178:6820 osd.8 since back 2024-06-02T22:55:36.711415+0000 front 2024-06-02T22:55:36.711385+0000 (oldest deadline 2024-06-02T22:56:00.211367+0000) 2024-06-02T22:56:05.271 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 podman[75239]: 2024-06-02 22:56:05.014706481 +0000 UTC m=+5.700072198 container died 1e1b9b2f713fde4d78112a405c092032a733640fab862f58243cede653b4532f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-02T22:56:05.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 podman[75239]: 2024-06-02 22:56:05.363061075 +0000 UTC m=+6.048426791 container cleanup 1e1b9b2f713fde4d78112a405c092032a733640fab862f58243cede653b4532f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-02T22:56:05.562 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 bash[75239]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11 2024-06-02T22:56:05.964 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 podman[75253]: 2024-06-02 22:56:05.656147616 +0000 UTC m=+0.640463706 container remove 1e1b9b2f713fde4d78112a405c092032a733640fab862f58243cede653b4532f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-02T22:56:06.275 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 podman[75340]: 2024-06-02 22:56:05.965296161 +0000 UTC m=+0.110017018 container create 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-02T22:56:06.275 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:05 smithi178 podman[75340]: 2024-06-02 22:56:05.872523728 +0000 UTC m=+0.017244606 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-02T22:56:06.275 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:06 smithi178 podman[75340]: 2024-06-02 22:56:06.192965131 +0000 UTC m=+0.337686013 container init 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:56:06.275 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:06 smithi178 podman[75340]: 2024-06-02 22:56:06.196266645 +0000 UTC m=+0.340987510 container start 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-02T22:56:06.275 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:06 smithi178 podman[75340]: 2024-06-02 22:56:06.275888071 +0000 UTC m=+0.420608963 container attach 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-02T22:56:06.561 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:06 smithi178 podman[75340]: 2024-06-02 22:56:06.4840084 +0000 UTC m=+0.628729265 container died 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-02T22:56:07.028 INFO:journalctl@ceph.osd.11.smithi178.stdout:Jun 02 22:56:07 smithi178 podman[75366]: 2024-06-02 22:56:07.012318478 +0000 UTC m=+0.522520503 container remove 4fd413e51610b07bfc6fa07749b61a70eabf3c8e5bfbd0c637c8f90a6939d5f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:56:07.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-02T22:56:07.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:07.073 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-02T22:56:07.073 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-02T22:56:07.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.a 2024-06-02T22:56:07.621 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:07 smithi031 systemd[1]: Stopping Ceph mds.a for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:08.121 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: 2024-06-02T22:56:07.667+0000 7f8a01000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:08.121 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:07 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a[73552]: 2024-06-02T22:56:07.667+0000 7f8a01000700 -1 mds.a *** got signal Terminated *** 2024-06-02T22:56:09.024 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:08 smithi031 podman[101522]: 2024-06-02 22:56:08.760731247 +0000 UTC m=+1.234931673 container died 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-02T22:56:09.372 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:09 smithi031 podman[101522]: 2024-06-02 22:56:09.177285246 +0000 UTC m=+1.651485729 container cleanup 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-02T22:56:09.372 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:09 smithi031 bash[101522]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a 2024-06-02T22:56:09.871 INFO:journalctl@ceph.mds.a.smithi031.stdout:Jun 02 22:56:09 smithi031 podman[101536]: 2024-06-02 22:56:09.543825032 +0000 UTC m=+0.753049817 container remove 2511ce9313f857f310d1a5636d05b4c88b1be391c6696627de9c92f0160440e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0) 2024-06-02T22:56:10.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-02T22:56:10.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:10.281 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-02T22:56:10.281 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-02T22:56:10.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.d 2024-06-02T22:56:10.845 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:10 smithi031 systemd[1]: Stopping Ceph mds.d for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:11.121 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d[72382]: 2024-06-02T22:56:10.844+0000 7fe744200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:11.121 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:10 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d[72382]: 2024-06-02T22:56:10.844+0000 7fe744200700 -1 mds.d *** got signal Terminated *** 2024-06-02T22:56:12.121 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:11 smithi031 podman[101645]: 2024-06-02 22:56:11.959390713 +0000 UTC m=+1.254209150 container died db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, RELEASE=squid-3d89acc, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:56:12.621 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:12 smithi031 podman[101645]: 2024-06-02 22:56:12.422389039 +0000 UTC m=+1.717207476 container cleanup db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-02T22:56:12.621 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:12 smithi031 bash[101645]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d 2024-06-02T22:56:13.121 INFO:journalctl@ceph.mds.d.smithi031.stdout:Jun 02 22:56:12 smithi031 podman[101666]: 2024-06-02 22:56:12.665489852 +0000 UTC m=+0.688342974 container remove db78413fcb658d620592f249bc2182ccfe1e0d714f1e6d47903076542b466417 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-d, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528) 2024-06-02T22:56:13.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-02T22:56:13.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:13.349 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-02T22:56:13.350 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-02T22:56:13.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.g 2024-06-02T22:56:13.871 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:13 smithi031 systemd[1]: Stopping Ceph mds.g for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:14.371 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: 2024-06-02T22:56:14.025+0000 7ffa1e000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:14.371 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:14 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g[73152]: 2024-06-02T22:56:14.025+0000 7ffa1e000700 -1 mds.g *** got signal Terminated *** 2024-06-02T22:56:17.121 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:16 smithi031 podman[101772]: 2024-06-02 22:56:16.747315386 +0000 UTC m=+2.886414767 container died 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-02T22:56:17.569 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:17 smithi031 podman[101772]: 2024-06-02 22:56:17.334731125 +0000 UTC m=+3.473830540 container cleanup 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-02T22:56:17.569 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:17 smithi031 bash[101772]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g 2024-06-02T22:56:17.871 INFO:journalctl@ceph.mds.g.smithi031.stdout:Jun 02 22:56:17 smithi031 podman[101786]: 2024-06-02 22:56:17.569113745 +0000 UTC m=+0.805241733 container remove 6df0c493ca23a1b7305cc9caab78ecf8a0f8a5a63342837fe7154d3730be5e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-g, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-02T22:56:18.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-02T22:56:18.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:18.224 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-02T22:56:18.224 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-02T22:56:18.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.j 2024-06-02T22:56:18.819 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:18 smithi031 systemd[1]: Stopping Ceph mds.j for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:19.121 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: 2024-06-02T22:56:18.819+0000 7f466fc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:19.121 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:18 smithi031 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j[71955]: 2024-06-02T22:56:18.819+0000 7f466fc00700 -1 mds.j *** got signal Terminated *** 2024-06-02T22:56:21.058 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:20 smithi031 podman[101892]: 2024-06-02 22:56:20.735510292 +0000 UTC m=+2.036542425 container died 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528) 2024-06-02T22:56:21.371 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:21 smithi031 podman[101892]: 2024-06-02 22:56:21.154719698 +0000 UTC m=+2.455751841 container cleanup 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-02T22:56:21.371 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:21 smithi031 bash[101892]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j 2024-06-02T22:56:21.871 INFO:journalctl@ceph.mds.j.smithi031.stdout:Jun 02 22:56:21 smithi031 podman[101905]: 2024-06-02 22:56:21.438943864 +0000 UTC m=+0.683545960 container remove 4fdbd2d526f908ab9afbb353e13d1b822a3cb91dab339d0b762073cf5e8ddac2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-j, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-06-02T22:56:22.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-02T22:56:22.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:22.137 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-02T22:56:22.137 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-02T22:56:22.137 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.b 2024-06-02T22:56:22.449 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:22 smithi098 systemd[1]: Stopping Ceph mds.b for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:22.709 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b[66875]: 2024-06-02T22:56:22.449+0000 7f8e62df8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:22.710 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:22 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b[66875]: 2024-06-02T22:56:22.449+0000 7f8e62df8700 -1 mds.b *** got signal Terminated *** 2024-06-02T22:56:24.916 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:24 smithi098 podman[73801]: 2024-06-02 22:56:24.610785915 +0000 UTC m=+2.277022126 container died c3a6a2fb06c747f30c6d4da6482f9ceab85459e6ddcc1308e88d6584d387ff45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-02T22:56:25.212 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:24 smithi098 podman[73801]: 2024-06-02 22:56:24.99950143 +0000 UTC m=+2.665737633 container cleanup c3a6a2fb06c747f30c6d4da6482f9ceab85459e6ddcc1308e88d6584d387ff45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True) 2024-06-02T22:56:25.213 INFO:journalctl@ceph.mds.b.smithi098.stdout:Jun 02 22:56:24 smithi098 bash[73801]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-b 2024-06-02T22:56:25.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-02T22:56:25.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:25.421 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-02T22:56:25.421 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-02T22:56:25.421 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.e 2024-06-02T22:56:25.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:25 smithi098 systemd[1]: Stopping Ceph mds.e for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:25.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: 2024-06-02T22:56:25.752+0000 7f1f10d4c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:25.963 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:25 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e[66257]: 2024-06-02T22:56:25.752+0000 7f1f10d4c700 -1 mds.e *** got signal Terminated *** 2024-06-02T22:56:28.929 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:28 smithi098 podman[73933]: 2024-06-02 22:56:28.632853798 +0000 UTC m=+2.986788442 container died 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True) 2024-06-02T22:56:29.196 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 podman[73933]: 2024-06-02 22:56:29.011919771 +0000 UTC m=+3.365854418 container cleanup 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:56:29.196 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 bash[73933]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e 2024-06-02T22:56:29.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-02T22:56:29.452 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 podman[73947]: 2024-06-02 22:56:29.196743518 +0000 UTC m=+0.562699789 container remove 6467bcb6935a69e937b908ca238f65d7842ea382b6d061abae8ca93ae8d5dea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-02T22:56:29.452 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.e.service: Deactivated successfully. 2024-06-02T22:56:29.452 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 systemd[1]: Stopped Ceph mds.e for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:56:29.452 INFO:journalctl@ceph.mds.e.smithi098.stdout:Jun 02 22:56:29 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.e.service: Consumed 2.658s CPU time. 2024-06-02T22:56:29.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:29.464 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-02T22:56:29.464 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-02T22:56:29.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.h 2024-06-02T22:56:29.712 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:29 smithi098 systemd[1]: Stopping Ceph mds.h for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:30.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: 2024-06-02T22:56:29.823+0000 7f0a010d4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:30.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:29 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h[66559]: 2024-06-02T22:56:29.823+0000 7f0a010d4700 -1 mds.h *** got signal Terminated *** 2024-06-02T22:56:32.891 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:32 smithi098 podman[74053]: 2024-06-02 22:56:32.632165635 +0000 UTC m=+2.944052175 container died daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-02T22:56:33.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:32 smithi098 podman[74053]: 2024-06-02 22:56:32.982887472 +0000 UTC m=+3.294774012 container cleanup daf652c1ae34de246bee649b2fbdb0076f92cf0a68066966f1887bcf42743fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-02T22:56:33.212 INFO:journalctl@ceph.mds.h.smithi098.stdout:Jun 02 22:56:32 smithi098 bash[74053]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-h 2024-06-02T22:56:33.411 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-02T22:56:33.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:33.442 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-02T22:56:33.443 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-02T22:56:33.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.k 2024-06-02T22:56:33.962 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:33 smithi098 systemd[1]: Stopping Ceph mds.k for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:33.963 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k[65954]: 2024-06-02T22:56:33.752+0000 7fc31d6c2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:33.963 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:33 smithi098 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k[65954]: 2024-06-02T22:56:33.752+0000 7fc31d6c2700 -1 mds.k *** got signal Terminated *** 2024-06-02T22:56:37.670 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:37 smithi098 podman[74173]: 2024-06-02 22:56:37.411748701 +0000 UTC m=+3.753970946 container died 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-02T22:56:37.920 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:37 smithi098 podman[74173]: 2024-06-02 22:56:37.745273449 +0000 UTC m=+4.087495739 container cleanup 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-02T22:56:37.920 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:37 smithi098 bash[74173]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k 2024-06-02T22:56:38.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-02T22:56:38.181 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:37 smithi098 podman[74187]: 2024-06-02 22:56:37.921141547 +0000 UTC m=+0.512857859 container remove 4ff0d8065575f3349d74c5d8ab75953e0b8eb955f6a451c9799c3d50979ff3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-02T22:56:38.181 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:38 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.k.service: Deactivated successfully. 2024-06-02T22:56:38.181 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:38 smithi098 systemd[1]: Stopped Ceph mds.k for 52c9257e-212e-11ef-bc9b-c7b262605968. 2024-06-02T22:56:38.181 INFO:journalctl@ceph.mds.k.smithi098.stdout:Jun 02 22:56:38 smithi098 systemd[1]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.k.service: Consumed 1.157s CPU time. 2024-06-02T22:56:38.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:38.191 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-02T22:56:38.191 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-02T22:56:38.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.c 2024-06-02T22:56:38.494 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:38 smithi178 systemd[1]: Stopping Ceph mds.c for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:38.748 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: 2024-06-02T22:56:38.493+0000 7f6ce891e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:38.748 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:38 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c[67787]: 2024-06-02T22:56:38.493+0000 7f6ce891e700 -1 mds.c *** got signal Terminated *** 2024-06-02T22:56:40.928 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:40 smithi178 podman[75444]: 2024-06-02 22:56:40.62444521 +0000 UTC m=+2.229812813 container died 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-02T22:56:41.269 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:41 smithi178 podman[75444]: 2024-06-02 22:56:41.027365324 +0000 UTC m=+2.632732929 container cleanup 337a3ba9741fb2ce4a9c5ff2aefa060832c49b6afe4e42d53966bea256d5f06c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, io.buildah.version=1.33.5) 2024-06-02T22:56:41.269 INFO:journalctl@ceph.mds.c.smithi178.stdout:Jun 02 22:56:41 smithi178 bash[75444]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-c 2024-06-02T22:56:41.404 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-02T22:56:41.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:41.439 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-02T22:56:41.439 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-02T22:56:41.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.f 2024-06-02T22:56:41.561 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:41 smithi178 systemd[1]: Stopping Ceph mds.f for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:42.061 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: 2024-06-02T22:56:41.756+0000 7f780781c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:42.062 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:41 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f[67488]: 2024-06-02T22:56:41.756+0000 7f780781c700 -1 mds.f *** got signal Terminated *** 2024-06-02T22:56:44.922 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:44 smithi178 podman[75578]: 2024-06-02 22:56:44.627976932 +0000 UTC m=+2.971951798 container died d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux ) 2024-06-02T22:56:45.264 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:44 smithi178 podman[75578]: 2024-06-02 22:56:44.997794839 +0000 UTC m=+3.341769701 container cleanup d303537541291f9f763800e39a41fecdc0cd2f8df5cdf1db785512b0ef355057 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-02T22:56:45.264 INFO:journalctl@ceph.mds.f.smithi178.stdout:Jun 02 22:56:44 smithi178 bash[75578]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-f 2024-06-02T22:56:45.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-02T22:56:45.428 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:45.428 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-02T22:56:45.429 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-02T22:56:45.429 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.i 2024-06-02T22:56:45.561 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:45 smithi178 systemd[1]: Stopping Ceph mds.i for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:46.061 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: 2024-06-02T22:56:45.767+0000 7f90d7a9b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:46.061 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:45 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i[68087]: 2024-06-02T22:56:45.767+0000 7f90d7a9b700 -1 mds.i *** got signal Terminated *** 2024-06-02T22:56:48.942 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:48 smithi178 podman[75699]: 2024-06-02 22:56:48.613710695 +0000 UTC m=+2.969315468 container died 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-02T22:56:49.243 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:49 smithi178 podman[75699]: 2024-06-02 22:56:49.026380023 +0000 UTC m=+3.381984795 container cleanup 66a611c848eb636a319a2097cb72c0f87583e62be4a9981d174925b63e873976 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-06-02T22:56:49.243 INFO:journalctl@ceph.mds.i.smithi178.stdout:Jun 02 22:56:49 smithi178 bash[75699]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-i 2024-06-02T22:56:49.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-02T22:56:49.408 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:49.408 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-02T22:56:49.409 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-02T22:56:49.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.l 2024-06-02T22:56:49.561 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:49 smithi178 systemd[1]: Stopping Ceph mds.l for 52c9257e-212e-11ef-bc9b-c7b262605968... 2024-06-02T22:56:50.061 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: 2024-06-02T22:56:49.739+0000 7f5f4bbb9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T22:56:50.062 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:49 smithi178 ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l[67170]: 2024-06-02T22:56:49.739+0000 7f5f4bbb9700 -1 mds.l *** got signal Terminated *** 2024-06-02T22:56:52.903 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:52 smithi178 podman[75819]: 2024-06-02 22:56:52.627728147 +0000 UTC m=+3.004051715 container died fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-02T22:56:53.312 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:52 smithi178 podman[75819]: 2024-06-02 22:56:52.979689794 +0000 UTC m=+3.356013341 container cleanup fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-06-02T22:56:53.312 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:52 smithi178 bash[75819]: ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l 2024-06-02T22:56:53.312 INFO:journalctl@ceph.mds.l.smithi178.stdout:Jun 02 22:56:53 smithi178 podman[75833]: 2024-06-02 22:56:53.147521152 +0000 UTC m=+0.500322739 container remove fc4473041aee29142642a8e28b8c1d032562674e1b6747adeaf3ed66cc473048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-52c9257e-212e-11ef-bc9b-c7b262605968-mds-l, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-02T22:56:53.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-52c9257e-212e-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-02T22:56:53.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T22:56:53.390 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-02T22:56:53.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T22:56:53.724 INFO:teuthology.orchestra.run.smithi031.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:56:58.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T22:56:59.083 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:57:01.574 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T22:57:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T22:57:04.332 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:57:04.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:57:04.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T22:57:04.489 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-02T22:57:04.495 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi031/crash 2024-06-02T22:57:04.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T22:57:04.608 INFO:teuthology.orchestra.run.smithi031.stderr:tar: /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T22:57:04.608 INFO:teuthology.orchestra.run.smithi031.stderr:tar: Error is not recoverable: exiting now 2024-06-02T22:57:04.613 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi098/crash 2024-06-02T22:57:04.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T22:57:04.650 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T22:57:04.651 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-06-02T22:57:04.653 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi178/crash 2024-06-02T22:57:04.654 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T22:57:04.703 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T22:57:04.703 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2024-06-02T22:57:04.704 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-02T22:57:04.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-06-02T22:57:04.872 INFO:tasks.cephadm:Compressing logs... 2024-06-02T22:57:04.873 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T22:57:04.879 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T22:57:04.882 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-02T22:57:04.912 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T22:57:04.912 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log 2024-06-02T22:57:04.913 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-02T22:57:04.915 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-06-02T22:57:04.915 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-06-02T22:57:04.915 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-06-02T22:57:04.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-02T22:57:04.919 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-06-02T22:57:04.919 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-06-02T22:57:04.919 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-02T22:57:04.921 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log 2024-06-02T22:57:04.921 INFO:teuthology.orchestra.run.smithi178.stderr:: No such file or directory 2024-06-02T22:57:04.921 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-06-02T22:57:04.922 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-02T22:57:04.923 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-06-02T22:57:04.963 INFO:teuthology.orchestra.run.smithi031.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-06-02T22:57:04.963 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log 2024-06-02T22:57:04.964 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-02T22:57:04.965 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-06-02T22:57:04.966 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-06-02T22:57:04.968 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-02T22:57:04.969 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.j.log: 87.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-02T22:57:04.969 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-02T22:57:04.970 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-06-02T22:57:04.971 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-06-02T22:57:04.972 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-06-02T22:57:04.973 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-02T22:57:04.974 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-06-02T22:57:04.975 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-02T22:57:04.976 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-06-02T22:57:04.977 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 94.7% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-06-02T22:57:04.978 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-06-02T22:57:04.978 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-02T22:57:04.979 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-06-02T22:57:04.983 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-06-02T22:57:04.983 INFO:teuthology.orchestra.run.smithi031.stderr: 94.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-06-02T22:57:05.020 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-06-02T22:57:05.030 INFO:teuthology.orchestra.run.smithi098.stderr: 93.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-06-02T22:57:05.086 INFO:teuthology.orchestra.run.smithi178.stderr: 83.1% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-02T22:57:05.092 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-02T22:57:05.095 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-02T22:57:05.109 INFO:teuthology.orchestra.run.smithi178.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-02T22:57:05.190 INFO:teuthology.orchestra.run.smithi031.stderr: 83.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-02T22:57:05.201 INFO:teuthology.orchestra.run.smithi098.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-02T22:57:05.208 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-02T22:57:05.227 INFO:teuthology.orchestra.run.smithi178.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-02T22:57:05.237 INFO:teuthology.orchestra.run.smithi178.stderr: 91.0% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-02T22:57:05.239 INFO:teuthology.orchestra.run.smithi098.stderr: 94.7% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-06-02T22:57:05.295 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-02T22:57:05.333 INFO:teuthology.orchestra.run.smithi178.stderr: 94.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-06-02T22:57:05.361 INFO:teuthology.orchestra.run.smithi098.stderr: 83.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-02T22:57:05.364 INFO:teuthology.orchestra.run.smithi098.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-02T22:57:05.491 INFO:teuthology.orchestra.run.smithi031.stderr: 94.6% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-06-02T22:57:05.537 INFO:teuthology.orchestra.run.smithi178.stderr: 87.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-02T22:57:05.554 INFO:teuthology.orchestra.run.smithi031.stderr: 90.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-02T22:57:05.588 INFO:teuthology.orchestra.run.smithi098.stderr: 94.9% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-06-02T22:57:05.712 INFO:teuthology.orchestra.run.smithi098.stderr: 93.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-06-02T22:57:05.824 INFO:teuthology.orchestra.run.smithi031.stderr: 93.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-06-02T22:57:05.887 INFO:teuthology.orchestra.run.smithi178.stderr: 93.2% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-06-02T22:57:06.012 INFO:teuthology.orchestra.run.smithi178.stderr: 93.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-06-02T22:57:06.674 INFO:teuthology.orchestra.run.smithi098.stderr: 91.6% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-06-02T22:57:06.763 INFO:teuthology.orchestra.run.smithi031.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-06-02T22:57:12.868 INFO:teuthology.orchestra.run.smithi031.stderr: 90.3% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-06-02T22:57:14.736 INFO:teuthology.orchestra.run.smithi178.stderr: 91.9% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-06-02T22:57:46.096 INFO:teuthology.orchestra.run.smithi098.stderr: 90.6% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-06-02T22:57:50.043 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-06-02T22:59:38.253 INFO:teuthology.orchestra.run.smithi178.stderr: 90.8% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-02T23:00:11.359 INFO:teuthology.orchestra.run.smithi098.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-02T23:00:39.674 INFO:teuthology.orchestra.run.smithi098.stderr: 90.5% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-06-02T23:01:10.351 INFO:teuthology.orchestra.run.smithi098.stderr: 90.7% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-02T23:01:10.353 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-06-02T23:01:10.353 INFO:teuthology.orchestra.run.smithi098.stderr:real 4m5.457s 2024-06-02T23:01:10.354 INFO:teuthology.orchestra.run.smithi098.stderr:user 5m4.750s 2024-06-02T23:01:10.354 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m10.532s 2024-06-02T23:02:40.156 INFO:teuthology.orchestra.run.smithi178.stderr: 90.5% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-06-02T23:03:00.313 INFO:teuthology.orchestra.run.smithi178.stderr: 90.5% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-06-02T23:03:10.557 INFO:teuthology.orchestra.run.smithi178.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-02T23:03:10.559 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-06-02T23:03:10.559 INFO:teuthology.orchestra.run.smithi178.stderr:real 6m5.663s 2024-06-02T23:03:10.559 INFO:teuthology.orchestra.run.smithi178.stderr:user 5m47.979s 2024-06-02T23:03:10.559 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m12.589s 2024-06-02T23:06:01.908 INFO:teuthology.orchestra.run.smithi031.stderr: 90.5% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-02T23:06:37.693 INFO:teuthology.orchestra.run.smithi031.stderr: 90.5% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-06-02T23:07:10.618 INFO:teuthology.orchestra.run.smithi031.stderr: 90.4% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-02T23:08:11.998 INFO:teuthology.orchestra.run.smithi031.stderr: 90.6% -- replaced with /var/log/ceph/52c9257e-212e-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-06-02T23:08:12.003 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-06-02T23:08:12.003 INFO:teuthology.orchestra.run.smithi031.stderr:real 11m7.080s 2024-06-02T23:08:12.003 INFO:teuthology.orchestra.run.smithi031.stderr:user 14m59.141s 2024-06-02T23:08:12.003 INFO:teuthology.orchestra.run.smithi031.stderr:sys 1m43.962s 2024-06-02T23:08:12.004 INFO:tasks.cephadm:Archiving logs... 2024-06-02T23:08:12.005 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi031/log 2024-06-02T23:08:12.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T23:09:22.996 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi098/log 2024-06-02T23:09:22.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T23:10:17.564 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi178/log 2024-06-02T23:10:17.565 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T23:11:19.458 INFO:tasks.cephadm:Removing cluster... 2024-06-02T23:11:19.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force 2024-06-02T23:11:20.209 INFO:teuthology.orchestra.run.smithi031.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T23:11:22.314 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force 2024-06-02T23:11:22.506 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T23:11:23.211 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 52c9257e-212e-11ef-bc9b-c7b262605968 --force 2024-06-02T23:11:23.691 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 52c9257e-212e-11ef-bc9b-c7b262605968 2024-06-02T23:11:24.418 INFO:tasks.cephadm:Removing cephadm ... 2024-06-02T23:11:24.421 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T23:11:24.506 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T23:11:24.525 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T23:11:24.540 INFO:tasks.cephadm:Teardown complete 2024-06-02T23:11:24.540 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T23:11:24.551 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T23:11:24.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T23:11:24.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T23:11:24.567 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T23:11:24.724 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T23:11:24.741 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T23:11:24.742 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:11:24.750 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:11:24.753 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:11:24.766 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:11:24.767 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:11:24.795 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:11:24.796 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-06-02T23:11:24.796 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +363us[ +376us] +/- 60ms 2024-06-02T23:11:24.796 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -839us[ -839us] +/- 63ms 2024-06-02T23:11:24.796 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +525us[ +525us] +/- 65ms 2024-06-02T23:11:24.796 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:11:24.799 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:11:24.809 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:11:24.809 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-06-02T23:11:24.809 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +375us[ +413us] +/- 61ms 2024-06-02T23:11:24.810 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 -856us[ -829us] +/- 62ms 2024-06-02T23:11:24.810 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +539us[ +566us] +/- 64ms 2024-06-02T23:11:24.810 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:11:24.898 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:11:24.898 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-06-02T23:11:24.898 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +341us[ +319us] +/- 61ms 2024-06-02T23:11:24.898 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -831us[ -852us] +/- 63ms 2024-06-02T23:11:24.898 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +538us[ +517us] +/- 65ms 2024-06-02T23:11:24.899 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:11:24.901 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T23:11:24.918 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T23:11:24.919 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T23:11:25.012 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T23:11:25.335 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T23:11:25.419 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T23:11:25.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:11:25.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:25.631 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:11:25.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:25.661 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:11:25.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:25.690 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T23:11:25.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T23:11:25.771 INFO:teuthology.task.internal:Duration was 3586.804483 seconds 2024-06-02T23:11:25.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T23:11:25.887 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T23:11:25.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T23:11:25.896 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T23:11:25.898 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T23:11:25.951 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:11:25.976 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:11:26.045 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:11:26.490 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T23:11:26.490 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-06-02T23:11:26.491 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T23:11:26.559 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-06-02T23:11:26.559 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T23:11:26.590 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-06-02T23:11:26.590 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T23:11:26.615 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T23:11:26.616 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T23:11:26.623 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T23:11:26.632 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T23:11:26.713 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T23:11:26.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T23:11:26.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T23:11:26.721 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T23:11:27.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T23:11:27.472 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T23:11:27.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T23:11:27.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T23:11:27.596 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T23:11:27.634 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T23:11:27.683 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.691 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.718 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-06-02T23:11:27.739 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-06-02T23:11:27.791 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-06-02T23:11:27.844 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.892 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:27.893 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:27.908 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T23:11:27.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:11:27.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T23:11:27.934 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T23:11:27.936 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi031 2024-06-02T23:11:27.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T23:11:28.043 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi098 2024-06-02T23:11:28.043 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T23:11:28.080 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738600/remote/smithi178 2024-06-02T23:11:28.080 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T23:11:28.117 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T23:11:28.117 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T23:11:28.125 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T23:11:28.127 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T23:11:28.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T23:11:28.195 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T23:11:28.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T23:11:28.250 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T23:11:28.251 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T23:11:28.259 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T23:11:28.261 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T23:11:28.274 INFO:teuthology.orchestra.run.smithi098.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 23:11 /home/ubuntu/cephtest 2024-06-02T23:11:28.276 INFO:teuthology.orchestra.run.smithi178.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 23:11 /home/ubuntu/cephtest 2024-06-02T23:11:28.312 INFO:teuthology.orchestra.run.smithi031.stdout: 393478 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 23:11 /home/ubuntu/cephtest 2024-06-02T23:11:28.315 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T23:11:28.328 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T23:11:28.479 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 3586.8044834136963 failure_reason: 'The following counters failed to be set on mds daemons: {''mds.imported'', ''mds.exported''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-02T23:11:28.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T23:11:28.557 INFO:teuthology.run:FAIL